2024-09-16T01:44:32.825 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T01:44:32.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T01:44:32.946 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906497' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected - object missing on disk - Invalid tag char sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA5jILkSwwN2WWP58jsWO4FeTGsq8D0jIlm4U2v5/IyPvGebgRPpEeXBzKiw7HoQ2NWPPIPhjzTkDaQKwkZyHtw= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPwDla7/EpQhATcE83UWxwdPFDr4+TN7nhYXoq5svbkP7TjvINZLV8SGE8a/HBw1T2NKkCFUdloTXB2sBLqI73k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T01:44:32.946 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-16T01:44:32.947 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-16T01:44:32.947 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T01:44:32.949 INFO:teuthology.task.internal:Checking packages... 2024-09-16T01:44:32.973 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-16T01:44:32.974 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T01:44:32.974 INFO:teuthology.packaging:ref: None 2024-09-16T01:44:32.974 INFO:teuthology.packaging:tag: None 2024-09-16T01:44:32.974 INFO:teuthology.packaging:branch: squid 2024-09-16T01:44:32.974 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:44:32.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T01:44:33.176 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-16T01:44:33.177 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T01:44:33.183 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T01:44:33.184 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T01:44:33.192 INFO:teuthology.task.internal:Saving configuration 2024-09-16T01:44:33.209 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T01:44:33.215 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T01:44:33.234 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 01:39:35.194001', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA5jILkSwwN2WWP58jsWO4FeTGsq8D0jIlm4U2v5/IyPvGebgRPpEeXBzKiw7HoQ2NWPPIPhjzTkDaQKwkZyHtw='} 2024-09-16T01:44:33.254 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 01:39:35.195962', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPwDla7/EpQhATcE83UWxwdPFDr4+TN7nhYXoq5svbkP7TjvINZLV8SGE8a/HBw1T2NKkCFUdloTXB2sBLqI73k='} 2024-09-16T01:44:33.254 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T01:44:33.260 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-16T01:44:33.260 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-16T01:44:33.260 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T01:44:33.321 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad62b63be0>, signals=[15]) 2024-09-16T01:44:33.321 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T01:44:33.329 INFO:teuthology.task.internal:Opening connections... 2024-09-16T01:44:33.330 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:44:33.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:44:33.420 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:44:33.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:44:33.495 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T01:44:33.501 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-09-16T01:44:33.518 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-09-16T01:44:33.519 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-09-16T01:44:33.576 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-09-16T01:44:33.577 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T01:44:33.578 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T01:44:33.578 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T01:44:33.578 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-09-16T01:44:33.591 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-09-16T01:44:33.609 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-09-16T01:44:33.609 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-09-16T01:44:33.667 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-09-16T01:44:33.667 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-09-16T01:44:33.668 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-09-16T01:44:33.668 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-09-16T01:44:33.668 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-09-16T01:44:33.668 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-09-16T01:44:33.668 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T01:44:33.668 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-09-16T01:44:33.668 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-09-16T01:44:33.668 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T01:44:33.668 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-09-16T01:44:33.669 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T01:44:33.669 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T01:44:33.669 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T01:44:33.669 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-09-16T01:44:33.691 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T01:44:33.703 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T01:44:33.710 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T01:44:33.710 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-09-16T01:44:33.713 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-09-16T01:44:33.730 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T01:44:33.738 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T01:44:33.739 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-09-16T01:44:33.770 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-09-16T01:44:33.872 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T01:44:33.924 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T01:44:33.940 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-16T01:44:33.940 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-16T01:44:33.940 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-16T01:44:33.940 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T01:44:33.941 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T01:44:33.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:44:33.958 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-16T01:44:33.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:44:33.959 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-16T01:44:34.016 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-503.el9.x86_64 2024-09-16T01:44:34.016 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.14.0-503.el9.x86_64 2024-09-16T01:44:34.016 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2024-09-16T01:44:34.018 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-503.el9.x86_64 2024-09-16T01:44:34.018 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-503.el9.x86_64 2024-09-16T01:44:34.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-09-16T01:44:36.321 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-16T01:44:36.744 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.2 MB 00:00 2024-09-16T01:44:38.445 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-16T01:44:39.235 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-16T01:44:42.987 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.5 MB 00:00 2024-09-16T01:44:44.479 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-16T01:44:44.760 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-16T01:44:45.484 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-16T01:44:46.278 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-16T01:44:47.341 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-16T01:44:50.922 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-16T01:44:52.929 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T01:44:52.929 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T01:44:53.012 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-16T01:44:53.018 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-16T01:44:53.018 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-09-16T01:44:53.018 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-16T01:44:53.019 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-16T01:44:53.019 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T01:44:53.019 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-16T01:44:53.019 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T01:44:53.019 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T01:44:53.019 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T01:44:53.020 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:44:53.020 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-16T01:44:53.020 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-16T01:44:53.020 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-09-16T01:44:53.020 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:44:53.021 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 79 M 2024-09-16T01:44:53.021 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 126 M 2024-09-16T01:44:53.022 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-16T01:44:53.064 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-16T01:44:53.165 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 230 kB/s | 23 kB 00:00 2024-09-16T01:44:53.572 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-16T01:44:53.957 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-16T01:44:54.283 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-16T01:44:54.283 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:44:54.283 INFO:teuthology.orchestra.run.smithi107.stdout:Total 62 MB/s | 79 MB 00:01 2024-09-16T01:44:54.969 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-16T01:44:55.145 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T01:44:55.145 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T01:44:55.241 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-16T01:44:55.252 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-16T01:44:55.252 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-09-16T01:44:55.253 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:44:55.254 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 79 M 2024-09-16T01:44:55.254 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 126 M 2024-09-16T01:44:55.254 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-16T01:44:55.319 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-16T01:44:55.319 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-16T01:44:55.440 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 261 kB/s | 23 kB 00:00 2024-09-16T01:44:55.882 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-16T01:44:56.275 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-16T01:44:56.276 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-16T01:44:56.565 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-16T01:44:57.008 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 18 MB/s | 29 MB 00:01 2024-09-16T01:44:57.008 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:44:57.008 INFO:teuthology.orchestra.run.smithi042.stdout:Total 45 MB/s | 79 MB 00:01 2024-09-16T01:44:57.718 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-16T01:44:58.116 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-16T01:44:58.116 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-16T01:44:58.732 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-16T01:44:59.124 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-16T01:44:59.125 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-16T01:44:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:44:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:45:01.701 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-16T01:45:02.385 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:45:02.391 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:45:02.476 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:45:02.527 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:45:05.263 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:45:05.405 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:45:07.333 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:45:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:10.529 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:45:10.573 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:12.260 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:15.710 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:50.781 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:51.180 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:51.180 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:45:51.180 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:45:51.180 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:45:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:45:52.005 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-16T01:45:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T01:45:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T01:45:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T01:45:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T01:45:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:45:52.005 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-16T01:45:52.342 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:45:52.482 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:45:52.483 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:45:52.483 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T01:45:52.483 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T01:45:52.483 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T01:45:52.483 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-16T01:45:52.483 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T01:45:52.484 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:45:52.541 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:45:52.542 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:45:52.542 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-09-16T01:45:52.574 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-09-16T01:45:52.575 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-09-16T01:45:52.576 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-09-16T01:45:52.576 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 82.el9 2024-09-16T01:45:52.576 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-09-16T01:45:52.576 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T01:45:52.576 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-09-16T01:45:52.576 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8274670 2024-09-16T01:45:52.576 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-09-16T01:45:52.576 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T01:45:52.577 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T01:45:52.577 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T01:45:52.577 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T01:45:52.577 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-09-16T01:45:52.577 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-09-16T01:45:52.577 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T01:45:52.577 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-09-16T01:45:52.577 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-09-16T01:45:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:45:52.578 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T01:45:52.578 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T01:45:52.578 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T01:45:52.578 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-09-16T01:45:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:45:52.578 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T01:45:52.579 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T01:45:52.579 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 5.14.0-505.el9.x86_64 2024-09-16T01:45:52.579 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T01:45:53.267 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-09-16T01:45:54.575 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T01:45:54.604 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-09-16T01:45:54.606 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-16T01:45:54.623 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.6DJ8Y11a4L 2024-09-16T01:45:54.624 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6DJ8Y11a4L 2024-09-16T01:45:54.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.6DJ8Y11a4L 2024-09-16T01:45:54.794 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:54.827 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.6DJ8Y11a4L is 6KB 2024-09-16T01:45:54.835 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:54.877 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.6DJ8Y11a4L 2024-09-16T01:45:54.893 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T01:45:54.955 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T01:45:54.955 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T01:45:54.955 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T01:45:54.956 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T01:45:54.957 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T01:45:55.124 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-09-16T01:45:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:45:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:45:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:45:55.990 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:45:55.990 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:45:55.991 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-16T01:45:55.991 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T01:45:55.991 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T01:45:55.991 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T01:45:55.991 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T01:45:55.991 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:45:55.991 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-16T01:45:56.326 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:45:56.453 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:45:56.453 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:45:56.453 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T01:45:56.454 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T01:45:56.454 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T01:45:56.454 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-16T01:45:56.454 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T01:45:56.454 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:45:56.512 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:45:56.513 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:45:56.513 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-09-16T01:45:56.552 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-09-16T01:45:56.552 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 82.el9 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8274670 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-09-16T01:45:56.553 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-09-16T01:45:56.554 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T01:45:56.554 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-09-16T01:45:56.554 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-09-16T01:45:56.554 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:45:56.554 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T01:45:56.554 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T01:45:56.554 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T01:45:56.554 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-09-16T01:45:56.554 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:45:56.554 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T01:45:56.555 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T01:45:56.555 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 5.14.0-505.el9.x86_64 2024-09-16T01:45:56.555 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T01:45:57.208 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-09-16T01:45:58.555 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T01:45:58.584 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-09-16T01:45:58.590 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-16T01:45:58.606 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.dNVGg7pAxp 2024-09-16T01:45:58.606 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dNVGg7pAxp 2024-09-16T01:45:58.680 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.dNVGg7pAxp 2024-09-16T01:45:58.817 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.dNVGg7pAxp is 6KB 2024-09-16T01:45:58.866 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.dNVGg7pAxp 2024-09-16T01:45:58.880 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T01:45:58.943 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T01:45:58.943 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T01:45:58.943 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T01:45:58.943 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T01:45:58.945 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T01:45:59.091 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-09-16T01:46:25.150 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-16T01:46:25.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-16T01:46:25.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:46:29.097 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-16T01:46:29.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-16T01:46:29.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:46:59.773 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-16T01:47:08.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-16T01:47:08.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:47:11.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-16T01:47:23.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-16T01:47:23.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:47:26.909 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-16T01:47:29.101 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T01:47:38.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-16T01:47:38.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:47:38.486 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-16T01:47:38.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-16T01:47:38.881 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-16T01:47:38.882 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-16T01:47:38.901 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-505.el9.x86_64 2024-09-16T01:47:38.901 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T01:47:38.901 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T01:47:38.901 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T01:47:39.902 DEBUG:teuthology.parallel:result is None 2024-09-16T01:47:41.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-16T01:47:41.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:47:42.405 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-16T01:47:42.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-16T01:47:42.773 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-16T01:47:42.773 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-16T01:47:42.788 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-505.el9.x86_64 2024-09-16T01:47:42.789 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T01:47:42.789 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T01:47:42.789 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T01:47:43.790 DEBUG:teuthology.parallel:result is None 2024-09-16T01:47:43.790 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T01:47:43.800 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T01:47:43.800 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T01:47:43.805 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T01:47:43.821 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T01:47:43.830 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T01:47:43.843 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T01:47:43.843 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T01:47:43.859 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T01:47:43.890 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T01:47:43.901 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T01:47:43.902 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T01:47:43.927 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T01:47:44.016 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:47:44.023 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:47:44.049 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:47:44.061 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:47:44.063 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T01:47:44.188 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T01:47:44.189 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T01:47:44.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T01:47:44.217 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T01:47:44.270 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T01:47:44.270 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T01:47:44.273 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T01:47:44.288 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:47:44.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:47:44.424 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:47:44.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:47:44.551 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:47:44.552 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T01:47:44.622 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:47:44.665 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:47:44.722 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:47:44.763 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:47:44.800 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:47:44.800 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T01:47:44.862 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-09-16T01:47:44.865 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-09-16T01:47:44.918 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:47:44.949 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:47:45.425 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T01:47:45.433 INFO:teuthology.task.internal:Starting timer... 2024-09-16T01:47:45.433 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T01:47:45.445 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T01:47:45.456 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-16T01:47:45.456 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-09-16T01:47:45.534 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-09-16T01:47:45.537 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-09-16T01:47:45.648 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-09-16T01:47:45.650 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T01:47:45.650 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-09-16T01:47:45.700 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-09-16T01:47:45.701 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-09-16T01:47:45.747 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-09-16T01:47:45.747 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': 'permissive'} 2024-09-16T01:47:45.747 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:47:45.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:47:45.777 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:47:45.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:47:45.826 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T01:47:45.826 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-09-16T01:47:45.866 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-09-16T01:47:46.235 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T01:47:46.244 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T01:47:46.247 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T01:47:46.386 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T01:47:46.398 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T01:47:46.399 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T01:51:35.912 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2024-09-16T01:51:35.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-16T01:51:35.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:51:35.992 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-16T01:51:36.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-16T01:51:36.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-16T01:51:36.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:51:36.148 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-16T01:51:36.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-16T01:51:36.220 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T01:51:36.230 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T01:51:36.230 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T01:51:36.231 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:51:36.233 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T01:51:36.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:51:36.262 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T01:51:36.277 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T01:51:36.289 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T01:51:36.303 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-09-16T01:51:36.304 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T01:51:36.314 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-09-16T01:51:36.328 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-09-16T01:51:36.329 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T01:51:36.339 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-09-16T01:51:36.343 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T01:51:36.353 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T01:51:36.367 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T01:51:36.405 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:51:36.409 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:51:36.409 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-16T01:51:36.409 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:51:36.409 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:51:36.409 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:51:36.410 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:51:36.422 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:51:36.425 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:51:36.425 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-16T01:51:36.426 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:51:36.426 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:51:36.426 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:51:36.426 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:51:36.427 INFO:teuthology.run_tasks:Running task install... 2024-09-16T01:51:36.437 DEBUG:teuthology.task.install:project ceph 2024-09-16T01:51:36.437 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-16T01:51:36.438 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T01:51:36.438 INFO:teuthology.task.install:Using flavor: default 2024-09-16T01:51:36.443 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T01:51:36.443 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-16T01:51:36.444 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T01:51:36.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:51:36.446 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T01:51:36.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:51:36.591 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T01:51:36.591 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T01:51:36.596 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T01:51:36.597 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T01:51:36.702 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T01:51:36.702 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:51:36.702 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T01:51:36.711 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T01:51:36.711 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:51:36.711 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T01:51:36.729 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T01:51:36.729 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T01:51:36.737 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T01:51:36.737 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T01:51:36.796 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T01:51:36.803 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T01:51:36.873 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T01:51:36.878 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T01:51:36.938 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-09-16T01:51:36.939 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-09-16T01:51:36.942 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-09-16T01:51:36.943 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-09-16T01:51:37.177 INFO:teuthology.orchestra.run.smithi042.stdout:45 files removed 2024-09-16T01:51:37.184 INFO:teuthology.orchestra.run.smithi107.stdout:45 files removed 2024-09-16T01:51:37.204 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T01:51:37.214 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T01:51:37.769 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 310 kB/s | 83 kB 00:00 2024-09-16T01:51:37.772 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 312 kB/s | 83 kB 00:00 2024-09-16T01:51:38.056 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-16T01:51:38.078 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-09-16T01:51:38.331 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-16T01:51:38.354 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-16T01:51:39.757 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.2 MB 00:01 2024-09-16T01:51:40.287 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-16T01:51:44.613 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-16T01:51:45.599 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-16T01:51:50.155 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-16T01:51:50.758 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.5 MB 00:01 2024-09-16T01:51:51.822 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-16T01:51:52.542 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-16T01:51:52.959 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-16T01:51:53.480 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-16T01:51:58.490 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-09-16T01:51:59.152 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-16T01:52:00.834 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:52:00.834 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:52:00.845 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T01:52:00.846 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T01:52:00.847 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T01:52:00.848 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T01:52:00.849 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T01:52:00.851 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T01:52:00.852 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T01:52:00.913 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-16T01:52:00.935 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-16T01:52:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T01:52:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T01:52:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T01:52:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T01:52:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T01:52:00.940 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-16T01:52:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T01:52:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T01:52:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T01:52:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T01:52:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T01:52:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T01:52:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T01:52:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T01:52:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T01:52:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T01:52:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T01:52:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T01:52:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T01:52:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T01:52:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T01:52:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T01:52:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T01:52:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T01:52:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T01:52:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T01:52:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T01:52:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T01:52:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T01:52:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T01:52:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T01:52:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T01:52:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T01:52:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T01:52:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T01:52:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T01:52:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T01:52:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T01:52:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T01:52:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T01:52:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T01:52:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T01:52:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T01:52:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T01:52:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T01:52:00.949 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T01:52:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T01:52:00.950 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-09-16T01:52:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T01:52:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:00.950 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-16T01:52:00.950 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================== 2024-09-16T01:52:00.950 INFO:teuthology.orchestra.run.smithi107.stdout:Install 148 Packages 2024-09-16T01:52:00.950 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 8 Packages 2024-09-16T01:52:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:00.951 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 226 M 2024-09-16T01:52:00.951 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-16T01:52:01.598 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:52:01.598 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:52:01.611 INFO:teuthology.orchestra.run.smithi042.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T01:52:01.611 INFO:teuthology.orchestra.run.smithi042.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T01:52:01.612 INFO:teuthology.orchestra.run.smithi042.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T01:52:01.613 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T01:52:01.615 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T01:52:01.617 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T01:52:01.618 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T01:52:01.684 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T01:52:01.703 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T01:52:01.704 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T01:52:01.705 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T01:52:01.706 INFO:teuthology.orchestra.run.smithi042.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T01:52:01.707 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T01:52:01.707 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-16T01:52:01.707 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T01:52:01.707 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T01:52:01.707 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T01:52:01.707 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T01:52:01.707 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T01:52:01.707 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T01:52:01.707 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T01:52:01.707 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T01:52:01.708 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T01:52:01.709 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T01:52:01.710 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T01:52:01.711 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T01:52:01.712 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T01:52:01.713 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T01:52:01.714 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T01:52:01.715 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T01:52:01.716 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T01:52:01.716 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-09-16T01:52:01.716 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T01:52:01.716 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:01.716 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-16T01:52:01.716 INFO:teuthology.orchestra.run.smithi042.stdout:====================================================================================== 2024-09-16T01:52:01.716 INFO:teuthology.orchestra.run.smithi042.stdout:Install 148 Packages 2024-09-16T01:52:01.716 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 8 Packages 2024-09-16T01:52:01.716 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:01.717 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 226 M 2024-09-16T01:52:01.717 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-16T01:52:01.766 INFO:teuthology.orchestra.run.smithi107.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-16T01:52:02.125 INFO:teuthology.orchestra.run.smithi107.stdout:(2/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-16T01:52:02.166 INFO:teuthology.orchestra.run.smithi107.stdout:(3/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 2.2 MB/s | 896 kB 00:00 2024-09-16T01:52:02.192 INFO:teuthology.orchestra.run.smithi107.stdout:(4/156): ceph-immutable-object-cache-19.1.1-326 2.1 MB/s | 145 kB 00:00 2024-09-16T01:52:02.300 INFO:teuthology.orchestra.run.smithi107.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 14 MB/s | 1.5 MB 00:00 2024-09-16T01:52:02.576 INFO:teuthology.orchestra.run.smithi107.stdout:(6/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-16T01:52:02.587 INFO:teuthology.orchestra.run.smithi042.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2024-09-16T01:52:02.784 INFO:teuthology.orchestra.run.smithi107.stdout:(7/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 18 MB/s | 21 MB 00:01 2024-09-16T01:52:02.812 INFO:teuthology.orchestra.run.smithi042.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 3.9 MB/s | 896 kB 00:00 2024-09-16T01:52:02.851 INFO:teuthology.orchestra.run.smithi107.stdout:(8/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 3.5 MB/s | 2.4 MB 00:00 2024-09-16T01:52:02.888 INFO:teuthology.orchestra.run.smithi042.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.9 MB/s | 145 kB 00:00 2024-09-16T01:52:02.918 INFO:teuthology.orchestra.run.smithi107.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 379 kB/s | 25 kB 00:00 2024-09-16T01:52:02.963 INFO:teuthology.orchestra.run.smithi042.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 8.9 MB/s | 5.4 MB 00:00 2024-09-16T01:52:03.222 INFO:teuthology.orchestra.run.smithi042.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 7.2 MB/s | 2.4 MB 00:00 2024-09-16T01:52:03.377 INFO:teuthology.orchestra.run.smithi107.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 18 MB/s | 11 MB 00:00 2024-09-16T01:52:03.427 INFO:teuthology.orchestra.run.smithi107.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 4.5 MB/s | 228 kB 00:00 2024-09-16T01:52:03.477 INFO:teuthology.orchestra.run.smithi107.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 543 kB/s | 27 kB 00:00 2024-09-16T01:52:03.488 INFO:teuthology.orchestra.run.smithi042.stdout:(6/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-16T01:52:03.572 INFO:teuthology.orchestra.run.smithi042.stdout:(7/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 2.5 MB/s | 1.5 MB 00:00 2024-09-16T01:52:03.669 INFO:teuthology.orchestra.run.smithi107.stdout:(13/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 15 MB/s | 17 MB 00:01 2024-09-16T01:52:03.694 INFO:teuthology.orchestra.run.smithi107.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 146 kB/s | 32 kB 00:00 2024-09-16T01:52:03.728 INFO:teuthology.orchestra.run.smithi107.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 751 kB 00:00 2024-09-16T01:52:03.753 INFO:teuthology.orchestra.run.smithi107.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.7 MB/s | 163 kB 00:00 2024-09-16T01:52:03.778 INFO:teuthology.orchestra.run.smithi107.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-16T01:52:03.820 INFO:teuthology.orchestra.run.smithi107.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 7.4 MB/s | 506 kB 00:00 2024-09-16T01:52:03.879 INFO:teuthology.orchestra.run.smithi107.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 775 kB/s | 45 kB 00:00 2024-09-16T01:52:03.937 INFO:teuthology.orchestra.run.smithi107.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.3 MB/s | 136 kB 00:00 2024-09-16T01:52:04.004 INFO:teuthology.orchestra.run.smithi107.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.4 MB/s | 161 kB 00:00 2024-09-16T01:52:04.121 INFO:teuthology.orchestra.run.smithi107.stdout:(22/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-16T01:52:04.172 INFO:teuthology.orchestra.run.smithi107.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 1.9 MB/s | 320 kB 00:00 2024-09-16T01:52:04.197 INFO:teuthology.orchestra.run.smithi107.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 3.9 MB/s | 300 kB 00:00 2024-09-16T01:52:04.223 INFO:teuthology.orchestra.run.smithi107.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-16T01:52:04.248 INFO:teuthology.orchestra.run.smithi107.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-16T01:52:04.306 INFO:teuthology.orchestra.run.smithi107.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-16T01:52:04.364 INFO:teuthology.orchestra.run.smithi042.stdout:(8/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 17 MB 00:00 2024-09-16T01:52:04.390 INFO:teuthology.orchestra.run.smithi107.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-16T01:52:04.405 INFO:teuthology.orchestra.run.smithi042.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 611 kB/s | 25 kB 00:00 2024-09-16T01:52:04.415 INFO:teuthology.orchestra.run.smithi107.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 294 kB/s | 32 kB 00:00 2024-09-16T01:52:04.440 INFO:teuthology.orchestra.run.smithi107.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.9 MB/s | 146 kB 00:00 2024-09-16T01:52:04.716 INFO:teuthology.orchestra.run.smithi107.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 12 MB/s | 3.6 MB 00:00 2024-09-16T01:52:04.791 INFO:teuthology.orchestra.run.smithi107.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 3.3 MB/s | 249 kB 00:00 2024-09-16T01:52:04.850 INFO:teuthology.orchestra.run.smithi107.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 844 kB/s | 49 kB 00:00 2024-09-16T01:52:04.933 INFO:teuthology.orchestra.run.smithi107.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-16T01:52:04.950 INFO:teuthology.orchestra.run.smithi107.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 164 kB/s | 16 kB 00:00 2024-09-16T01:52:04.992 INFO:teuthology.orchestra.run.smithi107.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.8 MB/s | 285 kB 00:00 2024-09-16T01:52:05.034 INFO:teuthology.orchestra.run.smithi107.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-16T01:52:05.059 INFO:teuthology.orchestra.run.smithi107.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 273 kB/s | 18 kB 00:00 2024-09-16T01:52:05.081 INFO:teuthology.orchestra.run.smithi042.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 7.0 MB/s | 11 MB 00:01 2024-09-16T01:52:05.139 INFO:teuthology.orchestra.run.smithi042.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.8 MB/s | 228 kB 00:00 2024-09-16T01:52:05.181 INFO:teuthology.orchestra.run.smithi042.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 651 kB/s | 27 kB 00:00 2024-09-16T01:52:05.210 INFO:teuthology.orchestra.run.smithi107.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 456 kB/s | 80 kB 00:00 2024-09-16T01:52:05.223 INFO:teuthology.orchestra.run.smithi042.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 760 kB/s | 32 kB 00:00 2024-09-16T01:52:05.285 INFO:teuthology.orchestra.run.smithi107.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-16T01:52:05.307 INFO:teuthology.orchestra.run.smithi042.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-16T01:52:05.318 INFO:teuthology.orchestra.run.smithi107.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-16T01:52:05.357 INFO:teuthology.orchestra.run.smithi042.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 3.2 MB/s | 163 kB 00:00 2024-09-16T01:52:05.369 INFO:teuthology.orchestra.run.smithi107.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-16T01:52:05.407 INFO:teuthology.orchestra.run.smithi042.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-16T01:52:05.436 INFO:teuthology.orchestra.run.smithi107.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-16T01:52:05.461 INFO:teuthology.orchestra.run.smithi107.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-16T01:52:05.499 INFO:teuthology.orchestra.run.smithi042.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 5.4 MB/s | 506 kB 00:00 2024-09-16T01:52:05.511 INFO:teuthology.orchestra.run.smithi107.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-16T01:52:05.537 INFO:teuthology.orchestra.run.smithi107.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-16T01:52:05.587 INFO:teuthology.orchestra.run.smithi107.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-16T01:52:05.704 INFO:teuthology.orchestra.run.smithi107.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-16T01:52:05.746 INFO:teuthology.orchestra.run.smithi107.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-16T01:52:05.779 INFO:teuthology.orchestra.run.smithi107.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-16T01:52:05.805 INFO:teuthology.orchestra.run.smithi107.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-16T01:52:05.830 INFO:teuthology.orchestra.run.smithi107.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-16T01:52:05.855 INFO:teuthology.orchestra.run.smithi107.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-16T01:52:05.897 INFO:teuthology.orchestra.run.smithi107.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-09-16T01:52:05.942 INFO:teuthology.orchestra.run.smithi042.stdout:(18/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-16T01:52:05.948 INFO:teuthology.orchestra.run.smithi107.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 25 MB/s | 3.0 MB 00:00 2024-09-16T01:52:05.973 INFO:teuthology.orchestra.run.smithi107.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-16T01:52:05.992 INFO:teuthology.orchestra.run.smithi042.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 909 kB/s | 45 kB 00:00 2024-09-16T01:52:05.998 INFO:teuthology.orchestra.run.smithi107.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-16T01:52:06.024 INFO:teuthology.orchestra.run.smithi107.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-16T01:52:06.042 INFO:teuthology.orchestra.run.smithi042.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.7 MB/s | 136 kB 00:00 2024-09-16T01:52:06.065 INFO:teuthology.orchestra.run.smithi107.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-16T01:52:06.092 INFO:teuthology.orchestra.run.smithi042.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 3.2 MB/s | 161 kB 00:00 2024-09-16T01:52:06.107 INFO:teuthology.orchestra.run.smithi107.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-16T01:52:06.133 INFO:teuthology.orchestra.run.smithi107.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-16T01:52:06.151 INFO:teuthology.orchestra.run.smithi042.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 5.4 MB/s | 320 kB 00:00 2024-09-16T01:52:06.166 INFO:teuthology.orchestra.run.smithi107.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-16T01:52:06.192 INFO:teuthology.orchestra.run.smithi107.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-16T01:52:06.210 INFO:teuthology.orchestra.run.smithi042.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.0 MB/s | 300 kB 00:00 2024-09-16T01:52:06.217 INFO:teuthology.orchestra.run.smithi107.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-16T01:52:06.242 INFO:teuthology.orchestra.run.smithi107.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-16T01:52:06.259 INFO:teuthology.orchestra.run.smithi042.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 2.0 MB/s | 99 kB 00:00 2024-09-16T01:52:06.318 INFO:teuthology.orchestra.run.smithi042.stdout:(25/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-16T01:52:06.334 INFO:teuthology.orchestra.run.smithi107.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 42 MB/s | 4.9 MB 00:00 2024-09-16T01:52:06.409 INFO:teuthology.orchestra.run.smithi107.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-09-16T01:52:06.451 INFO:teuthology.orchestra.run.smithi107.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-16T01:52:06.493 INFO:teuthology.orchestra.run.smithi107.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-16T01:52:06.826 INFO:teuthology.orchestra.run.smithi107.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-16T01:52:06.826 INFO:teuthology.orchestra.run.smithi107.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-09-16T01:52:06.826 INFO:teuthology.orchestra.run.smithi107.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-09-16T01:52:06.826 INFO:teuthology.orchestra.run.smithi107.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 806 kB/s | 87 kB 00:00 2024-09-16T01:52:06.826 INFO:teuthology.orchestra.run.smithi107.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-16T01:52:06.826 INFO:teuthology.orchestra.run.smithi107.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-09-16T01:52:06.828 INFO:teuthology.orchestra.run.smithi107.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-16T01:52:06.854 INFO:teuthology.orchestra.run.smithi107.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-16T01:52:06.879 INFO:teuthology.orchestra.run.smithi107.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-09-16T01:52:06.885 INFO:teuthology.orchestra.run.smithi042.stdout:(26/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 20 MB/s | 49 MB 00:02 2024-09-16T01:52:06.904 INFO:teuthology.orchestra.run.smithi107.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-16T01:52:06.930 INFO:teuthology.orchestra.run.smithi107.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-16T01:52:06.955 INFO:teuthology.orchestra.run.smithi107.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-16T01:52:06.997 INFO:teuthology.orchestra.run.smithi107.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-16T01:52:07.075 INFO:teuthology.orchestra.run.smithi107.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 35 MB/s | 5.1 MB 00:00 2024-09-16T01:52:07.100 INFO:teuthology.orchestra.run.smithi107.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.1 MB/s | 222 kB 00:00 2024-09-16T01:52:07.110 INFO:teuthology.orchestra.run.smithi042.stdout:(27/156): ceph-common-19.1.1-326.g8921c8ef.el9. 4.5 MB/s | 21 MB 00:04 2024-09-16T01:52:07.125 INFO:teuthology.orchestra.run.smithi107.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-16T01:52:07.151 INFO:teuthology.orchestra.run.smithi107.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-16T01:52:07.161 INFO:teuthology.orchestra.run.smithi042.stdout:(28/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 620 kB/s | 170 kB 00:00 2024-09-16T01:52:07.176 INFO:teuthology.orchestra.run.smithi107.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-16T01:52:07.186 INFO:teuthology.orchestra.run.smithi042.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 424 kB/s | 32 kB 00:00 2024-09-16T01:52:07.201 INFO:teuthology.orchestra.run.smithi107.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-16T01:52:07.220 INFO:teuthology.orchestra.run.smithi042.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.4 MB/s | 146 kB 00:00 2024-09-16T01:52:07.226 INFO:teuthology.orchestra.run.smithi107.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-16T01:52:07.251 INFO:teuthology.orchestra.run.smithi107.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-16T01:52:07.270 INFO:teuthology.orchestra.run.smithi042.stdout:(31/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 3.3 MB/s | 3.1 MB 00:00 2024-09-16T01:52:07.277 INFO:teuthology.orchestra.run.smithi107.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-16T01:52:07.319 INFO:teuthology.orchestra.run.smithi107.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-16T01:52:07.345 INFO:teuthology.orchestra.run.smithi042.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 3.3 MB/s | 249 kB 00:00 2024-09-16T01:52:07.361 INFO:teuthology.orchestra.run.smithi107.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-16T01:52:07.396 INFO:teuthology.orchestra.run.smithi042.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 989 kB/s | 49 kB 00:00 2024-09-16T01:52:07.403 INFO:teuthology.orchestra.run.smithi107.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-16T01:52:07.445 INFO:teuthology.orchestra.run.smithi107.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 868 kB/s | 36 kB 00:00 2024-09-16T01:52:07.446 INFO:teuthology.orchestra.run.smithi042.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 329 kB/s | 16 kB 00:00 2024-09-16T01:52:07.505 INFO:teuthology.orchestra.run.smithi042.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.8 MB/s | 285 kB 00:00 2024-09-16T01:52:07.612 INFO:teuthology.orchestra.run.smithi107.stdout:(96/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-09-16T01:52:07.613 INFO:teuthology.orchestra.run.smithi042.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 19 MB/s | 7.4 MB 00:00 2024-09-16T01:52:07.637 INFO:teuthology.orchestra.run.smithi107.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 247 kB/s | 47 kB 00:00 2024-09-16T01:52:07.655 INFO:teuthology.orchestra.run.smithi042.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-16T01:52:07.662 INFO:teuthology.orchestra.run.smithi107.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-16T01:52:07.680 INFO:teuthology.orchestra.run.smithi042.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 274 kB/s | 18 kB 00:00 2024-09-16T01:52:07.688 INFO:teuthology.orchestra.run.smithi107.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-16T01:52:07.713 INFO:teuthology.orchestra.run.smithi107.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-16T01:52:07.738 INFO:teuthology.orchestra.run.smithi107.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T01:52:07.756 INFO:teuthology.orchestra.run.smithi042.stdout:(39/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 6.3 MB/s | 3.6 MB 00:00 2024-09-16T01:52:07.764 INFO:teuthology.orchestra.run.smithi107.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-16T01:52:07.797 INFO:teuthology.orchestra.run.smithi042.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-09-16T01:52:07.830 INFO:teuthology.orchestra.run.smithi107.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-16T01:52:07.873 INFO:teuthology.orchestra.run.smithi042.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-16T01:52:07.898 INFO:teuthology.orchestra.run.smithi042.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-16T01:52:07.906 INFO:teuthology.orchestra.run.smithi107.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-16T01:52:07.932 INFO:teuthology.orchestra.run.smithi042.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-16T01:52:07.956 INFO:teuthology.orchestra.run.smithi107.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 6.0 MB/s | 308 kB 00:00 2024-09-16T01:52:07.957 INFO:teuthology.orchestra.run.smithi042.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-16T01:52:07.982 INFO:teuthology.orchestra.run.smithi107.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-16T01:52:07.982 INFO:teuthology.orchestra.run.smithi042.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-16T01:52:08.007 INFO:teuthology.orchestra.run.smithi107.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-16T01:52:08.007 INFO:teuthology.orchestra.run.smithi042.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-16T01:52:08.041 INFO:teuthology.orchestra.run.smithi042.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-09-16T01:52:08.049 INFO:teuthology.orchestra.run.smithi107.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-09-16T01:52:08.066 INFO:teuthology.orchestra.run.smithi042.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-16T01:52:08.074 INFO:teuthology.orchestra.run.smithi107.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-16T01:52:08.108 INFO:teuthology.orchestra.run.smithi107.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-16T01:52:08.108 INFO:teuthology.orchestra.run.smithi042.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 6.7 MB/s | 689 kB 00:00 2024-09-16T01:52:08.134 INFO:teuthology.orchestra.run.smithi042.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-16T01:52:08.142 INFO:teuthology.orchestra.run.smithi107.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-16T01:52:08.150 INFO:teuthology.orchestra.run.smithi042.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 518 kB/s | 22 kB 00:00 2024-09-16T01:52:08.184 INFO:teuthology.orchestra.run.smithi042.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-09-16T01:52:08.201 INFO:teuthology.orchestra.run.smithi042.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-16T01:52:08.217 INFO:teuthology.orchestra.run.smithi107.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-16T01:52:08.236 INFO:teuthology.orchestra.run.smithi042.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-16T01:52:08.251 INFO:teuthology.orchestra.run.smithi042.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-16T01:52:08.267 INFO:teuthology.orchestra.run.smithi107.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-16T01:52:08.277 INFO:teuthology.orchestra.run.smithi042.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-16T01:52:08.293 INFO:teuthology.orchestra.run.smithi107.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-16T01:52:08.302 INFO:teuthology.orchestra.run.smithi042.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-16T01:52:08.318 INFO:teuthology.orchestra.run.smithi107.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-16T01:52:08.319 INFO:teuthology.orchestra.run.smithi042.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-16T01:52:08.343 INFO:teuthology.orchestra.run.smithi107.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 561 kB/s | 14 kB 00:00 2024-09-16T01:52:08.361 INFO:teuthology.orchestra.run.smithi042.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-16T01:52:08.394 INFO:teuthology.orchestra.run.smithi042.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-16T01:52:08.402 INFO:teuthology.orchestra.run.smithi107.stdout:(117/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-16T01:52:08.420 INFO:teuthology.orchestra.run.smithi042.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-16T01:52:08.427 INFO:teuthology.orchestra.run.smithi107.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-16T01:52:08.437 INFO:teuthology.orchestra.run.smithi042.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-16T01:52:08.461 INFO:teuthology.orchestra.run.smithi107.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-16T01:52:08.462 INFO:teuthology.orchestra.run.smithi042.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-09-16T01:52:08.487 INFO:teuthology.orchestra.run.smithi042.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-16T01:52:08.494 INFO:teuthology.orchestra.run.smithi107.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-16T01:52:08.513 INFO:teuthology.orchestra.run.smithi042.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-16T01:52:08.520 INFO:teuthology.orchestra.run.smithi107.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-16T01:52:08.554 INFO:teuthology.orchestra.run.smithi107.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-16T01:52:08.563 INFO:teuthology.orchestra.run.smithi042.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.9 MB/s | 3.0 MB 00:00 2024-09-16T01:52:08.579 INFO:teuthology.orchestra.run.smithi107.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-16T01:52:08.604 INFO:teuthology.orchestra.run.smithi107.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-16T01:52:08.629 INFO:teuthology.orchestra.run.smithi107.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 924 kB/s | 23 kB 00:00 2024-09-16T01:52:08.630 INFO:teuthology.orchestra.run.smithi042.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-16T01:52:08.655 INFO:teuthology.orchestra.run.smithi107.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-16T01:52:08.680 INFO:teuthology.orchestra.run.smithi107.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 784 kB/s | 20 kB 00:00 2024-09-16T01:52:08.731 INFO:teuthology.orchestra.run.smithi107.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-16T01:52:08.756 INFO:teuthology.orchestra.run.smithi042.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 18 MB/s | 4.9 MB 00:00 2024-09-16T01:52:08.756 INFO:teuthology.orchestra.run.smithi107.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T01:52:08.781 INFO:teuthology.orchestra.run.smithi107.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T01:52:08.806 INFO:teuthology.orchestra.run.smithi107.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-16T01:52:08.841 INFO:teuthology.orchestra.run.smithi107.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-16T01:52:08.881 INFO:teuthology.orchestra.run.smithi042.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 3.6 MB/s | 910 kB 00:00 2024-09-16T01:52:08.898 INFO:teuthology.orchestra.run.smithi042.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 969 kB/s | 137 kB 00:00 2024-09-16T01:52:08.915 INFO:teuthology.orchestra.run.smithi107.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 221 kB/s | 16 kB 00:00 2024-09-16T01:52:08.950 INFO:teuthology.orchestra.run.smithi107.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-16T01:52:08.956 INFO:teuthology.orchestra.run.smithi042.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-16T01:52:08.975 INFO:teuthology.orchestra.run.smithi107.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-16T01:52:08.998 INFO:teuthology.orchestra.run.smithi042.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-16T01:52:09.000 INFO:teuthology.orchestra.run.smithi107.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-16T01:52:09.023 INFO:teuthology.orchestra.run.smithi042.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-16T01:52:09.025 INFO:teuthology.orchestra.run.smithi107.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-16T01:52:09.050 INFO:teuthology.orchestra.run.smithi107.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T01:52:09.065 INFO:teuthology.orchestra.run.smithi042.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-16T01:52:09.076 INFO:teuthology.orchestra.run.smithi107.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-16T01:52:09.097 INFO:teuthology.orchestra.run.smithi107.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 775 kB/s | 36 kB 00:00 2024-09-16T01:52:09.122 INFO:teuthology.orchestra.run.smithi107.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.6 MB/s | 74 kB 00:00 2024-09-16T01:52:09.148 INFO:teuthology.orchestra.run.smithi107.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T01:52:09.157 INFO:teuthology.orchestra.run.smithi042.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-16T01:52:09.173 INFO:teuthology.orchestra.run.smithi107.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-16T01:52:09.182 INFO:teuthology.orchestra.run.smithi042.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-16T01:52:09.198 INFO:teuthology.orchestra.run.smithi107.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-09-16T01:52:09.207 INFO:teuthology.orchestra.run.smithi042.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-16T01:52:09.233 INFO:teuthology.orchestra.run.smithi042.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-16T01:52:09.240 INFO:teuthology.orchestra.run.smithi107.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-09-16T01:52:09.258 INFO:teuthology.orchestra.run.smithi042.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-16T01:52:09.266 INFO:teuthology.orchestra.run.smithi107.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-16T01:52:09.283 INFO:teuthology.orchestra.run.smithi042.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-16T01:52:09.309 INFO:teuthology.orchestra.run.smithi042.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-16T01:52:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-16T01:52:09.384 INFO:teuthology.orchestra.run.smithi042.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-16T01:52:09.409 INFO:teuthology.orchestra.run.smithi042.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-16T01:52:09.434 INFO:teuthology.orchestra.run.smithi042.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-16T01:52:09.460 INFO:teuthology.orchestra.run.smithi042.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-16T01:52:09.477 INFO:teuthology.orchestra.run.smithi042.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-16T01:52:09.502 INFO:teuthology.orchestra.run.smithi042.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-16T01:52:09.527 INFO:teuthology.orchestra.run.smithi042.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-16T01:52:09.552 INFO:teuthology.orchestra.run.smithi042.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-16T01:52:09.570 INFO:teuthology.orchestra.run.smithi042.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-16T01:52:09.587 INFO:teuthology.orchestra.run.smithi042.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-16T01:52:09.620 INFO:teuthology.orchestra.run.smithi042.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-16T01:52:09.712 INFO:teuthology.orchestra.run.smithi042.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-16T01:52:09.729 INFO:teuthology.orchestra.run.smithi042.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 408 kB/s | 44 kB 00:00 2024-09-16T01:52:09.754 INFO:teuthology.orchestra.run.smithi042.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-16T01:52:09.771 INFO:teuthology.orchestra.run.smithi042.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 865 kB/s | 36 kB 00:00 2024-09-16T01:52:09.783 INFO:teuthology.orchestra.run.smithi107.stdout:(148/156): ceph-test-19.1.1-326.g8921c8ef.el9.x 7.1 MB/s | 49 MB 00:06 2024-09-16T01:52:09.788 INFO:teuthology.orchestra.run.smithi042.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-16T01:52:09.822 INFO:teuthology.orchestra.run.smithi042.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-16T01:52:09.839 INFO:teuthology.orchestra.run.smithi042.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-16T01:52:09.864 INFO:teuthology.orchestra.run.smithi042.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-16T01:52:09.867 INFO:teuthology.orchestra.run.smithi107.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 6.1 MB/s | 3.2 MB 00:00 2024-09-16T01:52:09.881 INFO:teuthology.orchestra.run.smithi042.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-16T01:52:09.898 INFO:teuthology.orchestra.run.smithi042.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-16T01:52:09.933 INFO:teuthology.orchestra.run.smithi107.stdout:(150/156): librados2-19.1.1-326.g8921c8ef.el9.x 5.1 MB/s | 3.4 MB 00:00 2024-09-16T01:52:09.973 INFO:teuthology.orchestra.run.smithi042.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-16T01:52:09.984 INFO:teuthology.orchestra.run.smithi107.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-09-16T01:52:10.059 INFO:teuthology.orchestra.run.smithi107.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 9.4 MB/s | 1.8 MB 00:00 2024-09-16T01:52:10.084 INFO:teuthology.orchestra.run.smithi107.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 270 kB/s | 41 kB 00:00 2024-09-16T01:52:10.110 INFO:teuthology.orchestra.run.smithi107.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 1.9 MB/s | 249 kB 00:00 2024-09-16T01:52:10.143 INFO:teuthology.orchestra.run.smithi107.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-16T01:52:10.157 INFO:teuthology.orchestra.run.smithi042.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-16T01:52:10.207 INFO:teuthology.orchestra.run.smithi042.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-09-16T01:52:10.224 INFO:teuthology.orchestra.run.smithi042.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-09-16T01:52:10.249 INFO:teuthology.orchestra.run.smithi042.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-16T01:52:10.277 INFO:teuthology.orchestra.run.smithi107.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-16T01:52:10.283 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:52:10.283 INFO:teuthology.orchestra.run.smithi107.stdout:Total 24 MB/s | 226 MB 00:09 2024-09-16T01:52:10.291 INFO:teuthology.orchestra.run.smithi042.stdout:(108/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.3 MB/s | 308 kB 00:00 2024-09-16T01:52:10.316 INFO:teuthology.orchestra.run.smithi042.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-16T01:52:10.342 INFO:teuthology.orchestra.run.smithi042.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 282 kB/s | 26 kB 00:00 2024-09-16T01:52:10.367 INFO:teuthology.orchestra.run.smithi042.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T01:52:10.400 INFO:teuthology.orchestra.run.smithi042.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-16T01:52:10.467 INFO:teuthology.orchestra.run.smithi042.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-16T01:52:10.493 INFO:teuthology.orchestra.run.smithi042.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-16T01:52:10.518 INFO:teuthology.orchestra.run.smithi042.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 865 kB/s | 43 kB 00:00 2024-09-16T01:52:10.543 INFO:teuthology.orchestra.run.smithi042.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-16T01:52:10.568 INFO:teuthology.orchestra.run.smithi042.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-16T01:52:10.593 INFO:teuthology.orchestra.run.smithi042.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-16T01:52:10.627 INFO:teuthology.orchestra.run.smithi042.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-16T01:52:10.661 INFO:teuthology.orchestra.run.smithi042.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-16T01:52:10.694 INFO:teuthology.orchestra.run.smithi042.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-16T01:52:10.728 INFO:teuthology.orchestra.run.smithi042.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-16T01:52:10.753 INFO:teuthology.orchestra.run.smithi042.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 424 kB/s | 11 kB 00:00 2024-09-16T01:52:10.812 INFO:teuthology.orchestra.run.smithi042.stdout:(124/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 4.4 MB 00:00 2024-09-16T01:52:10.837 INFO:teuthology.orchestra.run.smithi042.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-09-16T01:52:10.854 INFO:teuthology.orchestra.run.smithi042.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 554 kB/s | 23 kB 00:00 2024-09-16T01:52:10.871 INFO:teuthology.orchestra.run.smithi042.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 578 kB/s | 19 kB 00:00 2024-09-16T01:52:10.888 INFO:teuthology.orchestra.run.smithi042.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 584 kB/s | 20 kB 00:00 2024-09-16T01:52:10.913 INFO:teuthology.orchestra.run.smithi042.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T01:52:10.947 INFO:teuthology.orchestra.run.smithi042.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-16T01:52:10.964 INFO:teuthology.orchestra.run.smithi042.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-16T01:52:10.998 INFO:teuthology.orchestra.run.smithi042.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-16T01:52:11.023 INFO:teuthology.orchestra.run.smithi042.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-16T01:52:11.048 INFO:teuthology.orchestra.run.smithi042.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-16T01:52:11.073 INFO:teuthology.orchestra.run.smithi042.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-16T01:52:11.124 INFO:teuthology.orchestra.run.smithi042.stdout:(136/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-09-16T01:52:11.149 INFO:teuthology.orchestra.run.smithi042.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 896 kB/s | 90 kB 00:00 2024-09-16T01:52:11.174 INFO:teuthology.orchestra.run.smithi042.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2024-09-16T01:52:11.199 INFO:teuthology.orchestra.run.smithi042.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-16T01:52:11.225 INFO:teuthology.orchestra.run.smithi042.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-16T01:52:11.250 INFO:teuthology.orchestra.run.smithi042.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-16T01:52:11.275 INFO:teuthology.orchestra.run.smithi042.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-16T01:52:11.300 INFO:teuthology.orchestra.run.smithi042.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-16T01:52:11.326 INFO:teuthology.orchestra.run.smithi042.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-16T01:52:11.351 INFO:teuthology.orchestra.run.smithi042.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-16T01:52:11.376 INFO:teuthology.orchestra.run.smithi042.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-16T01:52:11.402 INFO:teuthology.orchestra.run.smithi042.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-16T01:52:11.468 INFO:teuthology.orchestra.run.smithi042.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-16T01:52:11.470 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-16T01:52:11.624 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-16T01:52:11.624 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-16T01:52:11.635 INFO:teuthology.orchestra.run.smithi042.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 14 MB/s | 2.3 MB 00:00 2024-09-16T01:52:11.694 INFO:teuthology.orchestra.run.smithi042.stdout:(150/156): librados2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-16T01:52:11.759 INFO:teuthology.orchestra.run.smithi042.stdout:(151/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 8.8 MB/s | 3.2 MB 00:00 2024-09-16T01:52:11.803 INFO:teuthology.orchestra.run.smithi042.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 11 MB/s | 1.8 MB 00:00 2024-09-16T01:52:11.828 INFO:teuthology.orchestra.run.smithi042.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 304 kB/s | 41 kB 00:00 2024-09-16T01:52:11.870 INFO:teuthology.orchestra.run.smithi042.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-16T01:52:11.896 INFO:teuthology.orchestra.run.smithi042.stdout:(155/156): NetworkManager-tui-1.49.90-1.el9.x86 1.8 MB/s | 249 kB 00:00 2024-09-16T01:52:12.012 INFO:teuthology.orchestra.run.smithi042.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-09-16T01:52:12.019 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:52:12.019 INFO:teuthology.orchestra.run.smithi042.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-16T01:52:13.295 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-16T01:52:13.465 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-16T01:52:13.465 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-16T01:52:13.831 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-16T01:52:13.832 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-16T01:52:15.794 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-16T01:52:15.794 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-16T01:52:20.174 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-16T01:52:20.272 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T01:52:20.409 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T01:52:20.535 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T01:52:20.582 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T01:52:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T01:52:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T01:52:21.009 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T01:52:21.125 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:52:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:52:21.276 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:52:21.367 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:52:21.407 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:52:21.627 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T01:52:21.686 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T01:52:21.713 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:52:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:52:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:52:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:52:21.925 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:52:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:52:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:52:22.311 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:52:22.448 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T01:52:22.557 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-16T01:52:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:52:22.641 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:52:22.658 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T01:52:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T01:52:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T01:52:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T01:52:22.835 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T01:52:22.873 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:52:22.896 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T01:52:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T01:52:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T01:52:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T01:52:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T01:52:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T01:52:23.259 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T01:52:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T01:52:23.323 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T01:52:23.367 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T01:52:23.369 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:52:23.399 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T01:52:23.427 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T01:52:23.478 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:52:23.504 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T01:52:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:52:23.558 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T01:52:23.597 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T01:52:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:52:23.633 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:52:23.641 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T01:52:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T01:52:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T01:52:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T01:52:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T01:52:23.823 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T01:52:23.890 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T01:52:23.893 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T01:52:23.916 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:52:23.946 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T01:52:24.021 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T01:52:24.021 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:52:24.050 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:52:24.113 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:52:24.143 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:52:24.161 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T01:52:24.163 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:52:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T01:52:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:52:24.504 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:52:24.625 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T01:52:24.742 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:52:24.743 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T01:52:24.809 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:52:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T01:52:24.866 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T01:52:24.909 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T01:52:24.955 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T01:52:24.997 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T01:52:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:52:25.162 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T01:52:25.166 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T01:52:25.217 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T01:52:25.265 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T01:52:25.271 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T01:52:25.298 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T01:52:25.333 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T01:52:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T01:52:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T01:52:25.409 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T01:52:25.421 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T01:52:25.460 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T01:52:25.468 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T01:52:25.491 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T01:52:25.503 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T01:52:25.535 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T01:52:25.546 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T01:52:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T01:52:25.589 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T01:52:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T01:52:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T01:52:25.724 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T01:52:25.743 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T01:52:25.773 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T01:52:25.817 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T01:52:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T01:52:25.894 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T01:52:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T01:52:25.935 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T01:52:25.979 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T01:52:26.007 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T01:52:26.019 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T01:52:26.053 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T01:52:26.080 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T01:52:26.093 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T01:52:26.127 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T01:52:26.130 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T01:52:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T01:52:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T01:52:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T01:52:26.353 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T01:52:26.378 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T01:52:26.409 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T01:52:26.409 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T01:52:26.438 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T01:52:26.480 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T01:52:26.519 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T01:52:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T01:52:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T01:52:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T01:52:26.657 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T01:52:26.698 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T01:52:26.733 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T01:52:26.819 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T01:52:26.872 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T01:52:26.903 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T01:52:26.975 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T01:52:27.006 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T01:52:27.062 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T01:52:27.072 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T01:52:27.115 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T01:52:27.159 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T01:52:27.196 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T01:52:27.239 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T01:52:27.419 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T01:52:27.482 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T01:52:27.539 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T01:52:27.612 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T01:52:27.650 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T01:52:27.686 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T01:52:27.734 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T01:52:27.769 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T01:52:27.784 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T01:52:27.813 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T01:52:27.851 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T01:52:27.854 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T01:52:27.881 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T01:52:27.982 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T01:52:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T01:52:28.039 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T01:52:28.045 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T01:52:28.073 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T01:52:28.090 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T01:52:28.178 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T01:52:28.179 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T01:52:28.209 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T01:52:28.393 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T01:52:28.424 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T01:52:28.482 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T01:52:28.510 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T01:52:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T01:52:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T01:52:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T01:52:28.696 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T01:52:28.829 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T01:52:28.861 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T01:52:28.897 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T01:52:28.935 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T01:52:28.971 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T01:52:29.011 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T01:52:29.040 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T01:52:29.079 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T01:52:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T01:52:29.149 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T01:52:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T01:52:29.187 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T01:52:29.272 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T01:52:29.277 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T01:52:29.327 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T01:52:29.358 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T01:52:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T01:52:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T01:52:30.287 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T01:52:30.339 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T01:52:30.373 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T01:52:30.476 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T01:52:30.509 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T01:52:30.537 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T01:52:30.582 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T01:52:30.587 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T01:52:30.615 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T01:52:30.649 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T01:52:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T01:52:30.831 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T01:52:31.003 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T01:52:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:52:31.130 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T01:52:31.156 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T01:52:31.203 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:52:31.233 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T01:52:31.241 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T01:52:31.278 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T01:52:31.762 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T01:52:31.798 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:52:31.852 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:52:31.883 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T01:52:31.932 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T01:52:32.059 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T01:52:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T01:52:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T01:52:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T01:52:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T01:52:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T01:52:33.909 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:52:33.993 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:52:34.022 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T01:52:34.059 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T01:52:34.511 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:52:34.546 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:52:34.566 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T01:52:34.603 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:52:34.675 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:52:34.705 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T01:52:35.106 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:52:35.150 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:52:35.240 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:52:35.240 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T01:52:35.241 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T01:52:35.241 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:35.276 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:52:37.190 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:52:37.220 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:52:37.828 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:52:37.865 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:52:37.960 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:52:37.960 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T01:52:37.960 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T01:52:37.960 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:37.999 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:52:47.012 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:52:47.012 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-09-16T01:52:47.012 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-09-16T01:52:47.012 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-09-16T01:52:47.012 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-09-16T01:52:47.012 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-09-16T01:52:47.013 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-09-16T01:52:47.013 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-09-16T01:52:47.013 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:47.200 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:52:47.215 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:52:47.215 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:47.215 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T01:52:47.215 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:48.695 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:52:48.721 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:52:48.721 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:48.722 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T01:52:48.722 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:52:48.722 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:52:48.722 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:48.954 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:52:48.977 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:52:48.977 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:48.977 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T01:52:48.977 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:52:48.977 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:52:48.977 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:49.421 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:52:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:52:49.444 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:49.445 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T01:52:49.445 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:52:49.445 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:52:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:49.543 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T01:52:49.591 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T01:52:49.647 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T01:52:49.840 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T01:52:49.889 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T01:52:49.958 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T01:52:50.046 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T01:52:50.187 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T01:52:50.239 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T01:52:50.244 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:52:50.244 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-09-16T01:52:50.244 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-09-16T01:52:50.244 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-09-16T01:52:50.244 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-09-16T01:52:50.245 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-09-16T01:52:50.245 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-09-16T01:52:50.245 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-09-16T01:52:50.245 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:50.271 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T01:52:50.308 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T01:52:50.418 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:52:50.435 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:52:50.435 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:50.435 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T01:52:50.435 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:52:50.782 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:52:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T01:52:50.876 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T01:52:50.905 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:52:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:52:51.971 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:52:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:52:51.999 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:52:51.999 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:51.999 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T01:52:52.000 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:52:52.000 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:52:52.000 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:52.240 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:52:52.265 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:52:52.265 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:52.265 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T01:52:52.265 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:52:52.266 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:52:52.266 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:52.724 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:52:52.749 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:52:52.749 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:52.749 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T01:52:52.749 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:52:52.750 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:52:52.750 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:52.855 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T01:52:52.913 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T01:52:52.942 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:52:52.974 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:52:52.977 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T01:52:53.076 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:52:53.172 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T01:52:53.233 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T01:52:53.260 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T01:52:53.285 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:52:53.306 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T01:52:53.308 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:52:53.309 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:53.309 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T01:52:53.309 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:52:53.309 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:52:53.309 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:53.352 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:52:53.364 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:52:53.405 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T01:52:53.461 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T01:52:53.517 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T01:52:53.546 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T01:52:53.596 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T01:52:53.632 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T01:52:53.659 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T01:52:54.098 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:52:54.124 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:52:54.156 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T01:52:54.221 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T01:52:54.247 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:52:54.452 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T01:52:54.480 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:52:54.503 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:52:54.503 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:54.503 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T01:52:54.503 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:52:54.503 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:52:54.503 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:54.547 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:52:54.569 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:52:54.569 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:54.569 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T01:52:54.569 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:54.622 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:52:54.646 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:52:54.646 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:54.646 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T01:52:54.646 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:52:54.646 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:52:54.646 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:54.956 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:52:54.979 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:52:54.980 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:54.980 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T01:52:54.980 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:52:54.980 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:52:54.980 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:52:55.353 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:52:55.399 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:52:56.414 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:52:56.458 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:52:56.567 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:52:56.753 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T01:52:56.785 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:52:56.810 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:52:56.810 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:56.810 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T01:52:56.810 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:52:56.810 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:52:56.811 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:56.860 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:52:56.873 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:52:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T01:52:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T01:52:58.015 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T01:52:58.038 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:52:58.064 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:52:58.064 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:58.064 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T01:52:58.064 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:52:58.064 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:52:58.064 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:58.105 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:52:58.130 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:52:58.130 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:58.130 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T01:52:58.130 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:58.181 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:52:58.209 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:52:58.210 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:58.210 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T01:52:58.210 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:52:58.210 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:52:58.210 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:58.535 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:52:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:52:58.557 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:52:58.557 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T01:52:58.558 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:52:58.558 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:52:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:52:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T01:52:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T01:52:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T01:52:59.683 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T01:52:59.710 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T01:52:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T01:52:59.949 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T01:52:59.979 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T01:53:00.009 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T01:53:00.047 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T01:53:00.690 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:53:00.729 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:53:00.748 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:53:01.578 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T01:53:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T01:53:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T01:53:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T01:53:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T01:53:01.896 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T01:53:01.922 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T01:53:01.922 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:53:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:53:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:53:02.090 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:53:02.116 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T01:53:02.121 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:53:02.121 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:53:02.301 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:53:02.301 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:53:02.385 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:53:02.458 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:53:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T01:53:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T01:53:03.485 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T01:53:03.516 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T01:53:03.544 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T01:53:03.744 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T01:53:03.791 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T01:53:03.812 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T01:53:03.842 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T01:53:03.888 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T01:53:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:53:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:53:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:53:05.475 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T01:53:05.574 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T01:53:05.626 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T01:53:05.730 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T01:53:05.760 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T01:53:05.785 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T01:53:05.811 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T01:53:05.812 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:53:05.904 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:53:05.904 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:53:05.996 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:53:06.021 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T01:53:06.027 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:53:06.027 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:53:06.215 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:53:06.215 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:53:06.308 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:53:06.376 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:53:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:53:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T01:53:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T01:53:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T01:53:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T01:53:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T01:53:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T01:53:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T01:53:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T01:53:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T01:53:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T01:53:08.188 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T01:53:08.188 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T01:53:08.188 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T01:53:08.188 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T01:53:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T01:53:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T01:53:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T01:53:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T01:53:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T01:53:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T01:53:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T01:53:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T01:53:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T01:53:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T01:53:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T01:53:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T01:53:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T01:53:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T01:53:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T01:53:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T01:53:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T01:53:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T01:53:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T01:53:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T01:53:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T01:53:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T01:53:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T01:53:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T01:53:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T01:53:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T01:53:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T01:53:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T01:53:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T01:53:08.198 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T01:53:08.198 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T01:53:08.198 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T01:53:08.198 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T01:53:08.198 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T01:53:08.198 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T01:53:08.198 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T01:53:08.198 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T01:53:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T01:53:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T01:53:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T01:53:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T01:53:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T01:53:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T01:53:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T01:53:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T01:53:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T01:53:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T01:53:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.943 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:10.944 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T01:53:10.945 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.946 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T01:53:10.947 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T01:53:10.949 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T01:53:10.950 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T01:53:10.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T01:53:10.952 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.953 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.954 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:10.954 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T01:53:10.954 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T01:53:10.954 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T01:53:10.954 INFO:teuthology.orchestra.run.smithi107.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T01:53:10.954 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T01:53:10.954 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T01:53:10.954 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T01:53:10.955 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:10.955 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-16T01:53:11.453 DEBUG:teuthology.parallel:result is None 2024-09-16T01:53:12.204 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:53:12.204 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T01:53:12.204 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T01:53:12.204 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T01:53:12.204 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T01:53:12.204 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T01:53:12.204 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T01:53:12.205 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T01:53:12.205 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:53:12.205 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:53:12.205 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:53:12.205 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T01:53:12.205 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T01:53:12.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T01:53:12.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T01:53:12.208 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T01:53:12.209 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T01:53:12.210 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T01:53:12.211 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T01:53:12.212 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T01:53:12.213 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T01:53:12.213 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T01:53:12.213 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T01:53:12.213 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T01:53:12.213 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T01:53:12.213 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T01:53:12.213 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T01:53:12.213 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T01:53:12.213 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T01:53:12.213 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T01:53:12.214 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T01:53:12.215 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T01:53:12.216 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T01:53:12.217 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T01:53:12.218 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T01:53:12.218 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T01:53:12.218 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T01:53:12.218 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T01:53:14.504 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:53:14.504 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:14.504 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-09-16T01:53:14.504 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T01:53:14.505 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T01:53:14.505 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T01:53:14.505 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T01:53:14.505 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.505 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.505 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T01:53:14.505 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T01:53:14.505 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-16T01:53:14.505 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T01:53:14.505 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.506 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.507 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T01:53:14.508 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T01:53:14.509 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T01:53:14.510 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T01:53:14.511 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T01:53:14.512 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T01:53:14.513 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T01:53:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T01:53:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T01:53:14.516 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T01:53:14.517 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T01:53:14.518 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T01:53:14.518 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:14.518 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-16T01:53:15.021 DEBUG:teuthology.parallel:result is None 2024-09-16T01:53:15.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:53:15.172 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T01:53:15.196 INFO:teuthology.orchestra.run.smithi042.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T01:53:15.197 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T01:53:15.197 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T01:53:15.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:53:15.339 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T01:53:15.365 INFO:teuthology.orchestra.run.smithi107.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T01:53:15.365 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T01:53:15.366 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T01:53:15.367 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T01:53:15.367 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:15.368 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T01:53:15.398 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:15.398 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T01:53:15.437 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T01:53:15.438 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:15.438 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T01:53:15.465 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T01:53:15.532 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:15.532 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T01:53:15.560 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T01:53:15.628 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T01:53:15.628 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:15.628 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T01:53:15.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T01:53:15.722 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:15.722 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T01:53:15.749 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T01:53:15.816 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T01:53:15.817 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:15.817 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T01:53:15.843 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T01:53:15.909 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:15.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T01:53:15.935 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T01:53:16.001 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T01:53:16.081 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T01:53:16.082 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2024-09-16T01:53:16.085 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-09-16T01:53:16.110 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T01:53:16.110 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T01:53:16.152 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T01:53:16.176 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T01:53:16.177 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T01:53:16.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T01:53:16.250 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-16T01:53:16.250 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-16T01:53:16.250 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-16T01:53:16.251 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:16.251 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-16T01:53:16.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-16T01:53:16.411 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-16T01:53:16.437 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:16.437 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-16T01:53:16.452 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-16T01:53:16.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-16T01:53:16.595 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T01:53:16.596 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T01:53:16.596 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/forward-scrub}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906497', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3393, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '294/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA5jILkSwwN2WWP58jsWO4FeTGsq8D0jIlm4U2v5/IyPvGebgRPpEeXBzKiw7HoQ2NWPPIPhjzTkDaQKwkZyHtw=', 'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPwDla7/EpQhATcE83UWxwdPFDr4+TN7nhYXoq5svbkP7TjvINZLV8SGE8a/HBw1T2NKkCFUdloTXB2sBLqI73k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T01:53:16.596 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T01:53:16.599 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T01:53:16.643 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T01:53:16.656 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T01:53:16.709 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:16.709 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T01:53:16.736 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T01:53:16.736 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-09-16T01:53:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T01:53:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:53:16.793 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-16T01:53:16.793 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:53:16.793 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:53:16.793 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-16 01:53:06.741578644 +0000 2024-09-16T01:53:16.793 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-16 01:51:16.266204486 +0000 2024-09-16T01:53:16.793 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-16 01:51:16.266204486 +0000 2024-09-16T01:53:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-16 01:51:16.266204486 +0000 2024-09-16T01:53:16.793 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T01:53:16.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-16T01:53:16.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-16T01:53:16.858 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 9.7662e-05 s, 5.2 MB/s 2024-09-16T01:53:16.860 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T01:53:16.917 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-09-16T01:53:16.973 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T01:53:16.973 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:53:16.973 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T01:53:16.973 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:53:16.974 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:53:16.974 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-16 01:53:06.742578637 +0000 2024-09-16T01:53:16.974 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-16 01:51:16.596202277 +0000 2024-09-16T01:53:16.974 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-16 01:51:16.596202277 +0000 2024-09-16T01:53:16.974 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-16 01:51:16.596202277 +0000 2024-09-16T01:53:16.974 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T01:53:17.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-16T01:53:17.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-16T01:53:17.038 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000103163 s, 5.0 MB/s 2024-09-16T01:53:17.039 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T01:53:17.096 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-09-16T01:53:17.153 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T01:53:17.153 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:53:17.153 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T01:53:17.153 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:53:17.153 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:53:17.154 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-16 01:53:06.742578637 +0000 2024-09-16T01:53:17.154 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-16 01:51:16.912200163 +0000 2024-09-16T01:53:17.154 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-16 01:51:16.912200163 +0000 2024-09-16T01:53:17.154 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-16 01:51:16.912200163 +0000 2024-09-16T01:53:17.154 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T01:53:17.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-16T01:53:17.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-16T01:53:17.217 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000105084 s, 4.9 MB/s 2024-09-16T01:53:17.218 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T01:53:17.274 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-09-16T01:53:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T01:53:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:53:17.331 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T01:53:17.331 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:53:17.331 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:53:17.331 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-16 01:53:06.743578631 +0000 2024-09-16T01:53:17.332 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-16 01:51:17.237197988 +0000 2024-09-16T01:53:17.332 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-16 01:51:17.237197988 +0000 2024-09-16T01:53:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-16 01:51:17.237197988 +0000 2024-09-16T01:53:17.332 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T01:53:17.395 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-16T01:53:17.395 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-16T01:53:17.396 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000101379 s, 5.1 MB/s 2024-09-16T01:53:17.397 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T01:53:17.454 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T01:53:17.454 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:17.454 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T01:53:17.473 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T01:53:17.473 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-09-16T01:53:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T01:53:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:53:17.532 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-16T01:53:17.532 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:53:17.532 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:53:17.532 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-16 01:53:02.822381825 +0000 2024-09-16T01:53:17.532 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-16 01:51:10.195730416 +0000 2024-09-16T01:53:17.532 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-16 01:51:10.195730416 +0000 2024-09-16T01:53:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-16 01:51:10.195730416 +0000 2024-09-16T01:53:17.533 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T01:53:17.600 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-16T01:53:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-16T01:53:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000294944 s, 1.7 MB/s 2024-09-16T01:53:17.603 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T01:53:17.662 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-09-16T01:53:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T01:53:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:53:17.719 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-16T01:53:17.719 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:53:17.720 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:53:17.720 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-16 01:53:02.822381825 +0000 2024-09-16T01:53:17.720 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-16 01:51:10.522725311 +0000 2024-09-16T01:53:17.720 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-16 01:51:10.522725311 +0000 2024-09-16T01:53:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-16 01:51:10.522725311 +0000 2024-09-16T01:53:17.720 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T01:53:17.786 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-16T01:53:17.786 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-16T01:53:17.786 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000254587 s, 2.0 MB/s 2024-09-16T01:53:17.787 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T01:53:17.846 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-09-16T01:53:17.903 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T01:53:17.904 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:53:17.904 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-16T01:53:17.904 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:53:17.904 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:53:17.904 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-16 01:53:02.823381809 +0000 2024-09-16T01:53:17.904 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-16 01:51:10.850720191 +0000 2024-09-16T01:53:17.904 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-16 01:51:10.850720191 +0000 2024-09-16T01:53:17.904 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-16 01:51:10.850720191 +0000 2024-09-16T01:53:17.904 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T01:53:17.969 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-16T01:53:17.970 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-16T01:53:17.970 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000193027 s, 2.7 MB/s 2024-09-16T01:53:17.972 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T01:53:18.030 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-09-16T01:53:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T01:53:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:53:18.087 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T01:53:18.087 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:53:18.087 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:53:18.088 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-16 01:53:02.823381809 +0000 2024-09-16T01:53:18.088 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-16 01:51:11.178715071 +0000 2024-09-16T01:53:18.088 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-16 01:51:11.178715071 +0000 2024-09-16T01:53:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-16 01:51:11.178715071 +0000 2024-09-16T01:53:18.088 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T01:53:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-16T01:53:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-16T01:53:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000195179 s, 2.6 MB/s 2024-09-16T01:53:18.154 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T01:53:18.212 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T01:53:18.212 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-16T01:53:18.212 INFO:tasks.ceph:Generating config... 2024-09-16T01:53:18.213 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-16T01:53:18.213 INFO:tasks.ceph:[client] debug client = 20 2024-09-16T01:53:18.214 INFO:tasks.ceph:[client] debug ms = 1 2024-09-16T01:53:18.214 INFO:tasks.ceph:[client] pid file = 2024-09-16T01:53:18.214 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-16T01:53:18.214 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-16T01:53:18.214 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-16T01:53:18.214 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-16T01:53:18.214 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-16T01:53:18.214 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-16T01:53:18.214 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-16T01:53:18.214 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-16T01:53:18.214 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-16T01:53:18.215 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T01:53:18.216 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T01:53:18.217 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T01:53:18.217 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-16T01:53:18.217 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T01:53:18.217 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T01:53:18.274 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T01:53:18.277 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T01:53:18.326 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T01:53:18.353 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.42'), ('mon.b', '172.21.15.107'), ('mon.c', '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]')] 2024-09-16T01:53:18.353 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.42,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-16T01:53:18.354 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:18.354 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T01:53:18.410 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.42 --add b 172.21.15.107 --addv c '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:18.499 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:18.499 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: generated fsid 356ce71f-2ad9-4fe3-af21-266c510b09c8 2024-09-16T01:53:18.499 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = quincy 2024-09-16T01:53:18.499 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 0 2024-09-16T01:53:18.499 INFO:teuthology.orchestra.run.smithi042.stdout:fsid 356ce71f-2ad9-4fe3-af21-266c510b09c8 2024-09-16T01:53:18.499 INFO:teuthology.orchestra.run.smithi042.stdout:last_changed 2024-09-16T01:53:18.498818+0000 2024-09-16T01:53:18.499 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-09-16T01:53:18.498818+0000 2024-09-16T01:53:18.500 INFO:teuthology.orchestra.run.smithi042.stdout:min_mon_release 17 (quincy) 2024-09-16T01:53:18.500 INFO:teuthology.orchestra.run.smithi042.stdout:election_strategy: 1 2024-09-16T01:53:18.500 INFO:teuthology.orchestra.run.smithi042.stdout:0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-16T01:53:18.500 INFO:teuthology.orchestra.run.smithi042.stdout:1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.b 2024-09-16T01:53:18.500 INFO:teuthology.orchestra.run.smithi042.stdout:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-16T01:53:18.500 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-16T01:53:18.501 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T01:53:18.517 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 356ce71f-2ad9-4fe3-af21-266c510b09c8... 2024-09-16T01:53:18.518 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T01:53:18.560 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T01:53:18.602 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-16T01:53:18.602 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-09-16T01:53:18.602 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T01:53:18.602 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-09-16T01:53:18.602 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-09-16T01:53:18.603 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-09-16T01:53:18.604 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-09-16T01:53:18.605 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-09-16T01:53:18.606 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on skipped message = False 2024-09-16T01:53:18.606 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = 356ce71f-2ad9-4fe3-af21-266c510b09c8 2024-09-16T01:53:18.606 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.606 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-09-16T01:53:18.606 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-09-16T01:53:18.606 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.606 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-09-16T01:53:18.607 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-09-16T01:53:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-09-16T01:53:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-09-16T01:53:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-09-16T01:53:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-09-16T01:53:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-09-16T01:53:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-09-16T01:53:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-09-16T01:53:18.608 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.609 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 20 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 20 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 10 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-09-16T01:53:18.610 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: debug client = 20 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.611 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.612 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: mon down mkfs grace = 300 2024-09-16T01:53:18.613 INFO:teuthology.orchestra.run.smithi042.stdout: mon op complaint time = 120 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on pool no app = False 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: client mount timeout = 600 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: debug client = 20 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-16T01:53:18.614 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = "" 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout: rados mon op timeout = 900 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout: rados osd op timeout = 900 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds = 20 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds balancer = 20 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-16T01:53:18.615 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug frag = True 2024-09-16T01:53:18.616 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug scatterstat = True 2024-09-16T01:53:18.616 INFO:teuthology.orchestra.run.smithi042.stdout: mds op complaint time = 180 2024-09-16T01:53:18.616 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = True 2024-09-16T01:53:18.616 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2024-09-16T01:53:18.616 INFO:teuthology.orchestra.run.smithi042.stdout: rados mon op timeout = 900 2024-09-16T01:53:18.616 INFO:teuthology.orchestra.run.smithi042.stdout: rados osd op timeout = 900 2024-09-16T01:53:18.617 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-09-16T01:53:18.617 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-09-16T01:53:18.617 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T01:53:18.617 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-09-16T01:53:18.617 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.617 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-09-16T01:53:18.617 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.617 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-09-16T01:53:18.617 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.617 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-09-16T01:53:18.618 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-09-16T01:53:18.618 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.618 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-09-16T01:53:18.618 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-09-16T01:53:18.618 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.618 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T01:53:18.618 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-09-16T01:53:18.618 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.618 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T01:53:18.619 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.42,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-09-16T01:53:18.620 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on skipped message = False 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 356ce71f-2ad9-4fe3-af21-266c510b09c8 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.621 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-09-16T01:53:18.622 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 20 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 20 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 10 2024-09-16T01:53:18.623 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-09-16T01:53:18.624 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-09-16T01:53:18.625 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-09-16T01:53:18.626 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: mon down mkfs grace = 300 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: mon op complaint time = 120 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on pool no app = False 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: client mount timeout = 600 2024-09-16T01:53:18.627 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = "" 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout:[mds] 2024-09-16T01:53:18.628 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds = 20 2024-09-16T01:53:18.629 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds balancer = 20 2024-09-16T01:53:18.629 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-16T01:53:18.629 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug frag = True 2024-09-16T01:53:18.629 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug scatterstat = True 2024-09-16T01:53:18.629 INFO:teuthology.orchestra.run.smithi107.stdout: mds op complaint time = 180 2024-09-16T01:53:18.629 INFO:teuthology.orchestra.run.smithi107.stdout: mds verify scatter = True 2024-09-16T01:53:18.629 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-09-16T01:53:18.629 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-09-16T01:53:18.629 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-09-16T01:53:18.631 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T01:53:18.631 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T01:53:18.727 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T01:53:18.727 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:18.727 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T01:53:18.743 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:18.743 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T01:53:18.799 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:53:18.799 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:18.799 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T01:53:18.799 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T01:53:18.875 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:18.875 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:18.931 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:53:18.931 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:18.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T01:53:18.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T01:53:18.969 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:18.970 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:19.026 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T01:53:19.026 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T01:53:19.027 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T01:53:19.079 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T01:53:19.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T01:53:19.142 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T01:53:19.145 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T01:53:19.145 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-16T01:53:19.199 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-16T01:53:19.201 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-16T01:53:19.227 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-16T01:53:19.319 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-16T01:53:19.322 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-16T01:53:19.348 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-16T01:53:19.401 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-16T01:53:19.404 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-16T01:53:19.429 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-16T01:53:19.528 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-16T01:53:19.530 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-16T01:53:19.573 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T01:53:19.573 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T01:53:19.621 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T01:53:19.633 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-16T01:53:19.718 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-16T01:53:19.731 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T01:53:19.772 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T01:53:19.785 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-16T01:53:19.865 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-16T01:53:19.878 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T01:53:19.878 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-16T01:53:19.878 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T01:53:19.904 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T01:53:19.904 INFO:tasks.ceph:role: osd.0 2024-09-16T01:53:19.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:53:19.905 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T01:53:19.969 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:53:19.969 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:53:19.969 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:53:19.969 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:53:19.970 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:53:19.970 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:53:19.970 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:53:19.970 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:53:19.970 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:53:19.970 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:53:20.002 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-16T01:53:20.004 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-16T01:53:20.004 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T01:53:20.074 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T01:53:20.144 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T01:53:20.210 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T01:53:20.210 INFO:tasks.ceph:role: osd.1 2024-09-16T01:53:20.210 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:53:20.210 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T01:53:20.276 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:53:20.276 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:53:20.276 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:53:20.276 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:53:20.277 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:53:20.277 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:53:20.277 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:53:20.277 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:53:20.277 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:53:20.277 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:53:20.308 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-16T01:53:20.310 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-16T01:53:20.311 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T01:53:20.385 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T01:53:20.455 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T01:53:20.521 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T01:53:20.521 INFO:tasks.ceph:role: osd.2 2024-09-16T01:53:20.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:53:20.522 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T01:53:20.587 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:53:20.588 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:53:20.588 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:53:20.588 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:53:20.588 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:53:20.588 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:53:20.588 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:53:20.588 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:53:20.588 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:53:20.588 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:53:20.619 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-16T01:53:20.622 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-16T01:53:20.622 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T01:53:20.692 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T01:53:20.765 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T01:53:20.833 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T01:53:20.833 INFO:tasks.ceph:role: osd.3 2024-09-16T01:53:20.833 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:53:20.833 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T01:53:20.898 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:53:20.898 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:53:20.898 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:53:20.898 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:53:20.898 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:53:20.898 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:53:20.899 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:53:20.899 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:53:20.899 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:53:20.899 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:53:20.931 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-16T01:53:20.933 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-16T01:53:20.934 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-16T01:53:21.004 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T01:53:21.074 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:21.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:21.168+0000 7f2ce92fe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-16T01:53:21.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:21.168+0000 7f2ce92fe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-16T01:53:21.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:21.168+0000 7f2ce92fe640 -1 bdev(0x55acfa5e5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-16T01:53:21.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:21.168+0000 7f2ce92fe640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-16T01:53:24.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T01:53:24.115 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:24.208+0000 7f052e745640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-16T01:53:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:24.208+0000 7f052e745640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-16T01:53:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:24.208+0000 7f052e745640 -1 bdev(0x55ea3261b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-16T01:53:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:24.208+0000 7f052e745640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-16T01:53:27.390 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T01:53:27.420 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:27.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:27.512+0000 7f4d70fc5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-16T01:53:27.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:27.512+0000 7f4d70fc5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-16T01:53:27.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:27.512+0000 7f4d70fc5640 -1 bdev(0x5618565c7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-16T01:53:27.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:27.512+0000 7f4d70fc5640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-16T01:53:30.446 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T01:53:30.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:30.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:30.568+0000 7fdde91c3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-16T01:53:30.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:30.568+0000 7fdde91c3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-16T01:53:30.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:30.568+0000 7fdde91c3640 -1 bdev(0x55788ce69800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-16T01:53:30.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:30.569+0000 7fdde91c3640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-16T01:53:33.729 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T01:53:33.760 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-16T01:53:33.792 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T01:53:33.792 INFO:tasks.ceph:role: osd.4 2024-09-16T01:53:33.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:53:33.792 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T01:53:33.868 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:53:33.868 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:53:33.868 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:53:33.868 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:53:33.868 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:53:33.868 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:53:33.869 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:53:33.869 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:53:33.869 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:53:33.869 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:53:34.381 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-16T01:53:34.383 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-16T01:53:34.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-16T01:53:34.518 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-16T01:53:34.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-16T01:53:34.618 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T01:53:34.618 INFO:tasks.ceph:role: osd.5 2024-09-16T01:53:34.618 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:53:34.618 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T01:53:34.691 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:53:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:53:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:53:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:53:34.692 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:53:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:53:34.692 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:53:34.692 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:53:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:53:34.692 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:53:35.143 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-16T01:53:35.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-16T01:53:35.146 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-16T01:53:35.229 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-16T01:53:35.297 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-16T01:53:35.363 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T01:53:35.363 INFO:tasks.ceph:role: osd.6 2024-09-16T01:53:35.363 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:53:35.364 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T01:53:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:53:35.435 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:53:35.435 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:53:35.435 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:53:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:53:35.435 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:53:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:53:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:53:35.435 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:53:35.436 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:53:35.937 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-16T01:53:35.939 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-16T01:53:35.939 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-16T01:53:36.071 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-16T01:53:36.102 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-16T01:53:36.168 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T01:53:36.168 INFO:tasks.ceph:role: osd.7 2024-09-16T01:53:36.169 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:53:36.169 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T01:53:36.243 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:53:36.243 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:53:36.243 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:53:36.243 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:53:36.243 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:53:36.243 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:53:36.243 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:53:36.243 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:53:36.243 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:53:36.243 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:53:36.758 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-16T01:53:36.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-16T01:53:36.760 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-16T01:53:36.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-16T01:53:36.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:37.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:37.010+0000 7eff2842c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-16T01:53:37.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:37.010+0000 7eff2842c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-16T01:53:37.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:37.011+0000 7eff2842c640 -1 bdev(0x55d92f1e9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-16T01:53:37.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:37.011+0000 7eff2842c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-16T01:53:39.934 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T01:53:39.966 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:40.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:40.055+0000 7fb27741a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-16T01:53:40.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:40.056+0000 7fb27741a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-16T01:53:40.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:40.056+0000 7fb27741a640 -1 bdev(0x55ebff3ad800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-16T01:53:40.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:40.056+0000 7fb27741a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-16T01:53:43.225 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T01:53:43.254 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:43.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:43.343+0000 7fe611c10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-16T01:53:43.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:43.343+0000 7fe611c10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-16T01:53:43.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:43.343+0000 7fe611c10640 -1 bdev(0x55f0ce9a5800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-16T01:53:43.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:43.344+0000 7fe611c10640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-16T01:53:46.598 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:53:46.601 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:53:46.758 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-16T01:53:46.785 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:46.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:46.873+0000 7fecc88f1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-16T01:53:46.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:46.873+0000 7fecc88f1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-16T01:53:46.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:46.873+0000 7fecc88f1640 -1 bdev(0x556a08363800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-16T01:53:46.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:46.873+0000 7fecc88f1640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-16T01:53:50.029 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-16T01:53:50.058 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T01:53:50.058 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:50.059 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-16T01:53:50.094 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:50.094 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-16T01:53:50.164 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:50.164 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-16T01:53:50.233 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:50.234 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T01:53:50.302 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:50.302 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T01:53:50.370 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:50.370 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T01:53:50.437 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:50.437 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T01:53:50.506 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:50.506 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T01:53:50.536 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:50.536 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-16T01:53:50.606 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:50.606 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-16T01:53:50.676 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:50.676 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-16T01:53:50.745 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:50.745 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-16T01:53:50.813 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:50.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-16T01:53:50.881 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:50.881 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-16T01:53:50.950 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:50.950 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T01:53:50.970 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:50.970 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-16T01:53:51.029 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:51.029 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T01:53:51.047 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:51.047 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-16T01:53:51.103 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T01:53:51.104 DEBUG:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T01:53:51.106 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T01:53:51.147 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.y] 2024-09-16T01:53:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dmvS++BBAAz/uguUBb9FImHUTqjWn+aQ== 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dmMcjXCxAAT1mJYvmGTz3j/gt9V7UZSg== 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dmzDcLExAATadyYI33hfeB5hgeHu78rQ== 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCRj+dm608ZChAAlxPChkfdzKXeHCIJ8BHu/w== 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCUj+dmJdZ0DBAA7uQZ9GIuniJqny516zliSw== 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCXj+dmtAqWHhAAaGW9phi3HiWZRv0OCDonuA== 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2024-09-16T01:53:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCaj+dmZSnzIRAAk6WnucLW3q5dz9FKZxhXtA== 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dmJqF8CBAACeom3ua2ACe+FRyBfxqCnA== 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dmVSvlFxAA+JMa7tU+TmIufSm1H40/nw== 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dmJPBuHxAAl4Bgbbslzm974J8HK3/0ZA== 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.4] 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQChj+dmxUS9ABAApVKUWA3LGNafeCQDiPKH9w== 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.5] 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCkj+dmzCBvAxAAffM0asgUVUoQR8Lkproybg== 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.6] 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCnj+dmgHOUFBAAfSU6pxHqw51D/id51CzAww== 2024-09-16T01:53:51.149 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.7] 2024-09-16T01:53:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCqj+dmrBcXNBAAPCT+sn6Mx/1J5ItdLD7tbw== 2024-09-16T01:53:51.150 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-16T01:53:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dm96TxJBAAoZCGS2uSu2E2+xtA9fj+5g== 2024-09-16T01:53:51.150 INFO:teuthology.orchestra.run.smithi042.stdout:[client.2] 2024-09-16T01:53:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dm4JjPKhAAvfE6+QyfNHcahc6uzs34Zg== 2024-09-16T01:53:51.150 INFO:teuthology.orchestra.run.smithi042.stdout:[client.1] 2024-09-16T01:53:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dmkOUKLhAA+aD+mHe1UrKoAJ1cuqb6Yg== 2024-09-16T01:53:51.150 INFO:teuthology.orchestra.run.smithi042.stdout:[client.3] 2024-09-16T01:53:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dm4eSVMxAAP1P9R5DYorQup0ujBbfe0A== 2024-09-16T01:53:51.169 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-09-16T01:53:51.169 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCPj+dmvS++BBAAz/uguUBb9FImHUTqjWn+aQ== 2024-09-16T01:53:51.169 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-09-16T01:53:51.169 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCPj+dmMcjXCxAAT1mJYvmGTz3j/gt9V7UZSg== 2024-09-16T01:53:51.169 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-09-16T01:53:51.169 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCPj+dmzDcLExAATadyYI33hfeB5hgeHu78rQ== 2024-09-16T01:53:51.169 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCRj+dm608ZChAAlxPChkfdzKXeHCIJ8BHu/w== 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCUj+dmJdZ0DBAA7uQZ9GIuniJqny516zliSw== 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCXj+dmtAqWHhAAaGW9phi3HiWZRv0OCDonuA== 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCaj+dmZSnzIRAAk6WnucLW3q5dz9FKZxhXtA== 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCPj+dmJqF8CBAACeom3ua2ACe+FRyBfxqCnA== 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCPj+dmVSvlFxAA+JMa7tU+TmIufSm1H40/nw== 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-09-16T01:53:51.170 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCPj+dmJPBuHxAAl4Bgbbslzm974J8HK3/0ZA== 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQChj+dmxUS9ABAApVKUWA3LGNafeCQDiPKH9w== 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCkj+dmzCBvAxAAffM0asgUVUoQR8Lkproybg== 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCnj+dmgHOUFBAAfSU6pxHqw51D/id51CzAww== 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCqj+dmrBcXNBAAPCT+sn6Mx/1J5ItdLD7tbw== 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCPj+dm96TxJBAAoZCGS2uSu2E2+xtA9fj+5g== 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout:[client.2] 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCPj+dm4JjPKhAAvfE6+QyfNHcahc6uzs34Zg== 2024-09-16T01:53:51.171 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-09-16T01:53:51.172 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCPj+dmkOUKLhAA+aD+mHe1UrKoAJ1cuqb6Yg== 2024-09-16T01:53:51.172 INFO:teuthology.orchestra.run.smithi107.stdout:[client.3] 2024-09-16T01:53:51.172 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCPj+dm4eSVMxAAP1P9R5DYorQup0ujBbfe0A== 2024-09-16T01:53:51.173 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T01:53:51.194 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T01:53:51.266 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:53:51.268 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:53:51.325 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:53:51.327 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:53:51.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.384 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.434 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.489 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.544 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.547 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.597 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T01:53:51.599 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T01:53:51.650 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:53:51.652 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:53:51.706 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:53:51.709 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:53:51.764 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.767 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.818 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.820 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.871 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.874 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.926 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.928 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:53:51.979 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:53:51.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:53:52.035 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:53:52.038 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:53:52.092 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:53:52.094 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:53:52.149 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:53:52.152 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:53:52.206 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T01:53:52.206 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T01:53:52.231 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T01:53:52.329 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T01:53:52.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-16T01:53:52.380 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T01:53:52.475 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-16T01:53:52.500 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-16T01:53:52.564 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T01:53:52.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-16T01:53:52.685 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:52.688 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:53:52.740 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T01:53:52.740 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T01:53:52.740 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T01:53:52.744 INFO:tasks.ceph.mon.a:Started 2024-09-16T01:53:52.744 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-16T01:53:52.745 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-16T01:53:52.783 INFO:tasks.ceph.mon.b:Started 2024-09-16T01:53:52.783 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-16T01:53:52.783 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-16T01:53:52.786 INFO:tasks.ceph.mon.c:Started 2024-09-16T01:53:52.786 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T01:53:52.787 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-16T01:53:52.787 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-16T01:53:52.790 INFO:tasks.ceph.mgr.y:Started 2024-09-16T01:53:52.790 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T01:53:52.790 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T01:53:52.793 INFO:tasks.ceph.mgr.x:Started 2024-09-16T01:53:52.793 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T01:53:52.793 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T01:53:52.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.896+0000 7faa296a5640 1 Processor -- start 2024-09-16T01:53:52.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.896+0000 7faa296a5640 1 -- start start 2024-09-16T01:53:52.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa296a5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:52.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa296a5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:52.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa296a5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa240cfcb0 con 0x7faa240afd10 2024-09-16T01:53:52.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa296a5640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7faa240cfa10 con 0x7faa24070300 2024-09-16T01:53:52.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa296a5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faa2406e810 con 0x7faa2415b070 2024-09-16T01:53:52.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa237fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa237fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38272/0 (socket says 172.21.15.42:38272) 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa237fe640 1 -- 172.21.15.42:0/2297899837 learned_addr learned my addr 172.21.15.42:0/2297899837 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa237fe640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 msgr2=0x7faa240b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa237fe640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 msgr2=0x7faa240b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 msgr2=0x7faa240b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 msgr2=0x7faa240b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:52.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:52.897+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:53.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.098+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:53.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.098+0000 7faa237fe640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 msgr2=0x7faa240b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T01:53:53.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.098+0000 7faa237fe640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 msgr2=0x7faa240b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:53.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.098+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:53.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.098+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:53:53.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.098+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:53.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.098+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 msgr2=0x7faa240b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-16T01:53:53.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.098+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 msgr2=0x7faa240b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:53.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.098+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:53.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.098+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:53:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.499+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.499+0000 7faa237fe640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 msgr2=0x7faa240b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T01:53:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.499+0000 7faa237fe640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 msgr2=0x7faa240b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.499+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.499+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T01:53:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.499+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.499+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 msgr2=0x7faa240b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-16T01:53:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.499+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 msgr2=0x7faa240b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.499+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:53.499+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T01:53:54.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:54.300+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:54.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:54.300+0000 7faa237fe640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 msgr2=0x7faa240b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T01:53:54.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:54.300+0000 7faa237fe640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 msgr2=0x7faa240b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:54.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:54.300+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:54.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:54.300+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T01:53:54.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:54.300+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:54.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:54.301+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 msgr2=0x7faa240b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-16T01:53:54.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:54.301+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 msgr2=0x7faa240b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:54.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:54.301+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:54.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:54.301+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T01:53:55.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa20ff9640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 msgr2=0x7faa240b4e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:53:55.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa20ff9640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.107:3300/0 conn(0x7faa2415b070 0x7faa240b4e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:55.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa20ff9640 1 -- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 msgr2=0x7faa240b53c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:53:55.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa20ff9640 1 --2- 172.21.15.42:0/2297899837 >> v2:172.21.15.42:3300/0 conn(0x7faa24070300 0x7faa240b53c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:55.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa20ff9640 1 -- 172.21.15.42:0/2297899837 >> v1:172.21.15.107:6789/0 conn(0x7faa240afd10 legacy=0x7faa2415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:55.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa20ff9640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:55.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa20ff9640 1 -- 172.21.15.42:0/2297899837 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa2406eaf0 con 0x7faa04006150 2024-09-16T01:53:55.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa20ff9640 1 -- 172.21.15.42:0/2297899837 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa240cfa10 con 0x7faa04003670 2024-09-16T01:53:55.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:55.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 msgr2=0x7faa04005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T01:53:55.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 msgr2=0x7faa04005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:55.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:55.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:55.898+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:56.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:56.099+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:56.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:56.099+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 msgr2=0x7faa04005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T01:53:56.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:56.099+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 msgr2=0x7faa04005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:56.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:56.099+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:56.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:56.099+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:53:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:56.500+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:56.500+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 msgr2=0x7faa04005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T01:53:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:56.500+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 msgr2=0x7faa04005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:56.500+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:56.500+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T01:53:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:57.302+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:57.302+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 msgr2=0x7faa04005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T01:53:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:57.302+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 msgr2=0x7faa04005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:57.302+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:57.302+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T01:53:58.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.059+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570263524 0 0) 0x7faa2406eaf0 con 0x7faa04006150 2024-09-16T01:53:58.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.059+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa10005730 con 0x7faa04006150 2024-09-16T01:53:58.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.060+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2785306134 0 0) 0x7faa10005730 con 0x7faa04006150 2024-09-16T01:53:58.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.060+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 msgr2=0x7faa04005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:53:58.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.060+0000 7faa21ffb640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa04003670 0x7faa04005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.060+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0400b000 con 0x7faa04006150 2024-09-16T01:53:58.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.060+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7faa140016f0 con 0x7faa04006150 2024-09-16T01:53:58.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.060+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 >> v1:172.21.15.42:6789/0 conn(0x7faa04006150 legacy=0x7faa04008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.060+0000 7faa237fe640 1 -- 172.21.15.42:0/2297899837 reap_dead start 2024-09-16T01:53:58.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.060+0000 7faa21ffb640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa10005fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.060+0000 7faa21ffb640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa10006a10 0x7faa10006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.060+0000 7faa21ffb640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa100074f0 0x7faa1000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faa240cfa10 con 0x7faa10006a10 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faa1000e440 con 0x7faa100074f0 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa1000e640 con 0x7faa10005bc0 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa227fc640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa10006a10 0x7faa10006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa10005fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa237fe640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa100074f0 0x7faa1000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 msgr2=0x7faa10005fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa22ffd640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 msgr2=0x7faa10005fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa10005fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa10005fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa227fc640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 msgr2=0x7faa10005fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa227fc640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa10005fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa227fc640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa100074f0 msgr2=0x7faa1000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:53:58.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa227fc640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa100074f0 0x7faa1000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.061+0000 7faa227fc640 1 -- 172.21.15.42:0/2297899837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa10005730 con 0x7faa10006a10 2024-09-16T01:53:58.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.062+0000 7faa227fc640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa10006a10 0x7faa10006e90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa240b0150 tx=0x7faa10007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f18991d13a9416 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:58.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.062+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14007b70 con 0x7faa10006a10 2024-09-16T01:53:58.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.062+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa14031620 con 0x7faa10006a10 2024-09-16T01:53:58.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.062+0000 7faa21ffb640 1 -- 172.21.15.42:0/2297899837 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14031a10 con 0x7faa10006a10 2024-09-16T01:53:58.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.063+0000 7faa296a5640 1 -- 172.21.15.42:0/2297899837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa10006a10 msgr2=0x7faa10006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.063+0000 7faa296a5640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa10006a10 0x7faa10006e90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa240b0150 tx=0x7faa10007a40 comp rx=0 tx=0).stop 2024-09-16T01:53:58.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.063+0000 7faa296a5640 1 -- 172.21.15.42:0/2297899837 shutdown_connections 2024-09-16T01:53:58.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.063+0000 7faa296a5640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa100074f0 0x7faa1000dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.063+0000 7faa296a5640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa10006a10 0x7faa10006e90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.063+0000 7faa296a5640 1 --2- 172.21.15.42:0/2297899837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa10005fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.063+0000 7faa296a5640 1 -- 172.21.15.42:0/2297899837 >> 172.21.15.42:0/2297899837 conn(0x7faa240735d0 msgr2=0x7faa2406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:58.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.063+0000 7faa296a5640 1 -- 172.21.15.42:0/2297899837 shutdown_connections 2024-09-16T01:53:58.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.063+0000 7faa296a5640 1 -- 172.21.15.42:0/2297899837 wait complete. 2024-09-16T01:53:58.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.066+0000 7faa296a5640 1 Processor -- start 2024-09-16T01:53:58.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.066+0000 7faa296a5640 1 -- start start 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa296a5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa24156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa296a5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10006a10 0x7faa2414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa296a5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa100074f0 0x7faa241ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa296a5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faa240b6010 con 0x7faa100074f0 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa296a5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faa2415b450 con 0x7faa10006a10 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa296a5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa240b6190 con 0x7faa10005bc0 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa237fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa100074f0 0x7faa241ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa227fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10006a10 0x7faa2414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa22ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa24156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa237fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa100074f0 0x7faa241ef7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54906/0 (socket says 172.21.15.42:54906) 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa227fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10006a10 0x7faa2414f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:60108/0 (socket says 172.21.15.42:60108) 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa237fe640 1 -- 172.21.15.42:0/2570728398 learned_addr learned my addr 172.21.15.42:0/2570728398 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa22ffd640 1 -- 172.21.15.42:0/2570728398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 msgr2=0x7faa24156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa22ffd640 1 -- 172.21.15.42:0/2570728398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 msgr2=0x7faa24156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2570728398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa24156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa22ffd640 1 --2- 172.21.15.42:0/2570728398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa24156eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa237fe640 1 -- 172.21.15.42:0/2570728398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 msgr2=0x7faa24156eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa237fe640 1 --2- 172.21.15.42:0/2570728398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa24156eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa237fe640 1 -- 172.21.15.42:0/2570728398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10006a10 msgr2=0x7faa2414f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa237fe640 1 --2- 172.21.15.42:0/2570728398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10006a10 0x7faa2414f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.067+0000 7faa237fe640 1 -- 172.21.15.42:0/2570728398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa24159980 con 0x7faa100074f0 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.068+0000 7faa237fe640 1 --2- 172.21.15.42:0/2570728398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa100074f0 0x7faa241ef7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faa24070790 tx=0x7faa1c015d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.068+0000 7faa1b7fe640 1 -- 172.21.15.42:0/2570728398 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c01c070 con 0x7faa100074f0 2024-09-16T01:53:58.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.068+0000 7faa1b7fe640 1 -- 172.21.15.42:0/2570728398 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c003ba0 con 0x7faa100074f0 2024-09-16T01:53:58.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.068+0000 7faa296a5640 1 -- 172.21.15.42:0/2570728398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa24159c60 con 0x7faa100074f0 2024-09-16T01:53:58.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.068+0000 7faa1b7fe640 1 -- 172.21.15.42:0/2570728398 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0092d0 con 0x7faa100074f0 2024-09-16T01:53:58.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.068+0000 7faa296a5640 1 -- 172.21.15.42:0/2570728398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2415a220 con 0x7faa100074f0 2024-09-16T01:53:58.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.068+0000 7faa1b7fe640 1 -- 172.21.15.42:0/2570728398 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faa1c01f070 con 0x7faa100074f0 2024-09-16T01:53:58.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.068+0000 7faa1b7fe640 1 -- 172.21.15.42:0/2570728398 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faa1c021450 con 0x7faa100074f0 2024-09-16T01:53:58.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.069+0000 7faa296a5640 1 -- 172.21.15.42:0/2570728398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa240b03f0 con 0x7faa100074f0 2024-09-16T01:53:58.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.072+0000 7faa1b7fe640 1 -- 172.21.15.42:0/2570728398 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7faa1c026020 con 0x7faa100074f0 2024-09-16T01:53:58.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.140+0000 7faa296a5640 1 -- 172.21.15.42:0/2570728398 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7faa2415c750 con 0x7faa100074f0 2024-09-16T01:53:58.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.142+0000 7faa1b7fe640 1 -- 172.21.15.42:0/2570728398 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7faa1c004030 con 0x7faa100074f0 2024-09-16T01:53:58.143 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-09-16T01:53:58.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.143+0000 7faa296a5640 1 -- 172.21.15.42:0/2570728398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa100074f0 msgr2=0x7faa241ef7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.143+0000 7faa296a5640 1 --2- 172.21.15.42:0/2570728398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa100074f0 0x7faa241ef7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faa24070790 tx=0x7faa1c015d00 comp rx=0 tx=0).stop 2024-09-16T01:53:58.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.143+0000 7faa296a5640 1 -- 172.21.15.42:0/2570728398 shutdown_connections 2024-09-16T01:53:58.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.143+0000 7faa296a5640 1 --2- 172.21.15.42:0/2570728398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa100074f0 0x7faa241ef7a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.143+0000 7faa296a5640 1 --2- 172.21.15.42:0/2570728398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa10006a10 0x7faa2414f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.143+0000 7faa296a5640 1 --2- 172.21.15.42:0/2570728398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa10005bc0 0x7faa24156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.143+0000 7faa296a5640 1 -- 172.21.15.42:0/2570728398 >> 172.21.15.42:0/2570728398 conn(0x7faa240735d0 msgr2=0x7faa240cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:58.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.143+0000 7faa296a5640 1 -- 172.21.15.42:0/2570728398 shutdown_connections 2024-09-16T01:53:58.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:53:58.143+0000 7faa296a5640 1 -- 172.21.15.42:0/2570728398 wait complete. 2024-09-16T01:53:58.156 INFO:tasks.ceph:check_enable_crimson: False 2024-09-16T01:53:58.156 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T01:53:58.156 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:58.157 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T01:53:58.174 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:53:58.173+0000 7f1fb720e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:53:58.183 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:58.183 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T01:53:58.185 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:53:58.183+0000 7f5d1161c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:53:58.211 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:58.211 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T01:53:58.215 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:53:58.214+0000 7f1fb720e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:53:58.230 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:53:58.228+0000 7f5d1161c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:53:58.254 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:53:58.255 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T01:53:58.321 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:58.321 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-16T01:53:58.345 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:58.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-16T01:53:58.376 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:53:58.375+0000 7f1fb720e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:53:58.377 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:53:58.376+0000 7f5d1161c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:53:58.401 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:58.401 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-16T01:53:58.429 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:53:58.428+0000 7f1fb720e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:53:58.430 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:53:58.429+0000 7f5d1161c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:53:58.453 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:53:58.453 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-16T01:53:58.518 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 508cf9e9-0769-4afd-86cf-48af76ed36cf 0 2024-09-16T01:53:58.593 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:53:58.592+0000 7f1fb720e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:53:58.600 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:53:58.599+0000 7f5d1161c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:53:58.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.657+0000 7f44380ed640 1 Processor -- start 2024-09-16T01:53:58.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.657+0000 7f44380ed640 1 -- start start 2024-09-16T01:53:58.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f44380ed640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f443015b1b0 0x7f44300b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f44380ed640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44300b5770 con 0x7f44300b48e0 2024-09-16T01:53:58.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f44380ed640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44300b09f0 con 0x7f443009ab10 2024-09-16T01:53:58.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f44380ed640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f44300b0cd0 con 0x7f443015b1b0 2024-09-16T01:53:58.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f4435e89640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f443015b1b0 0x7f44300b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f4435e89640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f443015b1b0 0x7f44300b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33868/0 (socket says 172.21.15.107:33868) 2024-09-16T01:53:58.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f4435e89640 1 -- 172.21.15.107:0/623475996 learned_addr learned my addr 172.21.15.107:0/623475996 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:58.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f4435e89640 1 -- 172.21.15.107:0/623475996 >> v1:172.21.15.107:6789/0 conn(0x7f443009ab10 legacy=0x7f44300b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f4435e89640 1 -- 172.21.15.107:0/623475996 >> v1:172.21.15.42:6789/0 conn(0x7f44300b48e0 legacy=0x7f44300b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f4434e87640 1 -- 172.21.15.107:0/623475996 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1336341236 0 0) 0x7f44300b09f0 con 0x7f443009ab10 2024-09-16T01:53:58.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.658+0000 7f4435e89640 1 -- 172.21.15.107:0/623475996 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44300b0fb0 con 0x7f443015b1b0 2024-09-16T01:53:58.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.659+0000 7f4435e89640 1 --2- 172.21.15.107:0/623475996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 0x7f44300b4e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f442c009870 tx=0x7f442c02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f047ce4233516f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:58.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.659+0000 7f4434e87640 1 -- 172.21.15.107:0/623475996 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c037070 con 0x7f443015b1b0 2024-09-16T01:53:58.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.659+0000 7f4434e87640 1 -- 172.21.15.107:0/623475996 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f442c02ae50 con 0x7f443015b1b0 2024-09-16T01:53:58.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.659+0000 7f4434e87640 1 -- 172.21.15.107:0/623475996 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c032860 con 0x7f443015b1b0 2024-09-16T01:53:58.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.660+0000 7f44380ed640 1 -- 172.21.15.107:0/623475996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 msgr2=0x7f44300b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.660+0000 7f44380ed640 1 --2- 172.21.15.107:0/623475996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 0x7f44300b4e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f442c009870 tx=0x7f442c02a300 comp rx=0 tx=0).stop 2024-09-16T01:53:58.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.660+0000 7f44380ed640 1 -- 172.21.15.107:0/623475996 shutdown_connections 2024-09-16T01:53:58.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.660+0000 7f44380ed640 1 --2- 172.21.15.107:0/623475996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 0x7f44300b4e00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.660+0000 7f44380ed640 1 -- 172.21.15.107:0/623475996 >> 172.21.15.107:0/623475996 conn(0x7f44300734b0 msgr2=0x7f44300b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:58.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.660+0000 7f44380ed640 1 -- 172.21.15.107:0/623475996 shutdown_connections 2024-09-16T01:53:58.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.660+0000 7f44380ed640 1 -- 172.21.15.107:0/623475996 wait complete. 2024-09-16T01:53:58.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.661+0000 7f44380ed640 1 Processor -- start 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.661+0000 7f44380ed640 1 -- start start 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f44380ed640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f443009ab10 0x7f4430149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f44380ed640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44300b48e0 0x7f443014f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f44380ed640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 0x7f443015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f44380ed640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44300b54c0 con 0x7f443009ab10 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f44380ed640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f44300b5340 con 0x7f443015b1b0 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f44380ed640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f443015b590 con 0x7f44300b48e0 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f443668a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 0x7f443015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f4435688640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44300b48e0 0x7f443014f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f4435688640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44300b48e0 0x7f443014f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57516/0 (socket says 172.21.15.107:57516) 2024-09-16T01:53:58.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f4435688640 1 -- 172.21.15.107:0/2689401168 learned_addr learned my addr 172.21.15.107:0/2689401168 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:58.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f443668a640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 0x7f443015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33882/0 (socket says 172.21.15.107:33882) 2024-09-16T01:53:58.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f4435e89640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f443009ab10 0x7f4430149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f4435688640 1 -- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44300b48e0 msgr2=0x7f443014f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-16T01:53:58.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f4435688640 1 -- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44300b48e0 msgr2=0x7f443014f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:53:58.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f4435688640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44300b48e0 0x7f443014f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:58.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f4435688640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44300b48e0 0x7f443014f650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:58.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f443668a640 1 -- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44300b48e0 msgr2=0x7f443014f650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:53:58.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f443668a640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44300b48e0 0x7f443014f650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f443668a640 1 -- 172.21.15.107:0/2689401168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f443009ab10 msgr2=0x7f4430149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f443668a640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f443009ab10 0x7f4430149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f443668a640 1 -- 172.21.15.107:0/2689401168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443014a510 con 0x7f443015b1b0 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f4435e89640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f443009ab10 0x7f4430149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f443668a640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 0x7f443015dbb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f442800c690 tx=0x7f442800cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f44227fc640 1 -- 172.21.15.107:0/2689401168 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428003b70 con 0x7f443015b1b0 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f44227fc640 1 -- 172.21.15.107:0/2689401168 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4428003d10 con 0x7f443015b1b0 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f44380ed640 1 -- 172.21.15.107:0/2689401168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443014e5b0 con 0x7f443015b1b0 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.662+0000 7f44227fc640 1 -- 172.21.15.107:0/2689401168 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428005310 con 0x7f443015b1b0 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.663+0000 7f44380ed640 1 -- 172.21.15.107:0/2689401168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f443014eb70 con 0x7f443015b1b0 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.663+0000 7f44227fc640 1 -- 172.21.15.107:0/2689401168 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f44280054b0 con 0x7f443015b1b0 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.663+0000 7f44227fc640 1 -- 172.21.15.107:0/2689401168 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f4428012880 con 0x7f443015b1b0 2024-09-16T01:53:58.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.664+0000 7f44380ed640 1 -- 172.21.15.107:0/2689401168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f443014d380 con 0x7f443015b1b0 2024-09-16T01:53:58.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.666+0000 7f44227fc640 1 -- 172.21.15.107:0/2689401168 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4428012ad0 con 0x7f443015b1b0 2024-09-16T01:53:58.709 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:53:58.709+0000 7f1fb720e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:53:58.715 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:53:58.714+0000 7f5d1161c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:53:58.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.735+0000 7f44380ed640 1 -- 172.21.15.107:0/2689401168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "508cf9e9-0769-4afd-86cf-48af76ed36cf", "id": 0} v 0) -- 0x7f443014d0a0 con 0x7f443015b1b0 2024-09-16T01:53:58.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.740+0000 7f44227fc640 1 -- 172.21.15.107:0/2689401168 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "508cf9e9-0769-4afd-86cf-48af76ed36cf", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f4428012cb0 con 0x7f443015b1b0 2024-09-16T01:53:58.742 INFO:teuthology.orchestra.run.smithi107.stdout:0 2024-09-16T01:53:58.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.741+0000 7f44380ed640 1 -- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 msgr2=0x7f443015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.741+0000 7f44380ed640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 0x7f443015dbb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f442800c690 tx=0x7f442800cb50 comp rx=0 tx=0).stop 2024-09-16T01:53:58.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.742+0000 7f44380ed640 1 -- 172.21.15.107:0/2689401168 shutdown_connections 2024-09-16T01:53:58.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.742+0000 7f44380ed640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f443015b1b0 0x7f443015dbb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.742+0000 7f44380ed640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44300b48e0 0x7f443014f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.742+0000 7f44380ed640 1 --2- 172.21.15.107:0/2689401168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f443009ab10 0x7f4430149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.742+0000 7f44380ed640 1 -- 172.21.15.107:0/2689401168 >> 172.21.15.107:0/2689401168 conn(0x7f44300734b0 msgr2=0x7f4430150880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:58.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.742+0000 7f44380ed640 1 -- 172.21.15.107:0/2689401168 shutdown_connections 2024-09-16T01:53:58.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.742+0000 7f44380ed640 1 -- 172.21.15.107:0/2689401168 wait complete. 2024-09-16T01:53:58.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 920a2682-24f3-445d-9f9f-724c7753bbbc 1 2024-09-16T01:53:58.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.890+0000 7f9452d78640 1 Processor -- start 2024-09-16T01:53:58.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.890+0000 7f9452d78640 1 -- start start 2024-09-16T01:53:58.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9452d78640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f944c1566e0 0x7f944c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9452d78640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f944c0cee00 0x7f944c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9452d78640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f944c15d530 con 0x7f944c15ccd0 2024-09-16T01:53:58.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9452d78640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f944c0b4440 con 0x7f944c0cee00 2024-09-16T01:53:58.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9452d78640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f944c0b3df0 con 0x7f944c1566e0 2024-09-16T01:53:58.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9450b14640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f944c1566e0 0x7f944c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9450b14640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f944c1566e0 0x7f944c0ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33890/0 (socket says 172.21.15.107:33890) 2024-09-16T01:53:58.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9451315640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f944c15ccd0 0x7f944c15fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:60132/0 (socket says 172.21.15.107:60132) 2024-09-16T01:53:58.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9450b14640 1 -- 172.21.15.107:0/3707816477 learned_addr learned my addr 172.21.15.107:0/3707816477 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:58.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f944bfff640 1 --2- 172.21.15.107:0/3707816477 >> v2:172.21.15.42:3300/0 conn(0x7f944c0cee00 0x7f944c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9450b14640 1 -- 172.21.15.107:0/3707816477 >> v2:172.21.15.42:3300/0 conn(0x7f944c0cee00 msgr2=0x7f944c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:53:58.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9450b14640 1 --2- 172.21.15.107:0/3707816477 >> v2:172.21.15.42:3300/0 conn(0x7f944c0cee00 0x7f944c15c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f944b7fe640 1 -- 172.21.15.107:0/3707816477 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1021317588 0 0) 0x7f944c15d530 con 0x7f944c15ccd0 2024-09-16T01:53:58.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9450b14640 1 -- 172.21.15.107:0/3707816477 >> v1:172.21.15.107:6789/0 conn(0x7f944c15ccd0 legacy=0x7f944c15fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.891+0000 7f9450b14640 1 -- 172.21.15.107:0/3707816477 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c0b40d0 con 0x7f944c1566e0 2024-09-16T01:53:58.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.892+0000 7f9450b14640 1 --2- 172.21.15.107:0/3707816477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c1566e0 0x7f944c0ce8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f944c06e280 tx=0x7f943c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcd590ed1ee8e02a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:58.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.892+0000 7f944b7fe640 1 -- 172.21.15.107:0/3707816477 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c037070 con 0x7f944c1566e0 2024-09-16T01:53:58.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.892+0000 7f944b7fe640 1 -- 172.21.15.107:0/3707816477 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943c032440 con 0x7f944c1566e0 2024-09-16T01:53:58.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.892+0000 7f944b7fe640 1 -- 172.21.15.107:0/3707816477 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c032810 con 0x7f944c1566e0 2024-09-16T01:53:58.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.893+0000 7f9452d78640 1 -- 172.21.15.107:0/3707816477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c1566e0 msgr2=0x7f944c0ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.893+0000 7f9452d78640 1 --2- 172.21.15.107:0/3707816477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c1566e0 0x7f944c0ce8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f944c06e280 tx=0x7f943c02a270 comp rx=0 tx=0).stop 2024-09-16T01:53:58.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.893+0000 7f9452d78640 1 -- 172.21.15.107:0/3707816477 shutdown_connections 2024-09-16T01:53:58.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.893+0000 7f9452d78640 1 --2- 172.21.15.107:0/3707816477 >> v2:172.21.15.42:3300/0 conn(0x7f944c0cee00 0x7f944c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.893+0000 7f9452d78640 1 --2- 172.21.15.107:0/3707816477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c1566e0 0x7f944c0ce8c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.893+0000 7f9452d78640 1 -- 172.21.15.107:0/3707816477 >> 172.21.15.107:0/3707816477 conn(0x7f944c0735d0 msgr2=0x7f944c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:58.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.893+0000 7f9452d78640 1 -- 172.21.15.107:0/3707816477 shutdown_connections 2024-09-16T01:53:58.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.893+0000 7f9452d78640 1 -- 172.21.15.107:0/3707816477 wait complete. 2024-09-16T01:53:58.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.894+0000 7f9452d78640 1 Processor -- start 2024-09-16T01:53:58.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.894+0000 7f9452d78640 1 -- start start 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9452d78640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c0cee00 0x7f944c1473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9452d78640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f944c1566e0 0x7f944c157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9452d78640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f944c15ccd0 0x7f944c15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9452d78640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f944c156c40 con 0x7f944c15ccd0 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9452d78640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f944c156ac0 con 0x7f944c0cee00 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9452d78640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f944c0b58e0 con 0x7f944c1566e0 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9450b14640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c0cee00 0x7f944c1473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9450b14640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c0cee00 0x7f944c1473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33906/0 (socket says 172.21.15.107:33906) 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9450b14640 1 -- 172.21.15.107:0/3075152494 learned_addr learned my addr 172.21.15.107:0/3075152494 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f944bfff640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f944c1566e0 0x7f944c157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9451315640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f944c15ccd0 0x7f944c15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f944bfff640 1 -- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f944c1566e0 msgr2=0x7f944c157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-16T01:53:58.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f944bfff640 1 -- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f944c1566e0 msgr2=0x7f944c157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:53:58.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f944bfff640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f944c1566e0 0x7f944c157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:58.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f944bfff640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f944c1566e0 0x7f944c157d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9450b14640 1 -- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f944c1566e0 msgr2=0x7f944c157d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9450b14640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f944c1566e0 0x7f944c157d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9450b14640 1 -- 172.21.15.107:0/3075152494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f944c15ccd0 msgr2=0x7f944c15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9450b14640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f944c15ccd0 0x7f944c15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9450b14640 1 -- 172.21.15.107:0/3075152494 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c147920 con 0x7f944c0cee00 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9451315640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f944c15ccd0 0x7f944c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.895+0000 7f9450b14640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c0cee00 0x7f944c1473e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f943c02a2b0 tx=0x7f943c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.896+0000 7f94497fa640 1 -- 172.21.15.107:0/3075152494 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c037040 con 0x7f944c0cee00 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.896+0000 7f94497fa640 1 -- 172.21.15.107:0/3075152494 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943c042070 con 0x7f944c0cee00 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.896+0000 7f9452d78640 1 -- 172.21.15.107:0/3075152494 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c1586a0 con 0x7f944c0cee00 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.896+0000 7f94497fa640 1 -- 172.21.15.107:0/3075152494 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c030880 con 0x7f944c0cee00 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.896+0000 7f9452d78640 1 -- 172.21.15.107:0/3075152494 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c159620 con 0x7f944c0cee00 2024-09-16T01:53:58.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.896+0000 7f94497fa640 1 -- 172.21.15.107:0/3075152494 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f943c030a20 con 0x7f944c0cee00 2024-09-16T01:53:58.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.896+0000 7f94497fa640 1 -- 172.21.15.107:0/3075152494 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f943c047b90 con 0x7f944c0cee00 2024-09-16T01:53:58.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.897+0000 7f9452d78640 1 -- 172.21.15.107:0/3075152494 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944c15c790 con 0x7f944c0cee00 2024-09-16T01:53:58.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.899+0000 7f94497fa640 1 -- 172.21.15.107:0/3075152494 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f943c047460 con 0x7f944c0cee00 2024-09-16T01:53:58.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.968+0000 7f9452d78640 1 -- 172.21.15.107:0/3075152494 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "920a2682-24f3-445d-9f9f-724c7753bbbc", "id": 1} v 0) -- 0x7f944c0b6170 con 0x7f944c0cee00 2024-09-16T01:53:58.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.976+0000 7f94497fa640 1 -- 172.21.15.107:0/3075152494 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "920a2682-24f3-445d-9f9f-724c7753bbbc", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f943c047640 con 0x7f944c0cee00 2024-09-16T01:53:58.978 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-09-16T01:53:58.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.977+0000 7f9452d78640 1 -- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c0cee00 msgr2=0x7f944c1473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:58.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.977+0000 7f9452d78640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c0cee00 0x7f944c1473e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f943c02a2b0 tx=0x7f943c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.977+0000 7f9452d78640 1 -- 172.21.15.107:0/3075152494 shutdown_connections 2024-09-16T01:53:58.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.977+0000 7f9452d78640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f944c15ccd0 0x7f944c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.977+0000 7f9452d78640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f944c1566e0 0x7f944c157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.977+0000 7f9452d78640 1 --2- 172.21.15.107:0/3075152494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f944c0cee00 0x7f944c1473e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:58.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.977+0000 7f9452d78640 1 -- 172.21.15.107:0/3075152494 >> 172.21.15.107:0/3075152494 conn(0x7f944c0735d0 msgr2=0x7f944c15d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:58.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.977+0000 7f9452d78640 1 -- 172.21.15.107:0/3075152494 shutdown_connections 2024-09-16T01:53:58.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:58.977+0000 7f9452d78640 1 -- 172.21.15.107:0/3075152494 wait complete. 2024-09-16T01:53:58.988 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 57b7ae20-811c-44ce-b992-d1658bfe7c4e 2 2024-09-16T01:53:59.056 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:53:59.055+0000 7f5d1161c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:53:59.057 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:53:59.056+0000 7f1fb720e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:53:59.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.086+0000 7f8a13023640 1 Processor -- start 2024-09-16T01:53:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.086+0000 7f8a13023640 1 -- start start 2024-09-16T01:53:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a13023640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 0x7f8a0c167070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a13023640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a0c15d820 con 0x7f8a0c15cf10 2024-09-16T01:53:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a13023640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a0c15db00 con 0x7f8a0c15d2f0 2024-09-16T01:53:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a13023640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0c15dde0 con 0x7f8a0c0b6430 2024-09-16T01:53:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a0bfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8a0c15d2f0 0x7f8a0c0b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:60136/0 (socket says 172.21.15.107:60136) 2024-09-16T01:53:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a0bfff640 1 -- 172.21.15.107:0/2470811272 learned_addr learned my addr 172.21.15.107:0/2470811272 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-09-16T01:53:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a115c0640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 0x7f8a0c167070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a115c0640 1 -- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 msgr2=0x7f8a0c167070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a115c0640 1 -- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 msgr2=0x7f8a0c167070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a115c0640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 0x7f8a0c167070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.087+0000 7f8a115c0640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 0x7f8a0c167070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722765638 0 0) 0x7f8a0c15db00 con 0x7f8a0c15d2f0 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89fc003520 con 0x7f8a0c15d2f0 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 406972488 0 0) 0x7f8a0c15d820 con 0x7f8a0c15cf10 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a0c15db00 con 0x7f8a0c15cf10 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 183985263 0 0) 0x7f89fc003520 con 0x7f8a0c15d2f0 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 msgr2=0x7f8a0c167070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 0x7f8a0c167070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 >> v1:172.21.15.42:6789/0 conn(0x7f8a0c15cf10 legacy=0x7f8a0c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c15e0c0 con 0x7f8a0c15d2f0 2024-09-16T01:53:59.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f89f8001670 con 0x7f8a0c15d2f0 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 >> v1:172.21.15.107:6789/0 conn(0x7f8a0c15d2f0 legacy=0x7f8a0c0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89fc003b40 0x7f89fc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89fc004800 0x7f89fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 0x7f89fc005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c15dde0 con 0x7f89fc003b40 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc00bb80 con 0x7f89fc004800 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f89fc00bd80 con 0x7f8a0c0b6430 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a115c0640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 0x7f89fc005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0bfff640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89fc004800 0x7f89fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a10dbf640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89fc003b40 0x7f89fc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0bfff640 1 -- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 msgr2=0x7f89fc005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0bfff640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 0x7f89fc005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0bfff640 1 -- 172.21.15.107:0/2470811272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89fc003b40 msgr2=0x7f89fc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0bfff640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89fc003b40 0x7f89fc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a0bfff640 1 -- 172.21.15.107:0/2470811272 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc003520 con 0x7f89fc004800 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.088+0000 7f8a115c0640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c0b6430 0x7f89fc005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.089+0000 7f8a0bfff640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89fc004800 0x7f89fc004c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f89f800c210 tx=0x7f89fc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=703d9d4df9501dec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.089+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8007ce0 con 0x7f89fc004800 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.089+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f8005ad0 con 0x7f89fc004800 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.089+0000 7f8a0b7fe640 1 -- 172.21.15.107:0/2470811272 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8007070 con 0x7f89fc004800 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.090+0000 7f8a13023640 1 -- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89fc004800 msgr2=0x7f89fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.090+0000 7f8a13023640 1 --2- 172.21.15.107:0/2470811272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89fc004800 0x7f89fc004c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f89f800c210 tx=0x7f89fc005830 comp rx=0 tx=0).stop 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.090+0000 7f8a115c0640 1 -- 172.21.15.107:0/2470811272 reap_dead start 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.090+0000 7f8a13023640 1 -- 172.21.15.107:0/2470811272 shutdown_connections 2024-09-16T01:53:59.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.090+0000 7f8a13023640 1 -- 172.21.15.107:0/2470811272 >> 172.21.15.107:0/2470811272 conn(0x7f8a0c0b7970 msgr2=0x7f8a0c0b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.090+0000 7f8a13023640 1 -- 172.21.15.107:0/2470811272 shutdown_connections 2024-09-16T01:53:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.090+0000 7f8a13023640 1 -- 172.21.15.107:0/2470811272 wait complete. 2024-09-16T01:53:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.091+0000 7f8a13023640 1 Processor -- start 2024-09-16T01:53:59.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.091+0000 7f8a13023640 1 -- start start 2024-09-16T01:53:59.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a13023640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89fc004800 0x7f8a0c09fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a13023640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c155330 0x7f8a0c146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a13023640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a0c09dcb0 0x7f8a0c09e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a13023640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c0b3860 con 0x7f89fc004800 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a13023640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c0b36e0 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a13023640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0c15f8d0 con 0x7f8a0c155330 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a115c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a0c09dcb0 0x7f8a0c09e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a0bfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c155330 0x7f8a0c146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a115c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a0c09dcb0 0x7f8a0c09e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33924/0 (socket says 172.21.15.107:33924) 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a115c0640 1 -- 172.21.15.107:0/4055592537 learned_addr learned my addr 172.21.15.107:0/4055592537 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a10dbf640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89fc004800 0x7f8a0c09fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a0bfff640 1 -- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c155330 msgr2=0x7f8a0c146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a0bfff640 1 -- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c155330 msgr2=0x7f8a0c146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a0bfff640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c155330 0x7f8a0c146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a0bfff640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c155330 0x7f8a0c146cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:59.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a115c0640 1 -- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c155330 msgr2=0x7f8a0c146cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a115c0640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c155330 0x7f8a0c146cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a115c0640 1 -- 172.21.15.107:0/4055592537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89fc004800 msgr2=0x7f8a0c09fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a115c0640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89fc004800 0x7f8a0c09fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a115c0640 1 -- 172.21.15.107:0/4055592537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c155ba0 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.092+0000 7f8a10dbf640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89fc004800 0x7f8a0c09fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.093+0000 7f8a115c0640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a0c09dcb0 0x7f8a0c09e130 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009610 tx=0x7f8a04007700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.093+0000 7f8a097fa640 1 -- 172.21.15.107:0/4055592537 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04009bd0 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.093+0000 7f8a097fa640 1 -- 172.21.15.107:0/4055592537 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a04019070 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.093+0000 7f8a13023640 1 -- 172.21.15.107:0/4055592537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c09d4d0 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.093+0000 7f8a097fa640 1 -- 172.21.15.107:0/4055592537 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a040139c0 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.093+0000 7f8a13023640 1 -- 172.21.15.107:0/4055592537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c0afac0 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.093+0000 7f8a097fa640 1 -- 172.21.15.107:0/4055592537 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a04014410 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.093+0000 7f8a097fa640 1 -- 172.21.15.107:0/4055592537 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8a04014b20 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.094+0000 7f8a13023640 1 -- 172.21.15.107:0/4055592537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a0c0af8b0 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.096+0000 7f8a097fa640 1 -- 172.21.15.107:0/4055592537 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8a04022020 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.113 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:53:59.111+0000 7f1fb720e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:53:59.115 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:53:59.114+0000 7f5d1161c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:53:59.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.165+0000 7f8a13023640 1 -- 172.21.15.107:0/4055592537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "57b7ae20-811c-44ce-b992-d1658bfe7c4e", "id": 2} v 0) -- 0x7f8a0c0b2fd0 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.168+0000 7f8a097fa640 1 -- 172.21.15.107:0/4055592537 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "57b7ae20-811c-44ce-b992-d1658bfe7c4e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f8a04014d20 con 0x7f8a0c09dcb0 2024-09-16T01:53:59.169 INFO:teuthology.orchestra.run.smithi107.stdout:2 2024-09-16T01:53:59.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.169+0000 7f8a13023640 1 -- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a0c09dcb0 msgr2=0x7f8a0c09e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.169+0000 7f8a13023640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a0c09dcb0 0x7f8a0c09e130 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009610 tx=0x7f8a04007700 comp rx=0 tx=0).stop 2024-09-16T01:53:59.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.169+0000 7f8a13023640 1 -- 172.21.15.107:0/4055592537 shutdown_connections 2024-09-16T01:53:59.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.169+0000 7f8a13023640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a0c09dcb0 0x7f8a0c09e130 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.169+0000 7f8a13023640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8a0c155330 0x7f8a0c146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.169+0000 7f8a13023640 1 --2- 172.21.15.107:0/4055592537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89fc004800 0x7f8a0c09fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.169+0000 7f8a13023640 1 -- 172.21.15.107:0/4055592537 >> 172.21.15.107:0/4055592537 conn(0x7f8a0c0b7970 msgr2=0x7f8a0c070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:59.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.169+0000 7f8a13023640 1 -- 172.21.15.107:0/4055592537 shutdown_connections 2024-09-16T01:53:59.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.169+0000 7f8a13023640 1 -- 172.21.15.107:0/4055592537 wait complete. 2024-09-16T01:53:59.180 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 550be68c-fdb9-4643-b20d-0cd602a754ed 3 2024-09-16T01:53:59.269 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:53:59.268+0000 7f1fb720e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:53:59.272 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:53:59.271+0000 7f5d1161c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:53:59.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.277+0000 7f50a6837640 1 Processor -- start 2024-09-16T01:53:59.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.277+0000 7f50a6837640 1 -- start start 2024-09-16T01:53:59.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a6837640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f50a015b1b0 0x7f50a00b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a6837640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a00b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a6837640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a00b5770 con 0x7f50a009ab10 2024-09-16T01:53:59.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a6837640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f50a00b09f0 con 0x7f50a015b1b0 2024-09-16T01:53:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a6837640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f50a00b0cd0 con 0x7f50a00b48e0 2024-09-16T01:53:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f509ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f50a015b1b0 0x7f50a00b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a4dd4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a00b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f509ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f50a015b1b0 0x7f50a00b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33930/0 (socket says 172.21.15.107:33930) 2024-09-16T01:53:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a4dd4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a00b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57582/0 (socket says 172.21.15.107:57582) 2024-09-16T01:53:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f509ffff640 1 -- 172.21.15.107:0/1892517484 learned_addr learned my addr 172.21.15.107:0/1892517484 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a4dd4640 1 -- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 msgr2=0x7f50a00b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-16T01:53:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a4dd4640 1 -- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 msgr2=0x7f50a00b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a4dd4640 1 --2- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a00b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f50a4dd4640 1 --2- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a00b14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f509ffff640 1 -- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 msgr2=0x7f50a00b14d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:53:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f509ffff640 1 --2- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a00b14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f509ffff640 1 -- 172.21.15.107:0/1892517484 >> v1:172.21.15.42:6789/0 conn(0x7f50a009ab10 legacy=0x7f50a00b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.278+0000 7f509ffff640 1 -- 172.21.15.107:0/1892517484 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a00b0fb0 con 0x7f50a015b1b0 2024-09-16T01:53:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.279+0000 7f509ffff640 1 --2- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a015b1b0 0x7f50a00b4e00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5090009870 tx=0x7f509002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb7901041c836ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.279+0000 7f509effd640 1 -- 172.21.15.107:0/1892517484 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090037070 con 0x7f50a015b1b0 2024-09-16T01:53:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.279+0000 7f509effd640 1 -- 172.21.15.107:0/1892517484 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5090032440 con 0x7f50a015b1b0 2024-09-16T01:53:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.279+0000 7f509effd640 1 -- 172.21.15.107:0/1892517484 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090032810 con 0x7f50a015b1b0 2024-09-16T01:53:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.280+0000 7f50a6837640 1 -- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a015b1b0 msgr2=0x7f50a00b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.280+0000 7f50a6837640 1 --2- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a015b1b0 0x7f50a00b4e00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5090009870 tx=0x7f509002a270 comp rx=0 tx=0).stop 2024-09-16T01:53:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.280+0000 7f50a6837640 1 -- 172.21.15.107:0/1892517484 shutdown_connections 2024-09-16T01:53:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.280+0000 7f50a6837640 1 --2- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a00b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.280+0000 7f50a6837640 1 --2- 172.21.15.107:0/1892517484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a015b1b0 0x7f50a00b4e00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.280+0000 7f50a6837640 1 -- 172.21.15.107:0/1892517484 >> 172.21.15.107:0/1892517484 conn(0x7f50a00734b0 msgr2=0x7f50a00b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.280+0000 7f50a6837640 1 -- 172.21.15.107:0/1892517484 shutdown_connections 2024-09-16T01:53:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.280+0000 7f50a6837640 1 -- 172.21.15.107:0/1892517484 wait complete. 2024-09-16T01:53:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.281+0000 7f50a6837640 1 Processor -- start 2024-09-16T01:53:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.281+0000 7f50a6837640 1 -- start start 2024-09-16T01:53:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f50a6837640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a009ab10 0x7f50a014ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f50a6837640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a01e60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f50a6837640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a015b1b0 0x7f50a00cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f50a6837640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50a00b54c0 con 0x7f50a015b1b0 2024-09-16T01:53:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f50a6837640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f50a00b5340 con 0x7f50a009ab10 2024-09-16T01:53:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f50a6837640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f50a015b590 con 0x7f50a00b48e0 2024-09-16T01:53:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509f7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a01e60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509f7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a01e60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57590/0 (socket says 172.21.15.107:57590) 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509f7fe640 1 -- 172.21.15.107:0/1602759385 learned_addr learned my addr 172.21.15.107:0/1602759385 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509ffff640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a009ab10 0x7f50a014ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f50a4dd4640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a015b1b0 0x7f50a00cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509f7fe640 1 -- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 msgr2=0x7f50a01e60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509f7fe640 1 -- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 msgr2=0x7f50a01e60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509f7fe640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a01e60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509f7fe640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a01e60d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509ffff640 1 -- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 msgr2=0x7f50a01e60d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509ffff640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a01e60d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509ffff640 1 -- 172.21.15.107:0/1602759385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a015b1b0 msgr2=0x7f50a00cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509ffff640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a015b1b0 0x7f50a00cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509ffff640 1 -- 172.21.15.107:0/1602759385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a01e4b70 con 0x7f50a009ab10 2024-09-16T01:53:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f50a4dd4640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a015b1b0 0x7f50a00cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:53:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509ffff640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a009ab10 0x7f50a014ad20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5090031000 tx=0x7f50900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.282+0000 7f509cff9640 1 -- 172.21.15.107:0/1602759385 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090041020 con 0x7f50a009ab10 2024-09-16T01:53:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.283+0000 7f509cff9640 1 -- 172.21.15.107:0/1602759385 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50900307a0 con 0x7f50a009ab10 2024-09-16T01:53:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.283+0000 7f50a6837640 1 -- 172.21.15.107:0/1602759385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a01e5030 con 0x7f50a009ab10 2024-09-16T01:53:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.283+0000 7f509cff9640 1 -- 172.21.15.107:0/1602759385 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090037040 con 0x7f50a009ab10 2024-09-16T01:53:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.283+0000 7f50a6837640 1 -- 172.21.15.107:0/1602759385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a01e55f0 con 0x7f50a009ab10 2024-09-16T01:53:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.283+0000 7f509cff9640 1 -- 172.21.15.107:0/1602759385 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5090044020 con 0x7f50a009ab10 2024-09-16T01:53:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.283+0000 7f509cff9640 1 -- 172.21.15.107:0/1602759385 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f509003dbf0 con 0x7f50a009ab10 2024-09-16T01:53:59.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.284+0000 7f50a6837640 1 -- 172.21.15.107:0/1602759385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a00b4e00 con 0x7f50a009ab10 2024-09-16T01:53:59.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.286+0000 7f509cff9640 1 -- 172.21.15.107:0/1602759385 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f509004b030 con 0x7f50a009ab10 2024-09-16T01:53:59.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.355+0000 7f50a6837640 1 -- 172.21.15.107:0/1602759385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "550be68c-fdb9-4643-b20d-0cd602a754ed", "id": 3} v 0) -- 0x7f50a00aef70 con 0x7f50a009ab10 2024-09-16T01:53:59.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.358+0000 7f509cff9640 1 -- 172.21.15.107:0/1602759385 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "550be68c-fdb9-4643-b20d-0cd602a754ed", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f509003d420 con 0x7f50a009ab10 2024-09-16T01:53:59.359 INFO:teuthology.orchestra.run.smithi107.stdout:3 2024-09-16T01:53:59.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.359+0000 7f50a6837640 1 -- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a009ab10 msgr2=0x7f50a014ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.359+0000 7f50a6837640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a009ab10 0x7f50a014ad20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5090031000 tx=0x7f50900046c0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.359+0000 7f50a6837640 1 -- 172.21.15.107:0/1602759385 shutdown_connections 2024-09-16T01:53:59.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.359+0000 7f50a6837640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a015b1b0 0x7f50a00cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.359+0000 7f50a6837640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a00b48e0 0x7f50a01e60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.359+0000 7f50a6837640 1 --2- 172.21.15.107:0/1602759385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a009ab10 0x7f50a014ad20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.359+0000 7f50a6837640 1 -- 172.21.15.107:0/1602759385 >> 172.21.15.107:0/1602759385 conn(0x7f50a00734b0 msgr2=0x7f50a006f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:59.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.359+0000 7f50a6837640 1 -- 172.21.15.107:0/1602759385 shutdown_connections 2024-09-16T01:53:59.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.359+0000 7f50a6837640 1 -- 172.21.15.107:0/1602759385 wait complete. 2024-09-16T01:53:59.370 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new a9f2c68b-9906-472b-af51-1f7707c3cc82 4 2024-09-16T01:53:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.467+0000 7f2e59e3c640 1 Processor -- start 2024-09-16T01:53:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.467+0000 7f2e59e3c640 1 -- start start 2024-09-16T01:53:59.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.468+0000 7f2e59e3c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e540b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.468+0000 7f2e59e3c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2e540b48e0 0x7f2e540b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.468+0000 7f2e59e3c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e540b5770 con 0x7f2e5409ab10 2024-09-16T01:53:59.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.468+0000 7f2e59e3c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f2e540b09f0 con 0x7f2e540b48e0 2024-09-16T01:53:59.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.468+0000 7f2e59e3c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2e540b0cd0 con 0x7f2e5415b1b0 2024-09-16T01:53:59.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.468+0000 7f2e537fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e540b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.468+0000 7f2e4bfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2e5409ab10 0x7f2e540b41d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:60146/0 (socket says 172.21.15.107:60146) 2024-09-16T01:53:59.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.468+0000 7f2e4bfff640 1 -- 172.21.15.107:0/2298970830 learned_addr learned my addr 172.21.15.107:0/2298970830 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-09-16T01:53:59.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.468+0000 7f2e537fe640 1 -- 172.21.15.107:0/2298970830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 msgr2=0x7f2e540b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T01:53:59.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.469+0000 7f2e537fe640 1 -- 172.21.15.107:0/2298970830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 msgr2=0x7f2e540b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:59.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.469+0000 7f2e537fe640 1 --2- 172.21.15.107:0/2298970830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e540b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:59.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.469+0000 7f2e53fff640 1 --2- 172.21.15.107:0/2298970830 >> v2:172.21.15.42:3300/0 conn(0x7f2e540b48e0 0x7f2e540b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.469+0000 7f2e537fe640 1 --2- 172.21.15.107:0/2298970830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e540b4e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:59.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.469+0000 7f2e52ffd640 1 -- 172.21.15.107:0/2298970830 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093758373 0 0) 0x7f2e540b5770 con 0x7f2e5409ab10 2024-09-16T01:53:59.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.469+0000 7f2e52ffd640 1 -- 172.21.15.107:0/2298970830 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e40003520 con 0x7f2e5409ab10 2024-09-16T01:53:59.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.469+0000 7f2e53fff640 1 -- 172.21.15.107:0/2298970830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 msgr2=0x7f2e540b4e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:53:59.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.469+0000 7f2e53fff640 1 --2- 172.21.15.107:0/2298970830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e540b4e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.469+0000 7f2e53fff640 1 -- 172.21.15.107:0/2298970830 >> v1:172.21.15.107:6789/0 conn(0x7f2e5409ab10 legacy=0x7f2e540b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.469+0000 7f2e53fff640 1 -- 172.21.15.107:0/2298970830 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e540b0fb0 con 0x7f2e540b48e0 2024-09-16T01:53:59.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.470+0000 7f2e53fff640 1 --2- 172.21.15.107:0/2298970830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e540b48e0 0x7f2e540b14d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009d90 tx=0x7f2e4c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28c666554fdfc1e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:59.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.470+0000 7f2e52ffd640 1 -- 172.21.15.107:0/2298970830 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c007740 con 0x7f2e540b48e0 2024-09-16T01:53:59.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.470+0000 7f2e52ffd640 1 -- 172.21.15.107:0/2298970830 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c0078e0 con 0x7f2e540b48e0 2024-09-16T01:53:59.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.470+0000 7f2e52ffd640 1 -- 172.21.15.107:0/2298970830 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c007cb0 con 0x7f2e540b48e0 2024-09-16T01:53:59.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.470+0000 7f2e59e3c640 1 -- 172.21.15.107:0/2298970830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e540b48e0 msgr2=0x7f2e540b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.470+0000 7f2e59e3c640 1 --2- 172.21.15.107:0/2298970830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e540b48e0 0x7f2e540b14d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009d90 tx=0x7f2e4c02a660 comp rx=0 tx=0).stop 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.470+0000 7f2e59e3c640 1 -- 172.21.15.107:0/2298970830 shutdown_connections 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.470+0000 7f2e59e3c640 1 --2- 172.21.15.107:0/2298970830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e540b48e0 0x7f2e540b14d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.470+0000 7f2e59e3c640 1 --2- 172.21.15.107:0/2298970830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e540b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.470+0000 7f2e59e3c640 1 -- 172.21.15.107:0/2298970830 >> 172.21.15.107:0/2298970830 conn(0x7f2e540734b0 msgr2=0x7f2e540b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.471+0000 7f2e59e3c640 1 -- 172.21.15.107:0/2298970830 shutdown_connections 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.471+0000 7f2e59e3c640 1 -- 172.21.15.107:0/2298970830 wait complete. 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.472+0000 7f2e59e3c640 1 Processor -- start 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.472+0000 7f2e59e3c640 1 -- start start 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.472+0000 7f2e59e3c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e5409ab10 0x7f2e541536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.472+0000 7f2e59e3c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e540b48e0 0x7f2e54155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.472+0000 7f2e59e3c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e541564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.472+0000 7f2e59e3c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2e540b54c0 con 0x7f2e540b48e0 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.472+0000 7f2e59e3c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2e540b5340 con 0x7f2e5409ab10 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.472+0000 7f2e59e3c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5415b590 con 0x7f2e5415b1b0 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.472+0000 7f2e537fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e5409ab10 0x7f2e541536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e53fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e541564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e53fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e541564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57606/0 (socket says 172.21.15.107:57606) 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e53fff640 1 -- 172.21.15.107:0/1460244618 learned_addr learned my addr 172.21.15.107:0/1460244618 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e537fe640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e5409ab10 0x7f2e541536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33946/0 (socket says 172.21.15.107:33946) 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e4bfff640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e540b48e0 0x7f2e54155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e53fff640 1 -- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 msgr2=0x7f2e541564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e53fff640 1 -- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 msgr2=0x7f2e541564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e53fff640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e541564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e53fff640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e541564d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:59.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e537fe640 1 -- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 msgr2=0x7f2e541564d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e537fe640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e541564d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e537fe640 1 -- 172.21.15.107:0/1460244618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e540b48e0 msgr2=0x7f2e54155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e537fe640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e540b48e0 0x7f2e54155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e537fe640 1 -- 172.21.15.107:0/1460244618 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e54153f30 con 0x7f2e5409ab10 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e537fe640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e5409ab10 0x7f2e541536e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400d5a0 tx=0x7f2e4400da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e50ff9640 1 -- 172.21.15.107:0/1460244618 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e440125f0 con 0x7f2e5409ab10 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e50ff9640 1 -- 172.21.15.107:0/1460244618 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e44019070 con 0x7f2e5409ab10 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e59e3c640 1 -- 172.21.15.107:0/1460244618 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e54154210 con 0x7f2e5409ab10 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e50ff9640 1 -- 172.21.15.107:0/1460244618 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e440129d0 con 0x7f2e5409ab10 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e59e3c640 1 -- 172.21.15.107:0/1460244618 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e541547d0 con 0x7f2e5409ab10 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e50ff9640 1 -- 172.21.15.107:0/1460244618 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e44012b70 con 0x7f2e5409ab10 2024-09-16T01:53:59.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.473+0000 7f2e50ff9640 1 -- 172.21.15.107:0/1460244618 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2e44014a30 con 0x7f2e5409ab10 2024-09-16T01:53:59.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.474+0000 7f2e59e3c640 1 -- 172.21.15.107:0/1460244618 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e540b4e00 con 0x7f2e5409ab10 2024-09-16T01:53:59.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.476+0000 7f2e50ff9640 1 -- 172.21.15.107:0/1460244618 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2e44014d50 con 0x7f2e5409ab10 2024-09-16T01:53:59.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.545+0000 7f2e59e3c640 1 -- 172.21.15.107:0/1460244618 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a9f2c68b-9906-472b-af51-1f7707c3cc82", "id": 4} v 0) -- 0x7f2e540afed0 con 0x7f2e5409ab10 2024-09-16T01:53:59.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.548+0000 7f2e50ff9640 1 -- 172.21.15.107:0/1460244618 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a9f2c68b-9906-472b-af51-1f7707c3cc82", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f2e440145f0 con 0x7f2e5409ab10 2024-09-16T01:53:59.550 INFO:teuthology.orchestra.run.smithi107.stdout:4 2024-09-16T01:53:59.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.549+0000 7f2e59e3c640 1 -- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e5409ab10 msgr2=0x7f2e541536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.549+0000 7f2e59e3c640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e5409ab10 0x7f2e541536e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400d5a0 tx=0x7f2e4400da60 comp rx=0 tx=0).stop 2024-09-16T01:53:59.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.549+0000 7f2e59e3c640 1 -- 172.21.15.107:0/1460244618 shutdown_connections 2024-09-16T01:53:59.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.549+0000 7f2e59e3c640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e5415b1b0 0x7f2e541564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.549+0000 7f2e59e3c640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e540b48e0 0x7f2e54155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.549+0000 7f2e59e3c640 1 --2- 172.21.15.107:0/1460244618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e5409ab10 0x7f2e541536e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.549+0000 7f2e59e3c640 1 -- 172.21.15.107:0/1460244618 >> 172.21.15.107:0/1460244618 conn(0x7f2e540734b0 msgr2=0x7f2e5415e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:59.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.549+0000 7f2e59e3c640 1 -- 172.21.15.107:0/1460244618 shutdown_connections 2024-09-16T01:53:59.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.549+0000 7f2e59e3c640 1 -- 172.21.15.107:0/1460244618 wait complete. 2024-09-16T01:53:59.561 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 484684e7-8177-4db0-a40b-ccbe75d070d0 5 2024-09-16T01:53:59.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.681+0000 7f8560dc4640 1 Processor -- start 2024-09-16T01:53:59.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.681+0000 7f8560dc4640 1 -- start start 2024-09-16T01:53:59.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.682+0000 7f8560dc4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f855c1629b0 0x7f855c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.682+0000 7f8560dc4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0ae8c0 0x7f855c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.682+0000 7f8560dc4640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855c0b66a0 con 0x7f855c0b1e20 2024-09-16T01:53:59.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f8560dc4640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f855c0b2c90 con 0x7f855c1629b0 2024-09-16T01:53:59.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f8560dc4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f855c0b60e0 con 0x7f855c0ae8c0 2024-09-16T01:53:59.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855ad9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0ae8c0 0x7f855c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855ad9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0ae8c0 0x7f855c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57610/0 (socket says 172.21.15.107:57610) 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855ad9d640 1 -- 172.21.15.107:0/3173802304 learned_addr learned my addr 172.21.15.107:0/3173802304 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855a59c640 1 --2- 172.21.15.107:0/3173802304 >> v2:172.21.15.42:3300/0 conn(0x7f855c1629b0 0x7f855c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855ad9d640 1 -- 172.21.15.107:0/3173802304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0ae8c0 msgr2=0x7f855c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855ad9d640 1 -- 172.21.15.107:0/3173802304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0ae8c0 msgr2=0x7f855c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855ad9d640 1 --2- 172.21.15.107:0/3173802304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0ae8c0 0x7f855c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855ad9d640 1 --2- 172.21.15.107:0/3173802304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0ae8c0 0x7f855c0b2270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855a59c640 1 -- 172.21.15.107:0/3173802304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0ae8c0 msgr2=0x7f855c0b2270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855a59c640 1 --2- 172.21.15.107:0/3173802304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0ae8c0 0x7f855c0b2270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855a59c640 1 -- 172.21.15.107:0/3173802304 >> v1:172.21.15.42:6789/0 conn(0x7f855c0b1e20 legacy=0x7f855c0ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855a59c640 1 -- 172.21.15.107:0/3173802304 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c0b63c0 con 0x7f855c1629b0 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.683+0000 7f855959a640 1 -- 172.21.15.107:0/3173802304 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325662107 0 0) 0x7f855c0b66a0 con 0x7f855c0b1e20 2024-09-16T01:53:59.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.684+0000 7f855a59c640 1 --2- 172.21.15.107:0/3173802304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f855c1629b0 0x7f855c09aa30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f854c0097a0 tx=0x7f854c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a110034a405283ca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:59.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.684+0000 7f855959a640 1 -- 172.21.15.107:0/3173802304 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c037070 con 0x7f855c1629b0 2024-09-16T01:53:59.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.684+0000 7f855959a640 1 -- 172.21.15.107:0/3173802304 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c032440 con 0x7f855c1629b0 2024-09-16T01:53:59.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.684+0000 7f855959a640 1 -- 172.21.15.107:0/3173802304 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c032810 con 0x7f855c1629b0 2024-09-16T01:53:59.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.685+0000 7f8560dc4640 1 -- 172.21.15.107:0/3173802304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f855c1629b0 msgr2=0x7f855c09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.685+0000 7f8560dc4640 1 --2- 172.21.15.107:0/3173802304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f855c1629b0 0x7f855c09aa30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f854c0097a0 tx=0x7f854c02a210 comp rx=0 tx=0).stop 2024-09-16T01:53:59.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.685+0000 7f8560dc4640 1 -- 172.21.15.107:0/3173802304 shutdown_connections 2024-09-16T01:53:59.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.685+0000 7f8560dc4640 1 --2- 172.21.15.107:0/3173802304 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0ae8c0 0x7f855c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.685+0000 7f8560dc4640 1 --2- 172.21.15.107:0/3173802304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f855c1629b0 0x7f855c09aa30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.685+0000 7f8560dc4640 1 -- 172.21.15.107:0/3173802304 >> 172.21.15.107:0/3173802304 conn(0x7f855c0734b0 msgr2=0x7f855c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:59.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.685+0000 7f8560dc4640 1 -- 172.21.15.107:0/3173802304 shutdown_connections 2024-09-16T01:53:59.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.685+0000 7f8560dc4640 1 -- 172.21.15.107:0/3173802304 wait complete. 2024-09-16T01:53:59.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.687+0000 7f8560dc4640 1 Processor -- start 2024-09-16T01:53:59.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.687+0000 7f8560dc4640 1 -- start start 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.688+0000 7f8560dc4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0b1e20 0x7f855c09ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.688+0000 7f8560dc4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f855c1629b0 0x7f855c09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.688+0000 7f8560dc4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c0c63b0 0x7f855c15c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f8560dc4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f855c162d90 con 0x7f855c1629b0 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f8560dc4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f855c0b0530 con 0x7f855c0c63b0 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f8560dc4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f855c162f10 con 0x7f855c0b1e20 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855a59c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0b1e20 0x7f855c09ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855a59c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0b1e20 0x7f855c09ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57622/0 (socket says 172.21.15.107:57622) 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855a59c640 1 -- 172.21.15.107:0/350424152 learned_addr learned my addr 172.21.15.107:0/350424152 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855ad9d640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c0c63b0 0x7f855c15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855a59c640 1 -- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0b1e20 msgr2=0x7f855c09ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855a59c640 1 -- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0b1e20 msgr2=0x7f855c09ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855a59c640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0b1e20 0x7f855c09ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855a59c640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0b1e20 0x7f855c09ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f8559d9b640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f855c1629b0 0x7f855c09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855ad9d640 1 -- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0b1e20 msgr2=0x7f855c09ef10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855ad9d640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0b1e20 0x7f855c09ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855ad9d640 1 -- 172.21.15.107:0/350424152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f855c1629b0 msgr2=0x7f855c09d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855ad9d640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f855c1629b0 0x7f855c09d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855ad9d640 1 -- 172.21.15.107:0/350424152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c09e000 con 0x7f855c0c63b0 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f855ad9d640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c0c63b0 0x7f855c15c810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8554009fd0 tx=0x7f8554007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f854affd640 1 -- 172.21.15.107:0/350424152 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855401a070 con 0x7f855c0c63b0 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f854affd640 1 -- 172.21.15.107:0/350424152 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855400dbe0 con 0x7f855c0c63b0 2024-09-16T01:53:59.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f854affd640 1 -- 172.21.15.107:0/350424152 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554015400 con 0x7f855c0c63b0 2024-09-16T01:53:59.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f8560dc4640 1 -- 172.21.15.107:0/350424152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855c09e2e0 con 0x7f855c0c63b0 2024-09-16T01:53:59.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f8560dc4640 1 -- 172.21.15.107:0/350424152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855c09e8a0 con 0x7f855c0c63b0 2024-09-16T01:53:59.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.689+0000 7f854affd640 1 -- 172.21.15.107:0/350424152 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f855401d070 con 0x7f855c0c63b0 2024-09-16T01:53:59.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.690+0000 7f854affd640 1 -- 172.21.15.107:0/350424152 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f8554015b20 con 0x7f855c0c63b0 2024-09-16T01:53:59.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.690+0000 7f8560dc4640 1 -- 172.21.15.107:0/350424152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855c0b2860 con 0x7f855c0c63b0 2024-09-16T01:53:59.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.692+0000 7f854affd640 1 -- 172.21.15.107:0/350424152 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8554024070 con 0x7f855c0c63b0 2024-09-16T01:53:59.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.761+0000 7f8560dc4640 1 -- 172.21.15.107:0/350424152 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "484684e7-8177-4db0-a40b-ccbe75d070d0", "id": 5} v 0) -- 0x7f855c0d18f0 con 0x7f855c0c63b0 2024-09-16T01:53:59.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.764+0000 7f854affd640 1 -- 172.21.15.107:0/350424152 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "484684e7-8177-4db0-a40b-ccbe75d070d0", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f8554010070 con 0x7f855c0c63b0 2024-09-16T01:53:59.765 INFO:teuthology.orchestra.run.smithi107.stdout:5 2024-09-16T01:53:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.765+0000 7f8560dc4640 1 -- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c0c63b0 msgr2=0x7f855c15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.765+0000 7f8560dc4640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c0c63b0 0x7f855c15c810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8554009fd0 tx=0x7f8554007ef0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.765+0000 7f8560dc4640 1 -- 172.21.15.107:0/350424152 shutdown_connections 2024-09-16T01:53:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.765+0000 7f8560dc4640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f855c0c63b0 0x7f855c15c810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.765+0000 7f8560dc4640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f855c1629b0 0x7f855c09d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.765+0000 7f8560dc4640 1 --2- 172.21.15.107:0/350424152 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f855c0b1e20 0x7f855c09ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.765+0000 7f8560dc4640 1 -- 172.21.15.107:0/350424152 >> 172.21.15.107:0/350424152 conn(0x7f855c0734b0 msgr2=0x7f855c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:59.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.765+0000 7f8560dc4640 1 -- 172.21.15.107:0/350424152 shutdown_connections 2024-09-16T01:53:59.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.765+0000 7f8560dc4640 1 -- 172.21.15.107:0/350424152 wait complete. 2024-09-16T01:53:59.776 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 17c46c97-625c-4570-8156-7eee3de3c26b 6 2024-09-16T01:53:59.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.874+0000 7fda5781e640 1 Processor -- start 2024-09-16T01:53:59.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.874+0000 7fda5781e640 1 -- start start 2024-09-16T01:53:59.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda5781e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015d2f0 0x7fda500b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda5781e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fda500b6260 0x7fda5015e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda5781e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5015d820 con 0x7fda5015cf10 2024-09-16T01:53:59.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda5781e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fda5015db00 con 0x7fda500b6260 2024-09-16T01:53:59.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda5781e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fda5015dde0 con 0x7fda5015d2f0 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda55dbb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fda500b6260 0x7fda5015e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda54db9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015d2f0 0x7fda500b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda55dbb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fda500b6260 0x7fda5015e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33956/0 (socket says 172.21.15.107:33956) 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda55dbb640 1 -- 172.21.15.107:0/575937858 learned_addr learned my addr 172.21.15.107:0/575937858 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda54db9640 1 -- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015d2f0 msgr2=0x7fda500b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda54db9640 1 -- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015d2f0 msgr2=0x7fda500b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda54db9640 1 --2- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015d2f0 0x7fda500b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda54db9640 1 --2- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015d2f0 0x7fda500b5d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda55dbb640 1 -- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015d2f0 msgr2=0x7fda500b5d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda55dbb640 1 --2- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015d2f0 0x7fda500b5d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda55dbb640 1 -- 172.21.15.107:0/575937858 >> v1:172.21.15.42:6789/0 conn(0x7fda5015cf10 legacy=0x7fda500b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.875+0000 7fda55dbb640 1 -- 172.21.15.107:0/575937858 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5015e0c0 con 0x7fda500b6260 2024-09-16T01:53:59.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.876+0000 7fda55dbb640 1 --2- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda500b6260 0x7fda5015e8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fda48009e50 tx=0x7fda4802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b690eb00efe0ca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:59.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.876+0000 7fda47fff640 1 -- 172.21.15.107:0/575937858 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda48036070 con 0x7fda500b6260 2024-09-16T01:53:59.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.876+0000 7fda47fff640 1 -- 172.21.15.107:0/575937858 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda48031600 con 0x7fda500b6260 2024-09-16T01:53:59.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.876+0000 7fda47fff640 1 -- 172.21.15.107:0/575937858 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda480319d0 con 0x7fda500b6260 2024-09-16T01:53:59.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.877+0000 7fda5781e640 1 -- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda500b6260 msgr2=0x7fda5015e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.877+0000 7fda5781e640 1 --2- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda500b6260 0x7fda5015e8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fda48009e50 tx=0x7fda4802a680 comp rx=0 tx=0).stop 2024-09-16T01:53:59.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.877+0000 7fda5781e640 1 -- 172.21.15.107:0/575937858 shutdown_connections 2024-09-16T01:53:59.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.877+0000 7fda5781e640 1 --2- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda500b6260 0x7fda5015e8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.877+0000 7fda5781e640 1 --2- 172.21.15.107:0/575937858 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015d2f0 0x7fda500b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.877+0000 7fda5781e640 1 -- 172.21.15.107:0/575937858 >> 172.21.15.107:0/575937858 conn(0x7fda500b7970 msgr2=0x7fda500b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:59.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.877+0000 7fda5781e640 1 -- 172.21.15.107:0/575937858 shutdown_connections 2024-09-16T01:53:59.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.877+0000 7fda5781e640 1 -- 172.21.15.107:0/575937858 wait complete. 2024-09-16T01:53:59.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.879+0000 7fda5781e640 1 Processor -- start 2024-09-16T01:53:59.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.879+0000 7fda5781e640 1 -- start start 2024-09-16T01:53:59.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda5781e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda500b6260 0x7fda5013e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda5781e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015cf10 0x7fda500b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda5781e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda5015d2f0 0x7fda5014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:53:59.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda5781e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fda500b3860 con 0x7fda500b6260 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda5781e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fda500b36e0 con 0x7fda5015d2f0 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda5781e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fda5015ee00 con 0x7fda5015cf10 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda54db9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015cf10 0x7fda500b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda54db9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015cf10 0x7fda500b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57638/0 (socket says 172.21.15.107:57638) 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda55dbb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda5015d2f0 0x7fda5014e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda54db9640 1 -- 172.21.15.107:0/3861973481 learned_addr learned my addr 172.21.15.107:0/3861973481 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda555ba640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda500b6260 0x7fda5013e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda54db9640 1 -- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015cf10 msgr2=0x7fda500b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda54db9640 1 -- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015cf10 msgr2=0x7fda500b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda54db9640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015cf10 0x7fda500b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.880+0000 7fda54db9640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015cf10 0x7fda500b0900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:53:59.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda55dbb640 1 -- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015cf10 msgr2=0x7fda500b0900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda55dbb640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015cf10 0x7fda500b0900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda55dbb640 1 -- 172.21.15.107:0/3861973481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda500b6260 msgr2=0x7fda5013e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda55dbb640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda500b6260 0x7fda5013e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda55dbb640 1 -- 172.21.15.107:0/3861973481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5013ebc0 con 0x7fda5015d2f0 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda555ba640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda500b6260 0x7fda5013e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda55dbb640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda5015d2f0 0x7fda5014e960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fda50074350 tx=0x7fda48004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda45ffb640 1 -- 172.21.15.107:0/3861973481 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4803f020 con 0x7fda5015d2f0 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda45ffb640 1 -- 172.21.15.107:0/3861973481 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda48037040 con 0x7fda5015d2f0 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda5781e640 1 -- 172.21.15.107:0/3861973481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda500b1380 con 0x7fda5015d2f0 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda45ffb640 1 -- 172.21.15.107:0/3861973481 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda48036070 con 0x7fda5015d2f0 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda5781e640 1 -- 172.21.15.107:0/3861973481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda500b1940 con 0x7fda5015d2f0 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda45ffb640 1 -- 172.21.15.107:0/3861973481 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fda48042020 con 0x7fda5015d2f0 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.881+0000 7fda45ffb640 1 -- 172.21.15.107:0/3861973481 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fda48044c70 con 0x7fda5015d2f0 2024-09-16T01:53:59.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.882+0000 7fda5781e640 1 -- 172.21.15.107:0/3861973481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda500b5380 con 0x7fda5015d2f0 2024-09-16T01:53:59.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.884+0000 7fda45ffb640 1 -- 172.21.15.107:0/3861973481 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fda500b5380 con 0x7fda5015d2f0 2024-09-16T01:53:59.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.954+0000 7fda5781e640 1 -- 172.21.15.107:0/3861973481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "17c46c97-625c-4570-8156-7eee3de3c26b", "id": 6} v 0) -- 0x7fda5015e8c0 con 0x7fda5015d2f0 2024-09-16T01:53:59.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.957+0000 7fda45ffb640 1 -- 172.21.15.107:0/3861973481 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "17c46c97-625c-4570-8156-7eee3de3c26b", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fda48049030 con 0x7fda5015d2f0 2024-09-16T01:53:59.958 INFO:teuthology.orchestra.run.smithi107.stdout:6 2024-09-16T01:53:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.958+0000 7fda5781e640 1 -- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda5015d2f0 msgr2=0x7fda5014e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:53:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.958+0000 7fda5781e640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda5015d2f0 0x7fda5014e960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fda50074350 tx=0x7fda48004a40 comp rx=0 tx=0).stop 2024-09-16T01:53:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.958+0000 7fda5781e640 1 -- 172.21.15.107:0/3861973481 shutdown_connections 2024-09-16T01:53:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.958+0000 7fda5781e640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda5015d2f0 0x7fda5014e960 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.958+0000 7fda5781e640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda5015cf10 0x7fda500b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.958+0000 7fda5781e640 1 --2- 172.21.15.107:0/3861973481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda500b6260 0x7fda5013e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:53:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.958+0000 7fda5781e640 1 -- 172.21.15.107:0/3861973481 >> 172.21.15.107:0/3861973481 conn(0x7fda500b7970 msgr2=0x7fda500b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:53:59.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.958+0000 7fda5781e640 1 -- 172.21.15.107:0/3861973481 shutdown_connections 2024-09-16T01:53:59.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:53:59.958+0000 7fda5781e640 1 -- 172.21.15.107:0/3861973481 wait complete. 2024-09-16T01:53:59.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new cc31a75c-2b98-4d25-a7cf-e0be100618c6 7 2024-09-16T01:54:00.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.066+0000 7f12b46b7640 1 Processor -- start 2024-09-16T01:54:00.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.066+0000 7f12b46b7640 1 -- start start 2024-09-16T01:54:00.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.067+0000 7f12b46b7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac15b070 0x7f12ac0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:00.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.067+0000 7f12b46b7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f12ac070300 0x7f12ac0b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:00.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.067+0000 7f12b46b7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12ac0cfcb0 con 0x7f12ac0afd10 2024-09-16T01:54:00.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.067+0000 7f12b46b7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f12ac0cfa10 con 0x7f12ac070300 2024-09-16T01:54:00.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.067+0000 7f12b46b7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f12ac06e810 con 0x7f12ac15b070 2024-09-16T01:54:00.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.067+0000 7f12b2c54640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f12ac070300 0x7f12ac0b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:00.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2453640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac15b070 0x7f12ac0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:00.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2c54640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f12ac070300 0x7f12ac0b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33974/0 (socket says 172.21.15.107:33974) 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2c54640 1 -- 172.21.15.107:0/67724353 learned_addr learned my addr 172.21.15.107:0/67724353 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2453640 1 -- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac15b070 msgr2=0x7f12ac0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2453640 1 -- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac15b070 msgr2=0x7f12ac0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2453640 1 --2- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac15b070 0x7f12ac0b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2453640 1 --2- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac15b070 0x7f12ac0b4e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2c54640 1 -- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac15b070 msgr2=0x7f12ac0b4e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2c54640 1 --2- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac15b070 0x7f12ac0b4e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2c54640 1 -- 172.21.15.107:0/67724353 >> v1:172.21.15.107:6789/0 conn(0x7f12ac0afd10 legacy=0x7f12ac15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b2c54640 1 -- 172.21.15.107:0/67724353 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac06eaf0 con 0x7f12ac070300 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.068+0000 7f12b1451640 1 -- 172.21.15.107:0/67724353 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109550334 0 0) 0x7f12ac0cfcb0 con 0x7f12ac0afd10 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b2c54640 1 --2- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ac070300 0x7f12ac0b53c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009e50 tx=0x7f12a402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6498b712b9d51247 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b1451640 1 -- 172.21.15.107:0/67724353 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a4036070 con 0x7f12ac070300 2024-09-16T01:54:00.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b1451640 1 -- 172.21.15.107:0/67724353 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a4031600 con 0x7f12ac070300 2024-09-16T01:54:00.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b1451640 1 -- 172.21.15.107:0/67724353 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a40319d0 con 0x7f12ac070300 2024-09-16T01:54:00.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b46b7640 1 -- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ac070300 msgr2=0x7f12ac0b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:00.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b46b7640 1 --2- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ac070300 0x7f12ac0b53c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009e50 tx=0x7f12a402a710 comp rx=0 tx=0).stop 2024-09-16T01:54:00.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b46b7640 1 -- 172.21.15.107:0/67724353 shutdown_connections 2024-09-16T01:54:00.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b46b7640 1 --2- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ac070300 0x7f12ac0b53c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b46b7640 1 --2- 172.21.15.107:0/67724353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac15b070 0x7f12ac0b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b46b7640 1 -- 172.21.15.107:0/67724353 >> 172.21.15.107:0/67724353 conn(0x7f12ac0735d0 msgr2=0x7f12ac06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:00.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b46b7640 1 -- 172.21.15.107:0/67724353 shutdown_connections 2024-09-16T01:54:00.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.069+0000 7f12b46b7640 1 -- 172.21.15.107:0/67724353 wait complete. 2024-09-16T01:54:00.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b46b7640 1 Processor -- start 2024-09-16T01:54:00.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b46b7640 1 -- start start 2024-09-16T01:54:00.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b46b7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac070300 0x7f12ac14c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:00.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b46b7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12ac0afd10 0x7f12ac14e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:00.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b46b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ac15b070 0x7f12ac157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:00.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b46b7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac0b6010 con 0x7f12ac0afd10 2024-09-16T01:54:00.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b46b7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac15b450 con 0x7f12ac15b070 2024-09-16T01:54:00.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b46b7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f12ac0b6190 con 0x7f12ac070300 2024-09-16T01:54:00.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b2453640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac070300 0x7f12ac14c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:00.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b2453640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac070300 0x7f12ac14c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:57656/0 (socket says 172.21.15.107:57656) 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b2453640 1 -- 172.21.15.107:0/2223468561 learned_addr learned my addr 172.21.15.107:0/2223468561 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.071+0000 7f12b2c54640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ac15b070 0x7f12ac157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b1c52640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12ac0afd10 0x7f12ac14e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b2453640 1 -- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac070300 msgr2=0x7f12ac14c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b2453640 1 -- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac070300 msgr2=0x7f12ac14c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b2453640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac070300 0x7f12ac14c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b2453640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac070300 0x7f12ac14c7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b2c54640 1 -- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac070300 msgr2=0x7f12ac14c7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b2c54640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac070300 0x7f12ac14c7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b2c54640 1 -- 172.21.15.107:0/2223468561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12ac0afd10 msgr2=0x7f12ac14e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b2c54640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12ac0afd10 0x7f12ac14e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b2c54640 1 -- 172.21.15.107:0/2223468561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac155200 con 0x7f12ac15b070 2024-09-16T01:54:00.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b2c54640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ac15b070 0x7f12ac157a40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12a4030000 tx=0x7f12a4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:00.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12a2ffd640 1 -- 172.21.15.107:0/2223468561 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a4036050 con 0x7f12ac15b070 2024-09-16T01:54:00.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12a2ffd640 1 -- 172.21.15.107:0/2223468561 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a4042070 con 0x7f12ac15b070 2024-09-16T01:54:00.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b46b7640 1 -- 172.21.15.107:0/2223468561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac1554e0 con 0x7f12ac15b070 2024-09-16T01:54:00.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12a2ffd640 1 -- 172.21.15.107:0/2223468561 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a4009510 con 0x7f12ac15b070 2024-09-16T01:54:00.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12b46b7640 1 -- 172.21.15.107:0/2223468561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac155aa0 con 0x7f12ac15b070 2024-09-16T01:54:00.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12a2ffd640 1 -- 172.21.15.107:0/2223468561 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f12a4007bf0 con 0x7f12ac15b070 2024-09-16T01:54:00.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.072+0000 7f12a2ffd640 1 -- 172.21.15.107:0/2223468561 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f12a403dab0 con 0x7f12ac15b070 2024-09-16T01:54:00.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.073+0000 7f12b46b7640 1 -- 172.21.15.107:0/2223468561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ac0b03f0 con 0x7f12ac15b070 2024-09-16T01:54:00.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.075+0000 7f12a2ffd640 1 -- 172.21.15.107:0/2223468561 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f12a403dd50 con 0x7f12ac15b070 2024-09-16T01:54:00.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.144+0000 7f12b46b7640 1 -- 172.21.15.107:0/2223468561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cc31a75c-2b98-4d25-a7cf-e0be100618c6", "id": 7} v 0) -- 0x7f12ac15ea00 con 0x7f12ac15b070 2024-09-16T01:54:00.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.150+0000 7f12a2ffd640 1 -- 172.21.15.107:0/2223468561 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc31a75c-2b98-4d25-a7cf-e0be100618c6", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f12a4047460 con 0x7f12ac15b070 2024-09-16T01:54:00.152 INFO:teuthology.orchestra.run.smithi107.stdout:7 2024-09-16T01:54:00.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.151+0000 7f12b46b7640 1 -- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ac15b070 msgr2=0x7f12ac157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:00.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.151+0000 7f12b46b7640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ac15b070 0x7f12ac157a40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12a4030000 tx=0x7f12a4004a40 comp rx=0 tx=0).stop 2024-09-16T01:54:00.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.151+0000 7f12b46b7640 1 -- 172.21.15.107:0/2223468561 shutdown_connections 2024-09-16T01:54:00.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.151+0000 7f12b46b7640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f12ac15b070 0x7f12ac157a40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.151+0000 7f12b46b7640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12ac0afd10 0x7f12ac14e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.151+0000 7f12b46b7640 1 --2- 172.21.15.107:0/2223468561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f12ac070300 0x7f12ac14c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.151+0000 7f12b46b7640 1 -- 172.21.15.107:0/2223468561 >> 172.21.15.107:0/2223468561 conn(0x7f12ac0735d0 msgr2=0x7f12ac06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:00.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.151+0000 7f12b46b7640 1 -- 172.21.15.107:0/2223468561 shutdown_connections 2024-09-16T01:54:00.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:00.151+0000 7f12b46b7640 1 -- 172.21.15.107:0/2223468561 wait complete. 2024-09-16T01:54:00.162 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T01:54:00.163 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-16T01:54:00.165 INFO:tasks.ceph.osd.0:Started 2024-09-16T01:54:00.165 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T01:54:00.165 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-16T01:54:00.167 INFO:tasks.ceph.osd.1:Started 2024-09-16T01:54:00.167 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T01:54:00.167 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-16T01:54:00.170 INFO:tasks.ceph.osd.2:Started 2024-09-16T01:54:00.170 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T01:54:00.170 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-16T01:54:00.172 INFO:tasks.ceph.osd.3:Started 2024-09-16T01:54:00.172 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-16T01:54:00.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-16T01:54:00.174 INFO:tasks.ceph.osd.4:Started 2024-09-16T01:54:00.174 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-16T01:54:00.174 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-16T01:54:00.176 INFO:tasks.ceph.osd.5:Started 2024-09-16T01:54:00.176 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-16T01:54:00.176 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-16T01:54:00.178 INFO:tasks.ceph.osd.6:Started 2024-09-16T01:54:00.178 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-16T01:54:00.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-16T01:54:00.181 INFO:tasks.ceph.osd.7:Started 2024-09-16T01:54:00.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.313+0000 7fa018e47640 1 Processor -- start 2024-09-16T01:54:00.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.313+0000 7fa018e47640 1 -- start start 2024-09-16T01:54:00.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa018e47640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa014161c80 0x7fa01406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:00.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa018e47640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0140b6680 0x7fa0140cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:00.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa018e47640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa01406e870 con 0x7fa014162060 2024-09-16T01:54:00.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa018e47640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa01406d9f0 con 0x7fa0140b6680 2024-09-16T01:54:00.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa018e47640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa01406dcd0 con 0x7fa014161c80 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa01259c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa014161c80 0x7fa01406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa012d9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0140b6680 0x7fa0140cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa01259c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa014161c80 0x7fa01406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:39282/0 (socket says 172.21.15.42:39282) 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa012d9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0140b6680 0x7fa0140cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:60160/0 (socket says 172.21.15.42:60160) 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa01259c640 1 -- 172.21.15.42:0/1759693281 learned_addr learned my addr 172.21.15.42:0/1759693281 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa00bfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa014162060 0x7fa0140b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:35634/0 (socket says 172.21.15.42:35634) 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa01259c640 1 -- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa014161c80 msgr2=0x7fa01406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa01259c640 1 -- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa014161c80 msgr2=0x7fa01406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa01259c640 1 --2- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa014161c80 0x7fa01406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.314+0000 7fa01259c640 1 --2- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa014161c80 0x7fa01406e330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.315+0000 7fa011d9b640 1 -- 172.21.15.42:0/1759693281 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607486111 0 0) 0x7f9ffc001110 con 0x7fa014162060 2024-09-16T01:54:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.315+0000 7fa011d9b640 1 -- 172.21.15.42:0/1759693281 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa000003520 con 0x7fa014162060 2024-09-16T01:54:00.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.315+0000 7fa012d9d640 1 -- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa014161c80 msgr2=0x7fa01406e330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:54:00.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.315+0000 7fa012d9d640 1 --2- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa014161c80 0x7fa01406e330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.315+0000 7fa012d9d640 1 -- 172.21.15.42:0/1759693281 >> v1:172.21.15.107:6789/0 conn(0x7fa014162060 legacy=0x7fa0140b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:00.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.315+0000 7fa012d9d640 1 -- 172.21.15.42:0/1759693281 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01406dfb0 con 0x7fa0140b6680 2024-09-16T01:54:00.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.315+0000 7fa012d9d640 1 --2- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0140b6680 0x7fa0140cf1e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009d90 tx=0x7fa00c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1996254aba7c8494 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:00.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa011d9b640 1 -- 172.21.15.42:0/1759693281 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00c007740 con 0x7fa0140b6680 2024-09-16T01:54:00.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa011d9b640 1 -- 172.21.15.42:0/1759693281 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00c0078e0 con 0x7fa0140b6680 2024-09-16T01:54:00.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa011d9b640 1 -- 172.21.15.42:0/1759693281 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00c007cb0 con 0x7fa0140b6680 2024-09-16T01:54:00.319 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:00.316+0000 7f5d1161c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:54:00.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa018e47640 1 -- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0140b6680 msgr2=0x7fa0140cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:00.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa018e47640 1 --2- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0140b6680 0x7fa0140cf1e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009d90 tx=0x7fa00c02a660 comp rx=0 tx=0).stop 2024-09-16T01:54:00.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa018e47640 1 -- 172.21.15.42:0/1759693281 shutdown_connections 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa018e47640 1 --2- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0140b6680 0x7fa0140cf1e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa018e47640 1 --2- 172.21.15.42:0/1759693281 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa014161c80 0x7fa01406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa018e47640 1 -- 172.21.15.42:0/1759693281 >> 172.21.15.42:0/1759693281 conn(0x7fa0140d44f0 msgr2=0x7fa0140d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa018e47640 1 -- 172.21.15.42:0/1759693281 shutdown_connections 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.316+0000 7fa018e47640 1 -- 172.21.15.42:0/1759693281 wait complete. 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.318+0000 7fa018e47640 1 Processor -- start 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.318+0000 7fa018e47640 1 -- start start 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa018e47640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0140b6680 0x7fa0141552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa018e47640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa014161c80 0x7fa0140ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa018e47640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa014162060 0x7fa0140b9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa018e47640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa0140b6b30 con 0x7fa014161c80 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa018e47640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa0140d2aa0 con 0x7fa014162060 2024-09-16T01:54:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa018e47640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa0140b6cb0 con 0x7fa0140b6680 2024-09-16T01:54:00.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa00bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa014161c80 0x7fa0140ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:00.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa01259c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0140b6680 0x7fa0141552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:00.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa012d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa014162060 0x7fa0140b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:00.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa012d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa014162060 0x7fa0140b9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:60164/0 (socket says 172.21.15.42:60164) 2024-09-16T01:54:00.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa01259c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0140b6680 0x7fa0141552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:39284/0 (socket says 172.21.15.42:39284) 2024-09-16T01:54:00.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa012d9d640 1 -- 172.21.15.42:0/2765151865 learned_addr learned my addr 172.21.15.42:0/2765151865 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:00.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa00bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa014161c80 0x7fa0140ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54950/0 (socket says 172.21.15.42:54950) 2024-09-16T01:54:00.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa01259c640 1 -- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0140b6680 msgr2=0x7fa0141552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa01259c640 1 -- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0140b6680 msgr2=0x7fa0141552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa01259c640 1 --2- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0140b6680 0x7fa0141552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa01259c640 1 --2- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0140b6680 0x7fa0141552e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa00bfff640 1 -- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0140b6680 msgr2=0x7fa0141552e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa00bfff640 1 --2- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0140b6680 0x7fa0141552e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa00bfff640 1 -- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa014162060 msgr2=0x7fa0140b9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa00bfff640 1 --2- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa014162060 0x7fa0140b9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa00bfff640 1 -- 172.21.15.42:0/2765151865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0140cccb0 con 0x7fa014161c80 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.319+0000 7fa012d9d640 1 --2- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa014162060 0x7fa0140b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.320+0000 7fa00bfff640 1 --2- 172.21.15.42:0/2765151865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa014161c80 0x7fa0140ce030 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000f60 tx=0x7f9ffc00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.320+0000 7fa00affd640 1 -- 172.21.15.42:0/2765151865 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc017070 con 0x7fa014161c80 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.320+0000 7fa00affd640 1 -- 172.21.15.42:0/2765151865 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ffc005c20 con 0x7fa014161c80 2024-09-16T01:54:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.320+0000 7fa00affd640 1 -- 172.21.15.42:0/2765151865 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0070d0 con 0x7fa014161c80 2024-09-16T01:54:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.320+0000 7fa018e47640 1 -- 172.21.15.42:0/2765151865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0140ccf90 con 0x7fa014161c80 2024-09-16T01:54:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.320+0000 7fa018e47640 1 -- 172.21.15.42:0/2765151865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0140cd550 con 0x7fa014161c80 2024-09-16T01:54:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.320+0000 7fa00affd640 1 -- 172.21.15.42:0/2765151865 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ffc01a070 con 0x7fa014161c80 2024-09-16T01:54:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.320+0000 7fa00affd640 1 -- 172.21.15.42:0/2765151865 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9ffc012ad0 con 0x7fa014161c80 2024-09-16T01:54:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.321+0000 7fa018e47640 1 -- 172.21.15.42:0/2765151865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0140b20b0 con 0x7fa014161c80 2024-09-16T01:54:00.326 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:00.322+0000 7f1fb720e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:54:00.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.323+0000 7fa00affd640 1 -- 172.21.15.42:0/2765151865 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa0140b20b0 con 0x7fa014161c80 2024-09-16T01:54:00.373 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:00.372+0000 7f5d1161c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:54:00.376 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:00.375+0000 7f1fb720e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:54:00.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.383+0000 7fa018e47640 1 -- 172.21.15.42:0/2765151865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0140ba470 con 0x7fa014161c80 2024-09-16T01:54:00.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.384+0000 7fa00affd640 1 -- 172.21.15.42:0/2765151865 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9ffc021020 con 0x7fa014161c80 2024-09-16T01:54:00.385 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:00.385 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:00.146407+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:00.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.385+0000 7fa018e47640 1 -- 172.21.15.42:0/2765151865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa014161c80 msgr2=0x7fa0140ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:00.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.385+0000 7fa018e47640 1 --2- 172.21.15.42:0/2765151865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa014161c80 0x7fa0140ce030 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000f60 tx=0x7f9ffc00c820 comp rx=0 tx=0).stop 2024-09-16T01:54:00.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.385+0000 7fa018e47640 1 -- 172.21.15.42:0/2765151865 shutdown_connections 2024-09-16T01:54:00.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.385+0000 7fa018e47640 1 --2- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa014162060 0x7fa0140b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.385+0000 7fa018e47640 1 --2- 172.21.15.42:0/2765151865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa014161c80 0x7fa0140ce030 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.385+0000 7fa018e47640 1 --2- 172.21.15.42:0/2765151865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa0140b6680 0x7fa0141552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:00.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.385+0000 7fa018e47640 1 -- 172.21.15.42:0/2765151865 >> 172.21.15.42:0/2765151865 conn(0x7fa0140d44f0 msgr2=0x7fa0140cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:00.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.385+0000 7fa018e47640 1 -- 172.21.15.42:0/2765151865 shutdown_connections 2024-09-16T01:54:00.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:00.385+0000 7fa018e47640 1 -- 172.21.15.42:0/2765151865 wait complete. 2024-09-16T01:54:00.397 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T01:54:00.397 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T01:54:00.746 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:00.745+0000 7f1fb720e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:54:00.762 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:00.760+0000 7f5d1161c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:54:00.833 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:00.832+0000 7f1fb720e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:54:00.851 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:00.850+0000 7f5d1161c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:54:00.943 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:00.941+0000 7f1fb720e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:54:00.963 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:00.962+0000 7f5d1161c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:54:00.989 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:00.987+0000 7f1fb720e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:54:01.012 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:01.011+0000 7f5d1161c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:54:01.104 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:01.102+0000 7f1fb720e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:54:01.131 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:01.130+0000 7f5d1161c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:54:01.158 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:01.157+0000 7f1fb720e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:54:01.188 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:01.186+0000 7f5d1161c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:54:01.203 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:01.204 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:01.202+0000 7f1fb720e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:54:01.235 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:01.234+0000 7f5d1161c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:54:01.297 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.295+0000 7f81b58d2640 1 Processor -- start 2024-09-16T01:54:01.297 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.295+0000 7f81b58d2640 1 -- start start 2024-09-16T01:54:01.298 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81b58d2640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f81b006cf80 0x7f81b006e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81b58d2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f81b00b3770 0x7f81b00d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81b58d2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b006d8e0 con 0x7f81b006d360 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81b58d2640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f81b00d33c0 con 0x7f81b006cf80 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81b58d2640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f81b00d29f0 con 0x7f81b00b3770 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81aeffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f81b006cf80 0x7f81b006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81aeffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f81b006cf80 0x7f81b006e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54962/0 (socket says 172.21.15.42:54962) 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81aeffd640 1 -- 172.21.15.42:0/2721181314 learned_addr learned my addr 172.21.15.42:0/2721181314 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81af7fe640 1 --2- 172.21.15.42:0/2721181314 >> v2:172.21.15.107:3300/0 conn(0x7f81b00b3770 0x7f81b00d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81aeffd640 1 -- 172.21.15.42:0/2721181314 >> v2:172.21.15.107:3300/0 conn(0x7f81b00b3770 msgr2=0x7f81b00d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81aeffd640 1 --2- 172.21.15.42:0/2721181314 >> v2:172.21.15.107:3300/0 conn(0x7f81b00b3770 0x7f81b00d2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:01.299 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.296+0000 7f81aeffd640 1 -- 172.21.15.42:0/2721181314 >> v1:172.21.15.107:6789/0 conn(0x7f81b006d360 legacy=0x7f81b01625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:01.300 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.297+0000 7f81aeffd640 1 -- 172.21.15.42:0/2721181314 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b006dbc0 con 0x7f81b006cf80 2024-09-16T01:54:01.300 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.297+0000 7f81aeffd640 1 --2- 172.21.15.42:0/2721181314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006cf80 0x7f81b006e950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81b006e390 tx=0x7f81a002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65021a0c45f15b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:01.300 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.297+0000 7f81adffb640 1 -- 172.21.15.42:0/2721181314 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0037070 con 0x7f81b006cf80 2024-09-16T01:54:01.300 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.297+0000 7f81adffb640 1 -- 172.21.15.42:0/2721181314 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a0032440 con 0x7f81b006cf80 2024-09-16T01:54:01.300 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.297+0000 7f81adffb640 1 -- 172.21.15.42:0/2721181314 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0032810 con 0x7f81b006cf80 2024-09-16T01:54:01.301 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.298+0000 7f81b58d2640 1 -- 172.21.15.42:0/2721181314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006cf80 msgr2=0x7f81b006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:01.301 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.298+0000 7f81b58d2640 1 --2- 172.21.15.42:0/2721181314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006cf80 0x7f81b006e950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81b006e390 tx=0x7f81a002a1e0 comp rx=0 tx=0).stop 2024-09-16T01:54:01.301 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.298+0000 7f81b58d2640 1 -- 172.21.15.42:0/2721181314 shutdown_connections 2024-09-16T01:54:01.301 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.298+0000 7f81b58d2640 1 --2- 172.21.15.42:0/2721181314 >> v2:172.21.15.107:3300/0 conn(0x7f81b00b3770 0x7f81b00d2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:01.301 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.298+0000 7f81b58d2640 1 --2- 172.21.15.42:0/2721181314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006cf80 0x7f81b006e950 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:01.302 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.298+0000 7f81b58d2640 1 -- 172.21.15.42:0/2721181314 >> 172.21.15.42:0/2721181314 conn(0x7f81b008c000 msgr2=0x7f81b00d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:01.302 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.298+0000 7f81b58d2640 1 -- 172.21.15.42:0/2721181314 shutdown_connections 2024-09-16T01:54:01.302 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.298+0000 7f81b58d2640 1 -- 172.21.15.42:0/2721181314 wait complete. 2024-09-16T01:54:01.302 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.299+0000 7f81b58d2640 1 Processor -- start 2024-09-16T01:54:01.302 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81b58d2640 1 -- start start 2024-09-16T01:54:01.305 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81b58d2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b006cf80 0x7f81b00b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:01.305 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81b58d2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006d360 0x7f81b00b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:01.305 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81b58d2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81b00b3770 0x7f81b00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:01.305 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81b58d2640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0162d00 con 0x7f81b006d360 2024-09-16T01:54:01.305 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81b58d2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f81b008c4f0 con 0x7f81b00b3770 2024-09-16T01:54:01.305 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81b58d2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81b0162e80 con 0x7f81b006cf80 2024-09-16T01:54:01.305 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81ae7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006d360 0x7f81b00b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:01.305 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81ae7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006d360 0x7f81b00b67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54976/0 (socket says 172.21.15.42:54976) 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81ae7fc640 1 -- 172.21.15.42:0/2109778029 learned_addr learned my addr 172.21.15.42:0/2109778029 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81aeffd640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b006cf80 0x7f81b00b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.300+0000 7f81af7fe640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81b00b3770 0x7f81b00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81aeffd640 1 -- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b006cf80 msgr2=0x7f81b00b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81aeffd640 1 -- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b006cf80 msgr2=0x7f81b00b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81aeffd640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b006cf80 0x7f81b00b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81aeffd640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b006cf80 0x7f81b00b6270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81ae7fc640 1 -- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b006cf80 msgr2=0x7f81b00b6270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81ae7fc640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b006cf80 0x7f81b00b6270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81ae7fc640 1 -- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81b00b3770 msgr2=0x7f81b00b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:01.306 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81ae7fc640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81b00b3770 0x7f81b00b8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:01.307 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81ae7fc640 1 -- 172.21.15.42:0/2109778029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b01f4290 con 0x7f81b006d360 2024-09-16T01:54:01.307 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81ae7fc640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006d360 0x7f81b00b67b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81a400c400 tx=0x7f81a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:01.307 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f8197fff640 1 -- 172.21.15.42:0/2109778029 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40052d0 con 0x7f81b006d360 2024-09-16T01:54:01.307 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f8197fff640 1 -- 172.21.15.42:0/2109778029 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a4005490 con 0x7f81b006d360 2024-09-16T01:54:01.307 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f8197fff640 1 -- 172.21.15.42:0/2109778029 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4007260 con 0x7f81b006d360 2024-09-16T01:54:01.307 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81b58d2640 1 -- 172.21.15.42:0/2109778029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b01f4570 con 0x7f81b006d360 2024-09-16T01:54:01.307 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f81b58d2640 1 -- 172.21.15.42:0/2109778029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b01f4b30 con 0x7f81b006d360 2024-09-16T01:54:01.307 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f8197fff640 1 -- 172.21.15.42:0/2109778029 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f81a4007400 con 0x7f81b006d360 2024-09-16T01:54:01.307 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.301+0000 7f8197fff640 1 -- 172.21.15.42:0/2109778029 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f81a4011c60 con 0x7f81b006d360 2024-09-16T01:54:01.307 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.302+0000 7f81b58d2640 1 -- 172.21.15.42:0/2109778029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b0163240 con 0x7f81b006d360 2024-09-16T01:54:01.308 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.304+0000 7f8197fff640 1 -- 172.21.15.42:0/2109778029 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f81a40035f0 con 0x7f81b006d360 2024-09-16T01:54:01.316 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:01.315+0000 7f1fb720e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:54:01.356 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:01.354+0000 7f5d1161c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:54:01.365 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.364+0000 7f81b58d2640 1 -- 172.21.15.42:0/2109778029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81b015f580 con 0x7f81b006d360 2024-09-16T01:54:01.365 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.364+0000 7f8197fff640 1 -- 172.21.15.42:0/2109778029 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f81a4003a50 con 0x7f81b006d360 2024-09-16T01:54:01.369 INFO:teuthology.misc.health.smithi042.stdout: 2024-09-16T01:54:01.369 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":10,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:00.146407+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:01.370 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.365+0000 7f81b58d2640 1 -- 172.21.15.42:0/2109778029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006d360 msgr2=0x7f81b00b67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:01.370 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.365+0000 7f81b58d2640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006d360 0x7f81b00b67b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81a400c400 tx=0x7f81a400c8c0 comp rx=0 tx=0).stop 2024-09-16T01:54:01.370 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.365+0000 7f81b58d2640 1 -- 172.21.15.42:0/2109778029 shutdown_connections 2024-09-16T01:54:01.370 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.365+0000 7f81b58d2640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f81b00b3770 0x7f81b00b8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:01.370 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.365+0000 7f81b58d2640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81b006d360 0x7f81b00b67b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:01.370 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.365+0000 7f81b58d2640 1 --2- 172.21.15.42:0/2109778029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81b006cf80 0x7f81b00b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:01.371 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.365+0000 7f81b58d2640 1 -- 172.21.15.42:0/2109778029 >> 172.21.15.42:0/2109778029 conn(0x7f81b008c000 msgr2=0x7f81b00d1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:01.371 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.365+0000 7f81b58d2640 1 -- 172.21.15.42:0/2109778029 shutdown_connections 2024-09-16T01:54:01.371 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:01.365+0000 7f81b58d2640 1 -- 172.21.15.42:0/2109778029 wait complete. 2024-09-16T01:54:01.371 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:01.366+0000 7f1fb720e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:54:01.375 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-16T01:54:01.406 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-09-16T01:54:01.405+0000 7fb2975d9640 -1 Falling back to public interface 2024-09-16T01:54:01.409 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:01.408+0000 7f5d1161c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:54:01.419 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:01.418+0000 7f1fb720e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:54:01.452 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-09-16T01:54:01.451+0000 7f55c59fd640 -1 Falling back to public interface 2024-09-16T01:54:01.463 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:01.462+0000 7f5d1161c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:54:01.490 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:01.489+0000 7f1fb720e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:54:01.534 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:01.533+0000 7f1fb720e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:54:01.534 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:01.532+0000 7f5d1161c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:54:01.578 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:01.577+0000 7f1fb720e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:54:01.580 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:01.578+0000 7f5d1161c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:54:01.626 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:01.625+0000 7f5d1161c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:54:01.634 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-16T01:54:01.633+0000 7f9e7de0c640 -1 Falling back to public interface 2024-09-16T01:54:01.647 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-16T01:54:01.646+0000 7f136f4b6640 -1 Falling back to public interface 2024-09-16T01:54:01.659 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-16T01:54:01.658+0000 7fb7ab60d640 -1 Falling back to public interface 2024-09-16T01:54:01.867 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-09-16T01:54:01.866+0000 7f4a8a741640 -1 Falling back to public interface 2024-09-16T01:54:01.889 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-09-16T01:54:01.888+0000 7fb0536f1640 -1 Falling back to public interface 2024-09-16T01:54:02.138 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-16T01:54:02.136+0000 7f7d878d6640 -1 Falling back to public interface 2024-09-16T01:54:02.240 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:02.239+0000 7f1fb720e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:54:02.324 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-09-16T01:54:02.323+0000 7f5d1161c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:54:03.255 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:03.254+0000 7f1f56e8a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-16T01:54:03.255 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-09-16T01:54:03.254+0000 7f1f56e8a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-16T01:54:04.927 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-09-16T01:54:04.926+0000 7fb2975d9640 -1 osd.7 0 log_to_monitors true 2024-09-16T01:54:05.195 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-16T01:54:05.194+0000 7f9e7de0c640 -1 osd.2 0 log_to_monitors true 2024-09-16T01:54:05.269 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-09-16T01:54:05.268+0000 7f55c59fd640 -1 osd.4 0 log_to_monitors true 2024-09-16T01:54:05.372 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-09-16T01:54:05.371+0000 7f4a8a741640 -1 osd.5 0 log_to_monitors true 2024-09-16T01:54:05.453 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-16T01:54:05.452+0000 7f136f4b6640 -1 osd.0 0 log_to_monitors true 2024-09-16T01:54:05.738 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-16T01:54:05.737+0000 7fb7ab60d640 -1 osd.3 0 log_to_monitors true 2024-09-16T01:54:05.899 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-09-16T01:54:05.898+0000 7fb0536f1640 -1 osd.6 0 log_to_monitors true 2024-09-16T01:54:06.138 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-16T01:54:06.136+0000 7f7d878d6640 -1 osd.1 0 log_to_monitors true 2024-09-16T01:54:06.858 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-16T01:54:06.857+0000 7f9e7971e640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T01:54:06.875 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-16T01:54:06.874+0000 7f9e7153e640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:54:07.021 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-09-16T01:54:07.020+0000 7fb293d7c640 -1 osd.7 0 waiting for initial osdmap 2024-09-16T01:54:07.032 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-09-16T01:54:07.031+0000 7fb28b388640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:54:08.181 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:08.340 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.339+0000 7f6e61c2e640 1 Processor -- start 2024-09-16T01:54:08.341 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.339+0000 7f6e61c2e640 1 -- start start 2024-09-16T01:54:08.342 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.341+0000 7f6e61c2e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6e5c0b3770 0x7f6e5c06e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:08.342 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.341+0000 7f6e61c2e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5c163410 con 0x7f6e5c06d360 2024-09-16T01:54:08.342 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.341+0000 7f6e61c2e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5c06d8e0 con 0x7f6e5c06cf80 2024-09-16T01:54:08.342 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.341+0000 7f6e61c2e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5c0d29f0 con 0x7f6e5c0b3770 2024-09-16T01:54:08.343 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.341+0000 7f6e5bfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6e5c0b3770 0x7f6e5c06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:08.343 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.341+0000 7f6e5affd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6e5c06d360 0x7f6e5c162d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37852/0 (socket says 172.21.15.42:37852) 2024-09-16T01:54:08.343 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.341+0000 7f6e5affd640 1 -- 172.21.15.42:0/3602475976 learned_addr learned my addr 172.21.15.42:0/3602475976 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:08.343 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.341+0000 7f6e5bfff640 1 -- 172.21.15.42:0/3602475976 >> v1:172.21.15.107:6789/0 conn(0x7f6e5c06cf80 legacy=0x7f6e5c1625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:08.343 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.341+0000 7f6e5bfff640 1 -- 172.21.15.42:0/3602475976 >> v1:172.21.15.42:6789/0 conn(0x7f6e5c06d360 legacy=0x7f6e5c162d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:08.344 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.342+0000 7f6e5bfff640 1 -- 172.21.15.42:0/3602475976 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c06dbc0 con 0x7f6e5c0b3770 2024-09-16T01:54:08.344 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.343+0000 7f6e5bfff640 1 --2- 172.21.15.42:0/3602475976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e5c0b3770 0x7f6e5c06e950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0097a0 tx=0x7f6e4c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40cf7c306887bef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:08.350 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.349+0000 7f6e5a7fc640 1 -- 172.21.15.42:0/3602475976 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c037070 con 0x7f6e5c0b3770 2024-09-16T01:54:08.350 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.349+0000 7f6e5a7fc640 1 -- 172.21.15.42:0/3602475976 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4c032440 con 0x7f6e5c0b3770 2024-09-16T01:54:08.351 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.349+0000 7f6e5a7fc640 1 -- 172.21.15.42:0/3602475976 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c032810 con 0x7f6e5c0b3770 2024-09-16T01:54:08.352 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.351+0000 7f6e61c2e640 1 -- 172.21.15.42:0/3602475976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e5c0b3770 msgr2=0x7f6e5c06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:08.352 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.351+0000 7f6e61c2e640 1 --2- 172.21.15.42:0/3602475976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e5c0b3770 0x7f6e5c06e950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0097a0 tx=0x7f6e4c02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:54:08.352 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.351+0000 7f6e61c2e640 1 -- 172.21.15.42:0/3602475976 shutdown_connections 2024-09-16T01:54:08.352 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.351+0000 7f6e61c2e640 1 --2- 172.21.15.42:0/3602475976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e5c0b3770 0x7f6e5c06e950 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:08.352 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.351+0000 7f6e61c2e640 1 -- 172.21.15.42:0/3602475976 >> 172.21.15.42:0/3602475976 conn(0x7f6e5c08c000 msgr2=0x7f6e5c0d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:08.352 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.351+0000 7f6e61c2e640 1 -- 172.21.15.42:0/3602475976 shutdown_connections 2024-09-16T01:54:08.353 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.351+0000 7f6e61c2e640 1 -- 172.21.15.42:0/3602475976 wait complete. 2024-09-16T01:54:08.354 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.353+0000 7f6e61c2e640 1 Processor -- start 2024-09-16T01:54:08.355 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.353+0000 7f6e61c2e640 1 -- start start 2024-09-16T01:54:08.356 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.355+0000 7f6e61c2e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e5c06cf80 0x7f6e5c1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:08.357 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.355+0000 7f6e61c2e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e5c06d360 0x7f6e5c0b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:08.358 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.356+0000 7f6e61c2e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6e5c0b3770 0x7f6e5c0c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:08.358 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.356+0000 7f6e61c2e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0d2e80 con 0x7f6e5c06cf80 2024-09-16T01:54:08.358 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.356+0000 7f6e61c2e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c08c4f0 con 0x7f6e5c06d360 2024-09-16T01:54:08.358 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.356+0000 7f6e5bfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6e5c0b3770 0x7f6e5c0c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:08.358 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.356+0000 7f6e5bfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6e5c0b3770 0x7f6e5c0c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:49240/0 (socket says 172.21.15.42:49240) 2024-09-16T01:54:08.358 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.356+0000 7f6e5bfff640 1 -- 172.21.15.42:0/598140388 learned_addr learned my addr 172.21.15.42:0/598140388 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:08.358 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.356+0000 7f6e61c2e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c0d3000 con 0x7f6e5c0b3770 2024-09-16T01:54:08.358 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.356+0000 7f6e5b7fe640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e5c06cf80 0x7f6e5c1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:08.358 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.356+0000 7f6e5affd640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e5c06d360 0x7f6e5c0b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:08.359 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.357+0000 7f6e5bfff640 1 -- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e5c06d360 msgr2=0x7f6e5c0b9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:08.359 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.357+0000 7f6e5bfff640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e5c06d360 0x7f6e5c0b9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:08.359 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.357+0000 7f6e5bfff640 1 -- 172.21.15.42:0/598140388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e5c06cf80 msgr2=0x7f6e5c1571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:08.359 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.357+0000 7f6e5bfff640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e5c06cf80 0x7f6e5c1571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:08.360 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.357+0000 7f6e5bfff640 1 -- 172.21.15.42:0/598140388 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c0c9240 con 0x7f6e5c0b3770 2024-09-16T01:54:08.360 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.358+0000 7f6e5bfff640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6e5c0b3770 0x7f6e5c0c8b10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0097a0 tx=0x7f6e4c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:08.360 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.359+0000 7f6e43fff640 1 -- 172.21.15.42:0/598140388 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c037040 con 0x7f6e5c0b3770 2024-09-16T01:54:08.360 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.359+0000 7f6e43fff640 1 -- 172.21.15.42:0/598140388 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4c042070 con 0x7f6e5c0b3770 2024-09-16T01:54:08.361 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.359+0000 7f6e61c2e640 1 -- 172.21.15.42:0/598140388 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c0c9520 con 0x7f6e5c0b3770 2024-09-16T01:54:08.361 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.359+0000 7f6e61c2e640 1 -- 172.21.15.42:0/598140388 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c0c9bc0 con 0x7f6e5c0b3770 2024-09-16T01:54:08.361 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.359+0000 7f6e43fff640 1 -- 172.21.15.42:0/598140388 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c030b30 con 0x7f6e5c0b3770 2024-09-16T01:54:08.363 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.360+0000 7f6e61c2e640 1 -- 172.21.15.42:0/598140388 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c005290 con 0x7f6e5c0b3770 2024-09-16T01:54:08.363 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.361+0000 7f6e43fff640 1 -- 172.21.15.42:0/598140388 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7f6e4c030cd0 con 0x7f6e5c0b3770 2024-09-16T01:54:08.363 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.362+0000 7f6e43fff640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6e4806c2f0 0x7f6e4806e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:08.364 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.362+0000 7f6e43fff640 1 -- 172.21.15.42:0/598140388 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 3166+0+0 (secure 0 0 0) 0x7f6e4c0ab290 con 0x7f6e5c0b3770 2024-09-16T01:54:08.364 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.363+0000 7f6e5b7fe640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6e4806c2f0 0x7f6e4806e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:08.364 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.363+0000 7f6e5b7fe640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6e4806c2f0 0x7f6e4806e7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6e50004f60 tx=0x7f6e50007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:08.370 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.369+0000 7f6e43fff640 1 -- 172.21.15.42:0/598140388 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e4c079ef0 con 0x7f6e5c0b3770 2024-09-16T01:54:08.476 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-16T01:54:08.475+0000 7f7d84079640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T01:54:08.481 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-16T01:54:08.480+0000 7fb7a6ff9640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T01:54:08.492 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-16T01:54:08.491+0000 7f7d7b685640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:54:08.496 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-16T01:54:08.495+0000 7fb79ee19640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:54:08.502 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-16T01:54:08.501+0000 7f136b445640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T01:54:08.520 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-16T01:54:08.519+0000 7f1363265640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:54:08.606 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.605+0000 7f6e61c2e640 1 -- 172.21.15.42:0/598140388 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e3c005580 con 0x7f6e5c0b3770 2024-09-16T01:54:08.607 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.606+0000 7f6e43fff640 1 -- 172.21.15.42:0/598140388 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9941 (secure 0 0 0) 0x7f6e4c07e1f0 con 0x7f6e5c0b3770 2024-09-16T01:54:08.607 INFO:teuthology.misc.health.smithi042.stdout: 2024-09-16T01:54:08.607 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":14,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:08.326967+0000","last_up_change":"2024-09-16T01:54:07.259163+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":7.690000057220459,"score_stable":7.690000057220459,"optimal_score":0.12999999523162842,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:08.609 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 -- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6e4806c2f0 msgr2=0x7f6e4806e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:08.609 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6e4806c2f0 0x7f6e4806e7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6e50004f60 tx=0x7f6e50007e30 comp rx=0 tx=0).stop 2024-09-16T01:54:08.609 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 -- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6e5c0b3770 msgr2=0x7f6e5c0c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:08.610 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6e5c0b3770 0x7f6e5c0c8b10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0097a0 tx=0x7f6e4c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:54:08.610 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 -- 172.21.15.42:0/598140388 shutdown_connections 2024-09-16T01:54:08.610 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6e4806c2f0 0x7f6e4806e7b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:08.610 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6e5c0b3770 0x7f6e5c0c8b10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:08.610 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e5c06d360 0x7f6e5c0b9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:08.610 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 --2- 172.21.15.42:0/598140388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e5c06cf80 0x7f6e5c1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:08.610 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 -- 172.21.15.42:0/598140388 >> 172.21.15.42:0/598140388 conn(0x7f6e5c08c000 msgr2=0x7f6e5c0cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:08.610 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 -- 172.21.15.42:0/598140388 shutdown_connections 2024-09-16T01:54:08.610 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:08.608+0000 7f6e61c2e640 1 -- 172.21.15.42:0/598140388 wait complete. 2024-09-16T01:54:08.618 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-16T01:54:08.923 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-09-16T01:54:08.922+0000 7f4a866d0640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T01:54:08.937 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-09-16T01:54:08.937+0000 7f55c198c640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T01:54:08.939 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-09-16T01:54:08.938+0000 7f4a7e4f0640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:54:08.951 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-09-16T01:54:08.950+0000 7f55b97ac640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:54:09.027 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-09-16T01:54:09.026+0000 7fb04fe94640 -1 osd.6 0 waiting for initial osdmap 2024-09-16T01:54:09.046 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-09-16T01:54:09.045+0000 7fb0474a0640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:54:15.425 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:15.530 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.529+0000 7f0fc5d9d640 1 Processor -- start 2024-09-16T01:54:15.530 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.529+0000 7f0fc5d9d640 1 -- start start 2024-09-16T01:54:15.531 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.529+0000 7f0fc5d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fc015e560 0x7f0fc00d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.531 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.529+0000 7f0fc5d9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0fc00cf130 0x7f0fc00d4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fc5d9d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc00d1d30 con 0x7f0fc00cf590 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fc5d9d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc015e940 con 0x7f0fc00cf130 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fc5d9d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc006ce50 con 0x7f0fc015e560 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fbffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0fc00cf130 0x7f0fc00d4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fbffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0fc00cf130 0x7f0fc00d4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38250/0 (socket says 172.21.15.42:38250) 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fbffff640 1 -- 172.21.15.42:0/733729425 learned_addr learned my addr 172.21.15.42:0/733729425 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fc4d9b640 1 --2- 172.21.15.42:0/733729425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fc015e560 0x7f0fc00d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fbffff640 1 -- 172.21.15.42:0/733729425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fc015e560 msgr2=0x7f0fc00d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fbffff640 1 --2- 172.21.15.42:0/733729425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fc015e560 0x7f0fc00d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fbffff640 1 -- 172.21.15.42:0/733729425 >> v1:172.21.15.107:6789/0 conn(0x7f0fc00cf590 legacy=0x7f0fc0161fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:15.532 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.530+0000 7f0fbffff640 1 -- 172.21.15.42:0/733729425 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc00cfa10 con 0x7f0fc00cf130 2024-09-16T01:54:15.533 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.531+0000 7f0fbffff640 1 --2- 172.21.15.42:0/733729425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 0x7f0fc00d4400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009850 tx=0x7f0fac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6251962c2b6f99d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.531+0000 7f0fbf7fe640 1 -- 172.21.15.42:0/733729425 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac004030 con 0x7f0fc00cf130 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.531+0000 7f0fbf7fe640 1 -- 172.21.15.42:0/733729425 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fac0041d0 con 0x7f0fc00cf130 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.531+0000 7f0fbf7fe640 1 -- 172.21.15.42:0/733729425 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac003610 con 0x7f0fc00cf130 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.531+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/733729425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 msgr2=0x7f0fc00d4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.531+0000 7f0fc5d9d640 1 --2- 172.21.15.42:0/733729425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 0x7f0fc00d4400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009850 tx=0x7f0fac02a230 comp rx=0 tx=0).stop 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.532+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/733729425 shutdown_connections 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.532+0000 7f0fc5d9d640 1 --2- 172.21.15.42:0/733729425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 0x7f0fc00d4400 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.532+0000 7f0fc5d9d640 1 --2- 172.21.15.42:0/733729425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fc015e560 0x7f0fc00d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.532+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/733729425 >> 172.21.15.42:0/733729425 conn(0x7f0fc009d790 msgr2=0x7f0fc008c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.532+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/733729425 shutdown_connections 2024-09-16T01:54:15.534 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.532+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/733729425 wait complete. 2024-09-16T01:54:15.536 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.533+0000 7f0fc5d9d640 1 Processor -- start 2024-09-16T01:54:15.536 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.533+0000 7f0fc5d9d640 1 -- start start 2024-09-16T01:54:15.536 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc5d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 0x7f0fc00cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.536 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc5d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fc00cf590 0x7f0fc00b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.536 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc5d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fc015e560 0x7f0fc00b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.537 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc5d9d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc00d02b0 con 0x7f0fc00cf130 2024-09-16T01:54:15.537 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc5d9d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc00cffd0 con 0x7f0fc015e560 2024-09-16T01:54:15.537 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc5d9d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc00d3430 con 0x7f0fc00cf590 2024-09-16T01:54:15.537 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc4d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 0x7f0fc00cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:15.537 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc4d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 0x7f0fc00cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38254/0 (socket says 172.21.15.42:38254) 2024-09-16T01:54:15.537 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc4d9b640 1 -- 172.21.15.42:0/3823924422 learned_addr learned my addr 172.21.15.42:0/3823924422 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:15.537 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc4d9b640 1 -- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fc00cf590 msgr2=0x7f0fc00b8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:15.537 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc4d9b640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fc00cf590 0x7f0fc00b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.538 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc4d9b640 1 -- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fc015e560 msgr2=0x7f0fc00b91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:15.538 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc4d9b640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fc015e560 0x7f0fc00b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.538 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc4d9b640 1 -- 172.21.15.42:0/3823924422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc00b5ae0 con 0x7f0fc00cf130 2024-09-16T01:54:15.538 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fc4d9b640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 0x7f0fc00cdce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400e8a0 tx=0x7f0fb400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:15.538 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.534+0000 7f0fbd7fa640 1 -- 172.21.15.42:0/3823924422 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4017070 con 0x7f0fc00cf130 2024-09-16T01:54:15.538 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.535+0000 7f0fbd7fa640 1 -- 172.21.15.42:0/3823924422 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb400c940 con 0x7f0fc00cf130 2024-09-16T01:54:15.538 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.535+0000 7f0fbd7fa640 1 -- 172.21.15.42:0/3823924422 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400cd30 con 0x7f0fc00cf130 2024-09-16T01:54:15.538 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.535+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/3823924422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc00b5dc0 con 0x7f0fc00cf130 2024-09-16T01:54:15.538 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.535+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/3823924422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc00b6380 con 0x7f0fc00cf130 2024-09-16T01:54:15.539 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.536+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/3823924422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc00ba3f0 con 0x7f0fc00cf130 2024-09-16T01:54:15.539 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.536+0000 7f0fbd7fa640 1 -- 172.21.15.42:0/3823924422 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0fb401a070 con 0x7f0fc00cf130 2024-09-16T01:54:15.540 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.537+0000 7f0fbd7fa640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0fa406c2e0 0x7f0fa406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.540 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.537+0000 7f0fbd7fa640 1 -- 172.21.15.42:0/3823924422 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f0fb408b2f0 con 0x7f0fc00cf130 2024-09-16T01:54:15.540 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.537+0000 7f0fbffff640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0fa406c2e0 0x7f0fa406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:15.540 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.537+0000 7f0fbffff640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0fa406c2e0 0x7f0fa406e7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0fac033000 tx=0x7f0fac02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:15.543 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.541+0000 7f0fbd7fa640 1 -- 172.21.15.42:0/3823924422 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0fb4059db0 con 0x7f0fc00cf130 2024-09-16T01:54:15.719 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.718+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/3823924422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0fc00d17d0 con 0x7f0fc00cf130 2024-09-16T01:54:15.720 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.719+0000 7f0fbd7fa640 1 -- 172.21.15.42:0/3823924422 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7f0fb40596b0 con 0x7f0fc00cf130 2024-09-16T01:54:15.720 INFO:teuthology.misc.health.smithi042.stdout: 2024-09-16T01:54:15.720 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":17,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:11.345886+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:15.722 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0fa406c2e0 msgr2=0x7f0fa406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:15.722 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0fa406c2e0 0x7f0fa406e7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0fac033000 tx=0x7f0fac02c000 comp rx=0 tx=0).stop 2024-09-16T01:54:15.722 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/3823924422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 msgr2=0x7f0fc00cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:15.722 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 0x7f0fc00cdce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400e8a0 tx=0x7f0fb400ed60 comp rx=0 tx=0).stop 2024-09-16T01:54:15.722 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/3823924422 shutdown_connections 2024-09-16T01:54:15.723 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0fa406c2e0 0x7f0fa406e7a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.723 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0fc015e560 0x7f0fc00b91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.723 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0fc00cf590 0x7f0fc00b8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.723 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 --2- 172.21.15.42:0/3823924422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fc00cf130 0x7f0fc00cdce0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.723 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/3823924422 >> 172.21.15.42:0/3823924422 conn(0x7f0fc009d790 msgr2=0x7f0fc006d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:15.723 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/3823924422 shutdown_connections 2024-09-16T01:54:15.723 INFO:teuthology.misc.health.smithi042.stderr:2024-09-16T01:54:15.721+0000 7f0fc5d9d640 1 -- 172.21.15.42:0/3823924422 wait complete. 2024-09-16T01:54:15.731 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-16T01:54:15.731 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T01:54:15.732 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:54:15.732 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:54:15.734 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:54:15.734 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:54:15.734 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:54:15.736 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:54:15.736 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:54:15.737 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:54:15.739 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:54:15.740 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:54:15.740 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:54:15.742 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:54:15.743 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-16T01:54:15.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:54:15.812 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-16T01:54:15.812 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-16T01:54:15.827 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-09-16T01:54:15.827 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-09-16T01:54:15.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.848+0000 7f23d8b49640 1 Processor -- start 2024-09-16T01:54:15.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.848+0000 7f23d8b49640 1 -- start start 2024-09-16T01:54:15.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d8b49640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f23d4161c80 0x7f23d406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d8b49640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f23d4162060 0x7f23d40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d8b49640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d406e870 con 0x7f23d40b64b0 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d8b49640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f23d406d9f0 con 0x7f23d4162060 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d8b49640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f23d406dcd0 con 0x7f23d4161c80 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d1d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f23d4162060 0x7f23d40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d1d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f23d4162060 0x7f23d40b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38288/0 (socket says 172.21.15.42:38288) 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d2d9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f23d40b64b0 0x7f23d4162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37890/0 (socket says 172.21.15.42:37890) 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d1d9b640 1 -- 172.21.15.42:0/2833921698 learned_addr learned my addr 172.21.15.42:0/2833921698 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d259c640 1 --2- 172.21.15.42:0/2833921698 >> v2:172.21.15.107:3300/0 conn(0x7f23d4161c80 0x7f23d406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d1d9b640 1 -- 172.21.15.42:0/2833921698 >> v2:172.21.15.107:3300/0 conn(0x7f23d4161c80 msgr2=0x7f23d406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d1d9b640 1 --2- 172.21.15.42:0/2833921698 >> v2:172.21.15.107:3300/0 conn(0x7f23d4161c80 0x7f23d406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d1d9b640 1 -- 172.21.15.42:0/2833921698 >> v1:172.21.15.42:6789/0 conn(0x7f23d40b64b0 legacy=0x7f23d4162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:15.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.849+0000 7f23d1d9b640 1 -- 172.21.15.42:0/2833921698 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d406dfb0 con 0x7f23d4162060 2024-09-16T01:54:15.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.850+0000 7f23d1d9b640 1 --2- 172.21.15.42:0/2833921698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4162060 0x7f23d40b5f70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23d408d7a0 tx=0x7f23c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26858405755fcdf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:15.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.850+0000 7f23d159a640 1 -- 172.21.15.42:0/2833921698 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8037070 con 0x7f23d4162060 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.850+0000 7f23d159a640 1 -- 172.21.15.42:0/2833921698 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c8032440 con 0x7f23d4162060 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.850+0000 7f23d159a640 1 -- 172.21.15.42:0/2833921698 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8032810 con 0x7f23d4162060 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.850+0000 7f23d8b49640 1 -- 172.21.15.42:0/2833921698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4162060 msgr2=0x7f23d40b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.850+0000 7f23d8b49640 1 --2- 172.21.15.42:0/2833921698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4162060 0x7f23d40b5f70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23d408d7a0 tx=0x7f23c802a270 comp rx=0 tx=0).stop 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.851+0000 7f23d8b49640 1 -- 172.21.15.42:0/2833921698 shutdown_connections 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.851+0000 7f23d8b49640 1 --2- 172.21.15.42:0/2833921698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4162060 0x7f23d40b5f70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.851+0000 7f23d8b49640 1 --2- 172.21.15.42:0/2833921698 >> v2:172.21.15.107:3300/0 conn(0x7f23d4161c80 0x7f23d406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.851+0000 7f23d8b49640 1 -- 172.21.15.42:0/2833921698 >> 172.21.15.42:0/2833921698 conn(0x7f23d40d44f0 msgr2=0x7f23d40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.851+0000 7f23d8b49640 1 -- 172.21.15.42:0/2833921698 shutdown_connections 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.851+0000 7f23d8b49640 1 -- 172.21.15.42:0/2833921698 wait complete. 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.852+0000 7f23d8b49640 1 Processor -- start 2024-09-16T01:54:15.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.852+0000 7f23d8b49640 1 -- start start 2024-09-16T01:54:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d8b49640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23d40b64b0 0x7f23d41567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d8b49640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4161c80 0x7f23d41f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d8b49640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23d4162060 0x7f23d415e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d8b49640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f23d40d2a10 con 0x7f23d4161c80 2024-09-16T01:54:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d8b49640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f23d40d2890 con 0x7f23d4162060 2024-09-16T01:54:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d8b49640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f23d40b6960 con 0x7f23d40b64b0 2024-09-16T01:54:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4161c80 0x7f23d41f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4161c80 0x7f23d41f4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38304/0 (socket says 172.21.15.42:38304) 2024-09-16T01:54:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d1d9b640 1 -- 172.21.15.42:0/245481316 learned_addr learned my addr 172.21.15.42:0/245481316 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d2d9d640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23d4162060 0x7f23d415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:15.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d259c640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23d40b64b0 0x7f23d41567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:15.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d1d9b640 1 -- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23d40b64b0 msgr2=0x7f23d41567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:15.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d1d9b640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23d40b64b0 0x7f23d41567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d1d9b640 1 -- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23d4162060 msgr2=0x7f23d415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:15.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d1d9b640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23d4162060 0x7f23d415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:15.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d1d9b640 1 -- 172.21.15.42:0/245481316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d4157220 con 0x7f23d4161c80 2024-09-16T01:54:15.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d259c640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23d40b64b0 0x7f23d41567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:15.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d2d9d640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23d4162060 0x7f23d415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:15.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23d1d9b640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4161c80 0x7f23d41f4e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23c802a2b0 tx=0x7f23c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:15.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.853+0000 7f23c2ffd640 1 -- 172.21.15.42:0/245481316 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8037040 con 0x7f23d4161c80 2024-09-16T01:54:15.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.854+0000 7f23c2ffd640 1 -- 172.21.15.42:0/245481316 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c8042070 con 0x7f23d4161c80 2024-09-16T01:54:15.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.854+0000 7f23d8b49640 1 -- 172.21.15.42:0/245481316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d41f5380 con 0x7f23d4161c80 2024-09-16T01:54:15.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.854+0000 7f23c2ffd640 1 -- 172.21.15.42:0/245481316 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8030880 con 0x7f23d4161c80 2024-09-16T01:54:15.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.854+0000 7f23d8b49640 1 -- 172.21.15.42:0/245481316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d41577a0 con 0x7f23d4161c80 2024-09-16T01:54:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.854+0000 7f23d8b49640 1 -- 172.21.15.42:0/245481316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d40b3c70 con 0x7f23d4161c80 2024-09-16T01:54:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.855+0000 7f23c2ffd640 1 -- 172.21.15.42:0/245481316 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f23c8030a20 con 0x7f23d4161c80 2024-09-16T01:54:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.855+0000 7f23c2ffd640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f23b406c2b0 0x7f23b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.856+0000 7f23c2ffd640 1 -- 172.21.15.42:0/245481316 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f23c80ab9c0 con 0x7f23d4161c80 2024-09-16T01:54:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.856+0000 7f23d259c640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f23b406c2b0 0x7f23b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.856+0000 7f23d259c640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f23b406c2b0 0x7f23b406e770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009b90 tx=0x7f23c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:15.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:15.860+0000 7f23c2ffd640 1 -- 172.21.15.42:0/245481316 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23d40b3c70 con 0x7f23d4161c80 2024-09-16T01:54:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.072+0000 7f23d8b49640 1 -- 172.21.15.42:0/245481316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23d4160600 con 0x7f23d4161c80 2024-09-16T01:54:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.073+0000 7f23c2ffd640 1 -- 172.21.15.42:0/245481316 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f23c807a470 con 0x7f23d4161c80 2024-09-16T01:54:16.074 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:16.074 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":2,"btime":"2024-09-16T01:54:15:816456+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-16T01:54:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 2 2024-09-16T01:54:16.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 -- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f23b406c2b0 msgr2=0x7f23b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f23b406c2b0 0x7f23b406e770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009b90 tx=0x7f23c4008040 comp rx=0 tx=0).stop 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 -- 172.21.15.42:0/245481316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4161c80 msgr2=0x7f23d41f4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4161c80 0x7f23d41f4e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23c802a2b0 tx=0x7f23c80046c0 comp rx=0 tx=0).stop 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 -- 172.21.15.42:0/245481316 shutdown_connections 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f23b406c2b0 0x7f23b406e770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23d4162060 0x7f23d415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23d4161c80 0x7f23d41f4e40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 --2- 172.21.15.42:0/245481316 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f23d40b64b0 0x7f23d41567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 -- 172.21.15.42:0/245481316 >> 172.21.15.42:0/245481316 conn(0x7f23d40d44f0 msgr2=0x7f23d40b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 -- 172.21.15.42:0/245481316 shutdown_connections 2024-09-16T01:54:16.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:16.075+0000 7f23d8b49640 1 -- 172.21.15.42:0/245481316 wait complete. 2024-09-16T01:54:16.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:54:16.685 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:54:18.088 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:54:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.201+0000 7f5510354640 1 Processor -- start 2024-09-16T01:54:18.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.201+0000 7f5510354640 1 -- start start 2024-09-16T01:54:18.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f5510354640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508162060 0x7f55080b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f5510354640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f55080b64b0 0x7f55080b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f5510354640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f550806d9f0 con 0x7f5508161c80 2024-09-16T01:54:18.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f5510354640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f550806dcd0 con 0x7f55080b64b0 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f5510354640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f550806dfb0 con 0x7f5508162060 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f550e0f0640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5508161c80 0x7f550806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34566/0 (socket says 172.21.15.42:34566) 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f550e0f0640 1 -- 172.21.15.42:0/905839015 learned_addr learned my addr 172.21.15.42:0/905839015 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f550e8f1640 1 --2- 172.21.15.42:0/905839015 >> v2:172.21.15.107:3300/0 conn(0x7f55080b64b0 0x7f55080b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f550d8ef640 1 --2- 172.21.15.42:0/905839015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508162060 0x7f55080b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f550d0ee640 1 -- 172.21.15.42:0/905839015 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867065659 0 0) 0x7f550806d9f0 con 0x7f5508161c80 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.202+0000 7f550d0ee640 1 -- 172.21.15.42:0/905839015 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54f4003520 con 0x7f5508161c80 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.203+0000 7f550d0ee640 1 -- 172.21.15.42:0/905839015 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2651087908 0 0) 0x7f54f4003520 con 0x7f5508161c80 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.203+0000 7f550e8f1640 1 -- 172.21.15.42:0/905839015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508162060 msgr2=0x7f55080b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.203+0000 7f550e8f1640 1 --2- 172.21.15.42:0/905839015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508162060 0x7f55080b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.203+0000 7f550e8f1640 1 -- 172.21.15.42:0/905839015 >> v1:172.21.15.42:6789/0 conn(0x7f5508161c80 legacy=0x7f550806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.203+0000 7f550e8f1640 1 -- 172.21.15.42:0/905839015 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55080d01f0 con 0x7f55080b64b0 2024-09-16T01:54:18.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.203+0000 7f550d8ef640 1 --2- 172.21.15.42:0/905839015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508162060 0x7f55080b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f550e8f1640 1 --2- 172.21.15.42:0/905839015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55080b64b0 0x7f55080b6960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5500009d90 tx=0x7f550002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9468dc978f33ae11 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f550d0ee640 1 -- 172.21.15.42:0/905839015 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504001670 con 0x7f55080b64b0 2024-09-16T01:54:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f550d0ee640 1 -- 172.21.15.42:0/905839015 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5500007540 con 0x7f55080b64b0 2024-09-16T01:54:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f550d0ee640 1 -- 172.21.15.42:0/905839015 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55000078f0 con 0x7f55080b64b0 2024-09-16T01:54:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f5510354640 1 -- 172.21.15.42:0/905839015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55080b64b0 msgr2=0x7f55080b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f5510354640 1 --2- 172.21.15.42:0/905839015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55080b64b0 0x7f55080b6960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5500009d90 tx=0x7f550002a5f0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f5510354640 1 -- 172.21.15.42:0/905839015 shutdown_connections 2024-09-16T01:54:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f5510354640 1 --2- 172.21.15.42:0/905839015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55080b64b0 0x7f55080b6960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f5510354640 1 --2- 172.21.15.42:0/905839015 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508162060 0x7f55080b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f5510354640 1 -- 172.21.15.42:0/905839015 >> 172.21.15.42:0/905839015 conn(0x7f55080d44f0 msgr2=0x7f55080d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f5510354640 1 -- 172.21.15.42:0/905839015 shutdown_connections 2024-09-16T01:54:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.204+0000 7f5510354640 1 -- 172.21.15.42:0/905839015 wait complete. 2024-09-16T01:54:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.206+0000 7f5510354640 1 Processor -- start 2024-09-16T01:54:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.206+0000 7f5510354640 1 -- start start 2024-09-16T01:54:18.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.206+0000 7f5510354640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55080b64b0 0x7f550815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.206+0000 7f5510354640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508161c80 0x7f55080cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.206+0000 7f5510354640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5508162060 0x7f55080cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.206+0000 7f5510354640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55080cf1e0 con 0x7f55080b64b0 2024-09-16T01:54:18.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.206+0000 7f5510354640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f55080d2aa0 con 0x7f5508162060 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.206+0000 7f5510354640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f55080cf360 con 0x7f5508161c80 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.206+0000 7f550e0f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55080b64b0 0x7f550815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550e0f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55080b64b0 0x7f550815eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55598/0 (socket says 172.21.15.42:55598) 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550e0f0640 1 -- 172.21.15.42:0/1018439809 learned_addr learned my addr 172.21.15.42:0/1018439809 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550d8ef640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508161c80 0x7f55080cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550e8f1640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5508162060 0x7f55080cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550e0f0640 1 -- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508161c80 msgr2=0x7f55080cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550e0f0640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508161c80 0x7f55080cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550e0f0640 1 -- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5508162060 msgr2=0x7f55080cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550e0f0640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5508162060 0x7f55080cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550e0f0640 1 -- 172.21.15.42:0/1018439809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55080c87a0 con 0x7f55080b64b0 2024-09-16T01:54:18.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550d8ef640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508161c80 0x7f55080cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f550e0f0640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55080b64b0 0x7f550815eb10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f550400c780 tx=0x7f550400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f54feffd640 1 -- 172.21.15.42:0/1018439809 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504017070 con 0x7f55080b64b0 2024-09-16T01:54:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f54feffd640 1 -- 172.21.15.42:0/1018439809 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5504005ad0 con 0x7f55080b64b0 2024-09-16T01:54:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f5510354640 1 -- 172.21.15.42:0/1018439809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55080c8a80 con 0x7f55080b64b0 2024-09-16T01:54:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f54feffd640 1 -- 172.21.15.42:0/1018439809 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504007070 con 0x7f55080b64b0 2024-09-16T01:54:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.207+0000 7f5510354640 1 -- 172.21.15.42:0/1018439809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550815f050 con 0x7f55080b64b0 2024-09-16T01:54:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.208+0000 7f5510354640 1 -- 172.21.15.42:0/1018439809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55080ba470 con 0x7f55080b64b0 2024-09-16T01:54:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.209+0000 7f54feffd640 1 -- 172.21.15.42:0/1018439809 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f550401a070 con 0x7f55080b64b0 2024-09-16T01:54:18.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.209+0000 7f54feffd640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f54ec06c2b0 0x7f54ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.209+0000 7f54feffd640 1 -- 172.21.15.42:0/1018439809 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f550408a630 con 0x7f55080b64b0 2024-09-16T01:54:18.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.209+0000 7f550d8ef640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f54ec06c2b0 0x7f54ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.210+0000 7f550d8ef640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f54ec06c2b0 0x7f54ec06e770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55080a1fd0 tx=0x7f54f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:18.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.214+0000 7f54feffd640 1 -- 172.21.15.42:0/1018439809 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55040590f0 con 0x7f55080b64b0 2024-09-16T01:54:18.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.429+0000 7f5510354640 1 -- 172.21.15.42:0/1018439809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f550806da90 con 0x7f55080b64b0 2024-09-16T01:54:18.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.429+0000 7f54feffd640 1 -- 172.21.15.42:0/1018439809 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3914 (secure 0 0 0) 0x7f55040589f0 con 0x7f55080b64b0 2024-09-16T01:54:18.431 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:18.431 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":3,"btime":"2024-09-16T01:54:16:817377+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-16T01:54:18.431 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 3 2024-09-16T01:54:18.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 -- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f54ec06c2b0 msgr2=0x7f54ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f54ec06c2b0 0x7f54ec06e770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55080a1fd0 tx=0x7f54f8008040 comp rx=0 tx=0).stop 2024-09-16T01:54:18.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 -- 172.21.15.42:0/1018439809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55080b64b0 msgr2=0x7f550815eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55080b64b0 0x7f550815eb10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f550400c780 tx=0x7f550400cc40 comp rx=0 tx=0).stop 2024-09-16T01:54:18.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 -- 172.21.15.42:0/1018439809 shutdown_connections 2024-09-16T01:54:18.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f54ec06c2b0 0x7f54ec06e770 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5508162060 0x7f55080cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5508161c80 0x7f55080cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 --2- 172.21.15.42:0/1018439809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55080b64b0 0x7f550815eb10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 -- 172.21.15.42:0/1018439809 >> 172.21.15.42:0/1018439809 conn(0x7f55080d44f0 msgr2=0x7f55080b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:18.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.431+0000 7f5510354640 1 -- 172.21.15.42:0/1018439809 shutdown_connections 2024-09-16T01:54:18.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.432+0000 7f5510354640 1 -- 172.21.15.42:0/1018439809 wait complete. 2024-09-16T01:54:18.444 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:54:18.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.545+0000 7f6ba4c4c640 1 Processor -- start 2024-09-16T01:54:18.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.545+0000 7f6ba4c4c640 1 -- start start 2024-09-16T01:54:18.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.546+0000 7f6ba4c4c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba0162060 0x7f6ba00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.546+0000 7f6ba4c4c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6ba00b64b0 0x7f6ba00b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.546+0000 7f6ba4c4c640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba006d9f0 con 0x7f6ba0161c80 2024-09-16T01:54:18.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.546+0000 7f6ba4c4c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6ba006dcd0 con 0x7f6ba00b64b0 2024-09-16T01:54:18.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.546+0000 7f6ba4c4c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba006dfb0 con 0x7f6ba0162060 2024-09-16T01:54:18.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.546+0000 7f6b9e59c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6ba0161c80 0x7f6ba006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34572/0 (socket says 172.21.15.42:34572) 2024-09-16T01:54:18.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.546+0000 7f6b9e59c640 1 -- 172.21.15.42:0/980762500 learned_addr learned my addr 172.21.15.42:0/980762500 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:18.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.546+0000 7f6b9dd9b640 1 --2- 172.21.15.42:0/980762500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba0162060 0x7f6ba00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.546+0000 7f6b9ed9d640 1 --2- 172.21.15.42:0/980762500 >> v2:172.21.15.107:3300/0 conn(0x7f6ba00b64b0 0x7f6ba00b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.547+0000 7f6b9d59a640 1 -- 172.21.15.42:0/980762500 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544777805 0 0) 0x7f6ba006d9f0 con 0x7f6ba0161c80 2024-09-16T01:54:18.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.547+0000 7f6b9d59a640 1 -- 172.21.15.42:0/980762500 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b8c003520 con 0x7f6ba0161c80 2024-09-16T01:54:18.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.547+0000 7f6b9d59a640 1 -- 172.21.15.42:0/980762500 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 78525356 0 0) 0x7f6b8c003520 con 0x7f6ba0161c80 2024-09-16T01:54:18.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.547+0000 7f6b9dd9b640 1 -- 172.21.15.42:0/980762500 >> v2:172.21.15.107:3300/0 conn(0x7f6ba00b64b0 msgr2=0x7f6ba00b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:18.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.547+0000 7f6b9dd9b640 1 --2- 172.21.15.42:0/980762500 >> v2:172.21.15.107:3300/0 conn(0x7f6ba00b64b0 0x7f6ba00b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.547+0000 7f6b9dd9b640 1 -- 172.21.15.42:0/980762500 >> v1:172.21.15.42:6789/0 conn(0x7f6ba0161c80 legacy=0x7f6ba006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.547+0000 7f6b9dd9b640 1 -- 172.21.15.42:0/980762500 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba00d01f0 con 0x7f6ba0162060 2024-09-16T01:54:18.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.548+0000 7f6b9dd9b640 1 --2- 172.21.15.42:0/980762500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba0162060 0x7f6ba00b5f70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6b880097a0 tx=0x7f6b8802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a3695f182855cb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.548+0000 7f6b9d59a640 1 -- 172.21.15.42:0/980762500 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88037070 con 0x7f6ba0162060 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.548+0000 7f6b9d59a640 1 -- 172.21.15.42:0/980762500 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8802aba0 con 0x7f6ba0162060 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.548+0000 7f6b9d59a640 1 -- 172.21.15.42:0/980762500 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98001670 con 0x7f6ba0162060 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.548+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/980762500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba0162060 msgr2=0x7f6ba00b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.548+0000 7f6ba4c4c640 1 --2- 172.21.15.42:0/980762500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba0162060 0x7f6ba00b5f70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6b880097a0 tx=0x7f6b8802a110 comp rx=0 tx=0).stop 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.549+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/980762500 shutdown_connections 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.549+0000 7f6ba4c4c640 1 --2- 172.21.15.42:0/980762500 >> v2:172.21.15.107:3300/0 conn(0x7f6ba00b64b0 0x7f6ba00b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.549+0000 7f6ba4c4c640 1 --2- 172.21.15.42:0/980762500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba0162060 0x7f6ba00b5f70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.549+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/980762500 >> 172.21.15.42:0/980762500 conn(0x7f6ba00d44f0 msgr2=0x7f6ba00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.549+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/980762500 shutdown_connections 2024-09-16T01:54:18.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.549+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/980762500 wait complete. 2024-09-16T01:54:18.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.550+0000 7f6ba4c4c640 1 Processor -- start 2024-09-16T01:54:18.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.550+0000 7f6ba4c4c640 1 -- start start 2024-09-16T01:54:18.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6ba4c4c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba00b64b0 0x7f6ba00b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6ba4c4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ba0161c80 0x7f6ba015fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6ba4c4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba0162060 0x7f6ba0160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6ba4c4c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba00cf1e0 con 0x7f6ba0162060 2024-09-16T01:54:18.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6ba4c4c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba00d2aa0 con 0x7f6ba0161c80 2024-09-16T01:54:18.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6ba4c4c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba00cf360 con 0x7f6ba00b64b0 2024-09-16T01:54:18.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba0162060 0x7f6ba0160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba0162060 0x7f6ba0160310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55600/0 (socket says 172.21.15.42:55600) 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9ed9d640 1 -- 172.21.15.42:0/2214656217 learned_addr learned my addr 172.21.15.42:0/2214656217 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9e59c640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba00b64b0 0x7f6ba00b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9dd9b640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ba0161c80 0x7f6ba015fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9ed9d640 1 -- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba00b64b0 msgr2=0x7f6ba00b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9ed9d640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba00b64b0 0x7f6ba00b88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9ed9d640 1 -- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ba0161c80 msgr2=0x7f6ba015fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9ed9d640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ba0161c80 0x7f6ba015fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9ed9d640 1 -- 172.21.15.42:0/2214656217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba00b93c0 con 0x7f6ba0162060 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9dd9b640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ba0161c80 0x7f6ba015fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:18.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.551+0000 7f6b9ed9d640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba0162060 0x7f6ba0160310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009dd0 tx=0x7f6b9000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:18.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.552+0000 7f6b96ffd640 1 -- 172.21.15.42:0/2214656217 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90018020 con 0x7f6ba0162060 2024-09-16T01:54:18.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.552+0000 7f6b96ffd640 1 -- 172.21.15.42:0/2214656217 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b90014480 con 0x7f6ba0162060 2024-09-16T01:54:18.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.552+0000 7f6b96ffd640 1 -- 172.21.15.42:0/2214656217 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90014870 con 0x7f6ba0162060 2024-09-16T01:54:18.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.552+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/2214656217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba00b96a0 con 0x7f6ba0162060 2024-09-16T01:54:18.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.552+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/2214656217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba00b9c60 con 0x7f6ba0162060 2024-09-16T01:54:18.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.553+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/2214656217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba00b5f70 con 0x7f6ba0162060 2024-09-16T01:54:18.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.553+0000 7f6b96ffd640 1 -- 172.21.15.42:0/2214656217 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6b9001b020 con 0x7f6ba0162060 2024-09-16T01:54:18.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.553+0000 7f6b96ffd640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6b8006c2b0 0x7f6b8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.554+0000 7f6b96ffd640 1 -- 172.21.15.42:0/2214656217 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6b9008bd40 con 0x7f6ba0162060 2024-09-16T01:54:18.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.554+0000 7f6b9e59c640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6b8006c2b0 0x7f6b8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.554+0000 7f6b9e59c640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6b8006c2b0 0x7f6b8006e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6b98005880 tx=0x7f6b98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:18.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.558+0000 7f6b96ffd640 1 -- 172.21.15.42:0/2214656217 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b90022030 con 0x7f6ba0162060 2024-09-16T01:54:18.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.734+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/2214656217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6ba00ba470 con 0x7f6ba0162060 2024-09-16T01:54:18.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.734+0000 7f6b96ffd640 1 -- 172.21.15.42:0/2214656217 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f6b90010040 con 0x7f6ba0162060 2024-09-16T01:54:18.736 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:18.736 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-16T01:54:18.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:54:18.736 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-16T01:54:18.736 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-16T01:54:18.736 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:54:18.736 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-16T01:54:18.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6b8006c2b0 msgr2=0x7f6b8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6b8006c2b0 0x7f6b8006e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6b98005880 tx=0x7f6b98009040 comp rx=0 tx=0).stop 2024-09-16T01:54:18.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/2214656217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba0162060 msgr2=0x7f6ba0160310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba0162060 0x7f6ba0160310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009dd0 tx=0x7f6b9000c490 comp rx=0 tx=0).stop 2024-09-16T01:54:18.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/2214656217 shutdown_connections 2024-09-16T01:54:18.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6b8006c2b0 0x7f6b8006e770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba0162060 0x7f6ba0160310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ba0161c80 0x7f6ba015fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 --2- 172.21.15.42:0/2214656217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6ba00b64b0 0x7f6ba00b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/2214656217 >> 172.21.15.42:0/2214656217 conn(0x7f6ba00d44f0 msgr2=0x7f6ba00746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:18.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/2214656217 shutdown_connections 2024-09-16T01:54:18.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.736+0000 7f6ba4c4c640 1 -- 172.21.15.42:0/2214656217 wait complete. 2024-09-16T01:54:18.748 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:54:18.748 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:54:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.854+0000 7fae0dbb9640 1 Processor -- start 2024-09-16T01:54:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.854+0000 7fae0dbb9640 1 -- start start 2024-09-16T01:54:18.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae0dbb9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fae08162340 0x7fae0806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae0dbb9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fae080cf280 0x7fae08162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae0dbb9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae0815ff70 con 0x7fae08162c60 2024-09-16T01:54:18.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae0dbb9640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fae0806de90 con 0x7fae08162340 2024-09-16T01:54:18.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae0dbb9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fae080d4d10 con 0x7fae080cf280 2024-09-16T01:54:18.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae077fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fae08162340 0x7fae0806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae077fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fae08162340 0x7fae0806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55610/0 (socket says 172.21.15.42:55610) 2024-09-16T01:54:18.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae077fe640 1 -- 172.21.15.42:0/4087588751 learned_addr learned my addr 172.21.15.42:0/4087588751 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:18.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae06ffd640 1 --2- 172.21.15.42:0/4087588751 >> v2:172.21.15.107:3300/0 conn(0x7fae080cf280 0x7fae08162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae077fe640 1 -- 172.21.15.42:0/4087588751 >> v2:172.21.15.107:3300/0 conn(0x7fae080cf280 msgr2=0x7fae08162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:18.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae077fe640 1 --2- 172.21.15.42:0/4087588751 >> v2:172.21.15.107:3300/0 conn(0x7fae080cf280 0x7fae08162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae077fe640 1 -- 172.21.15.42:0/4087588751 >> v1:172.21.15.107:6789/0 conn(0x7fae08162c60 legacy=0x7fae080d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.855+0000 7fae077fe640 1 -- 172.21.15.42:0/4087588751 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae080d4ff0 con 0x7fae08162340 2024-09-16T01:54:18.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.856+0000 7fae077fe640 1 --2- 172.21.15.42:0/4087588751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 0x7fae0806d740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fae080a23d0 tx=0x7fadf802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77dfb6c0215baa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:18.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.856+0000 7fae067fc640 1 -- 172.21.15.42:0/4087588751 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8037070 con 0x7fae08162340 2024-09-16T01:54:18.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.856+0000 7fae067fc640 1 -- 172.21.15.42:0/4087588751 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf8032440 con 0x7fae08162340 2024-09-16T01:54:18.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.856+0000 7fae067fc640 1 -- 172.21.15.42:0/4087588751 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8032810 con 0x7fae08162340 2024-09-16T01:54:18.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.857+0000 7fae0dbb9640 1 -- 172.21.15.42:0/4087588751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 msgr2=0x7fae0806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.857+0000 7fae0dbb9640 1 --2- 172.21.15.42:0/4087588751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 0x7fae0806d740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fae080a23d0 tx=0x7fadf802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.857+0000 7fae0dbb9640 1 -- 172.21.15.42:0/4087588751 shutdown_connections 2024-09-16T01:54:18.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.857+0000 7fae0dbb9640 1 --2- 172.21.15.42:0/4087588751 >> v2:172.21.15.107:3300/0 conn(0x7fae080cf280 0x7fae08162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.857+0000 7fae0dbb9640 1 --2- 172.21.15.42:0/4087588751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 0x7fae0806d740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.857+0000 7fae0dbb9640 1 -- 172.21.15.42:0/4087588751 >> 172.21.15.42:0/4087588751 conn(0x7fae0808bfc0 msgr2=0x7fae080d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:18.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.857+0000 7fae0dbb9640 1 -- 172.21.15.42:0/4087588751 shutdown_connections 2024-09-16T01:54:18.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.857+0000 7fae0dbb9640 1 -- 172.21.15.42:0/4087588751 wait complete. 2024-09-16T01:54:18.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.858+0000 7fae0dbb9640 1 Processor -- start 2024-09-16T01:54:18.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.858+0000 7fae0dbb9640 1 -- start start 2024-09-16T01:54:18.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae0dbb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae080cf280 0x7fae08157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae0dbb9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 0x7fae080b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae0dbb9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae08162c60 0x7fae080b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae0dbb9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fae080cf6c0 con 0x7fae08162340 2024-09-16T01:54:18.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae0dbb9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae080d52d0 con 0x7fae080cf280 2024-09-16T01:54:18.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae0dbb9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fae081630d0 con 0x7fae08162c60 2024-09-16T01:54:18.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae06ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 0x7fae080b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae06ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 0x7fae080b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55612/0 (socket says 172.21.15.42:55612) 2024-09-16T01:54:18.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae06ffd640 1 -- 172.21.15.42:0/1956166891 learned_addr learned my addr 172.21.15.42:0/1956166891 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:18.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae07fff640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae08162c60 0x7fae080b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae077fe640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae080cf280 0x7fae08157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae06ffd640 1 -- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae08162c60 msgr2=0x7fae080b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae06ffd640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae08162c60 0x7fae080b7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae06ffd640 1 -- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae080cf280 msgr2=0x7fae08157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:18.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae06ffd640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae080cf280 0x7fae08157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:18.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae06ffd640 1 -- 172.21.15.42:0/1956166891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae080ce1d0 con 0x7fae08162340 2024-09-16T01:54:18.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fae06ffd640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 0x7fae080b7300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00e9e0 tx=0x7fadfc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:18.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fadeffff640 1 -- 172.21.15.42:0/1956166891 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc017070 con 0x7fae08162340 2024-09-16T01:54:18.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fadeffff640 1 -- 172.21.15.42:0/1956166891 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadfc00c9d0 con 0x7fae08162340 2024-09-16T01:54:18.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.859+0000 7fadeffff640 1 -- 172.21.15.42:0/1956166891 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00cda0 con 0x7fae08162340 2024-09-16T01:54:18.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.860+0000 7fae0dbb9640 1 -- 172.21.15.42:0/1956166891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae080b8610 con 0x7fae08162340 2024-09-16T01:54:18.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.860+0000 7fae0dbb9640 1 -- 172.21.15.42:0/1956166891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae080b9570 con 0x7fae08162340 2024-09-16T01:54:18.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.861+0000 7fae0dbb9640 1 -- 172.21.15.42:0/1956166891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae080b12a0 con 0x7fae08162340 2024-09-16T01:54:18.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.861+0000 7fadeffff640 1 -- 172.21.15.42:0/1956166891 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fadfc01a070 con 0x7fae08162340 2024-09-16T01:54:18.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.861+0000 7fadeffff640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fadf406c2e0 0x7fadf406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:18.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.862+0000 7fadeffff640 1 -- 172.21.15.42:0/1956166891 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fadfc08b410 con 0x7fae08162340 2024-09-16T01:54:18.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.862+0000 7fae077fe640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fadf406c2e0 0x7fadf406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:18.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.862+0000 7fae077fe640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fadf406c2e0 0x7fadf406e7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fadf8034000 tx=0x7fadf802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:18.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:18.866+0000 7fadeffff640 1 -- 172.21.15.42:0/1956166891 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae080b12a0 con 0x7fae08162340 2024-09-16T01:54:19.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.042+0000 7fae0dbb9640 1 -- 172.21.15.42:0/1956166891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fae0808e640 con 0x7fae08162340 2024-09-16T01:54:19.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.829+0000 7fadeffff640 1 -- 172.21.15.42:0/1956166891 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fae080ce1d0 con 0x7fae08162340 2024-09-16T01:54:19.830 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-16T01:54:19.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.832+0000 7fae0dbb9640 1 -- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fadf406c2e0 msgr2=0x7fadf406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:19.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.832+0000 7fae0dbb9640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fadf406c2e0 0x7fadf406e7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fadf8034000 tx=0x7fadf802e000 comp rx=0 tx=0).stop 2024-09-16T01:54:19.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.832+0000 7fae0dbb9640 1 -- 172.21.15.42:0/1956166891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 msgr2=0x7fae080b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:19.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.832+0000 7fae0dbb9640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 0x7fae080b7300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00e9e0 tx=0x7fadfc00eea0 comp rx=0 tx=0).stop 2024-09-16T01:54:19.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.833+0000 7fae0dbb9640 1 -- 172.21.15.42:0/1956166891 shutdown_connections 2024-09-16T01:54:19.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.833+0000 7fae0dbb9640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fadf406c2e0 0x7fadf406e7a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:19.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.833+0000 7fae0dbb9640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae08162c60 0x7fae080b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:19.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.833+0000 7fae0dbb9640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae08162340 0x7fae080b7300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:19.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.833+0000 7fae0dbb9640 1 --2- 172.21.15.42:0/1956166891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae080cf280 0x7fae08157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:19.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.833+0000 7fae0dbb9640 1 -- 172.21.15.42:0/1956166891 >> 172.21.15.42:0/1956166891 conn(0x7fae0808bfc0 msgr2=0x7fae080d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:19.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.833+0000 7fae0dbb9640 1 -- 172.21.15.42:0/1956166891 shutdown_connections 2024-09-16T01:54:19.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.833+0000 7fae0dbb9640 1 -- 172.21.15.42:0/1956166891 wait complete. 2024-09-16T01:54:19.851 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-16T01:54:19.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.965+0000 7f400e02e640 1 Processor -- start 2024-09-16T01:54:19.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.965+0000 7f400e02e640 1 -- start start 2024-09-16T01:54:19.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f400e02e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 0x7f4008162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:19.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f400e02e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f40080d4c10 0x7f40080b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:19.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f400e02e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40080d2600 con 0x7f40080d3320 2024-09-16T01:54:19.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f400e02e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f40080d5420 con 0x7f40080d4c10 2024-09-16T01:54:19.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f400e02e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f40080d2e90 con 0x7f40080b5f80 2024-09-16T01:54:19.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f4006ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f40080d4c10 0x7f40080b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:19.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f4007fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f40080d3320 0x7f40080ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34576/0 (socket says 172.21.15.42:34576) 2024-09-16T01:54:19.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f4007fff640 1 -- 172.21.15.42:0/182700780 learned_addr learned my addr 172.21.15.42:0/182700780 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:19.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f40077fe640 1 --2- 172.21.15.42:0/182700780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 0x7f4008162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:19.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f4006ffd640 1 -- 172.21.15.42:0/182700780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 msgr2=0x7f4008162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:19.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f4006ffd640 1 --2- 172.21.15.42:0/182700780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 0x7f4008162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:19.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f4006ffd640 1 -- 172.21.15.42:0/182700780 >> v1:172.21.15.42:6789/0 conn(0x7f40080d3320 legacy=0x7f40080ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:19.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f4006ffd640 1 -- 172.21.15.42:0/182700780 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40080b3c10 con 0x7f40080d4c10 2024-09-16T01:54:19.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.966+0000 7f40067fc640 1 -- 172.21.15.42:0/182700780 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194594473 0 0) 0x7f4000001490 con 0x7f40080d3320 2024-09-16T01:54:19.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.967+0000 7f4006ffd640 1 --2- 172.21.15.42:0/182700780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d4c10 0x7f40080b6360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0097a0 tx=0x7f3ffc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fceb02c561f758 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:19.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.967+0000 7f40067fc640 1 -- 172.21.15.42:0/182700780 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc037070 con 0x7f40080d4c10 2024-09-16T01:54:19.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.967+0000 7f40067fc640 1 -- 172.21.15.42:0/182700780 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ffc032440 con 0x7f40080d4c10 2024-09-16T01:54:19.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.967+0000 7f40067fc640 1 -- 172.21.15.42:0/182700780 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc032810 con 0x7f40080d4c10 2024-09-16T01:54:19.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.968+0000 7f400e02e640 1 -- 172.21.15.42:0/182700780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d4c10 msgr2=0x7f40080b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:19.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.968+0000 7f400e02e640 1 --2- 172.21.15.42:0/182700780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d4c10 0x7f40080b6360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0097a0 tx=0x7f3ffc02a180 comp rx=0 tx=0).stop 2024-09-16T01:54:19.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.968+0000 7f400e02e640 1 -- 172.21.15.42:0/182700780 shutdown_connections 2024-09-16T01:54:19.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.968+0000 7f400e02e640 1 --2- 172.21.15.42:0/182700780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d4c10 0x7f40080b6360 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:19.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.968+0000 7f400e02e640 1 --2- 172.21.15.42:0/182700780 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 0x7f4008162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:19.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.968+0000 7f400e02e640 1 -- 172.21.15.42:0/182700780 >> 172.21.15.42:0/182700780 conn(0x7f400808bfc0 msgr2=0x7f40080d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:19.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.968+0000 7f400e02e640 1 -- 172.21.15.42:0/182700780 shutdown_connections 2024-09-16T01:54:19.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.968+0000 7f400e02e640 1 -- 172.21.15.42:0/182700780 wait complete. 2024-09-16T01:54:19.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.969+0000 7f400e02e640 1 Processor -- start 2024-09-16T01:54:19.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.969+0000 7f400e02e640 1 -- start start 2024-09-16T01:54:19.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f400e02e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 0x7f40081f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:19.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f400e02e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d3320 0x7f40080b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:19.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f400e02e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40080d4c10 0x7f400815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f400e02e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40080d5140 con 0x7f40080d3320 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f400e02e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f40080d2880 con 0x7f40080d4c10 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f400e02e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f40080d2b20 con 0x7f40080b5f80 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f4006ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d3320 0x7f40080b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f4006ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d3320 0x7f40080b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55620/0 (socket says 172.21.15.42:55620) 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f4006ffd640 1 -- 172.21.15.42:0/2089950171 learned_addr learned my addr 172.21.15.42:0/2089950171 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f40077fe640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 0x7f40081f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f4007fff640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40080d4c10 0x7f400815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f4006ffd640 1 -- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 msgr2=0x7f40081f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f4006ffd640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 0x7f40081f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f4006ffd640 1 -- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40080d4c10 msgr2=0x7f400815b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:19.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f4006ffd640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40080d4c10 0x7f400815b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:19.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f4006ffd640 1 -- 172.21.15.42:0/2089950171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40080b3470 con 0x7f40080d3320 2024-09-16T01:54:19.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f40077fe640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 0x7f40081f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:19.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.970+0000 7f4006ffd640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d3320 0x7f40080b1b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc035040 tx=0x7f3ffc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:19.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.971+0000 7f3feffff640 1 -- 172.21.15.42:0/2089950171 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc042020 con 0x7f40080d3320 2024-09-16T01:54:19.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.971+0000 7f3feffff640 1 -- 172.21.15.42:0/2089950171 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ffc030700 con 0x7f40080d3320 2024-09-16T01:54:19.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.971+0000 7f400e02e640 1 -- 172.21.15.42:0/2089950171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40080b7580 con 0x7f40080d3320 2024-09-16T01:54:19.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.971+0000 7f3feffff640 1 -- 172.21.15.42:0/2089950171 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc037040 con 0x7f40080d3320 2024-09-16T01:54:19.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.971+0000 7f400e02e640 1 -- 172.21.15.42:0/2089950171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40080b20a0 con 0x7f40080d3320 2024-09-16T01:54:19.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.972+0000 7f400e02e640 1 -- 172.21.15.42:0/2089950171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40080b6360 con 0x7f40080d3320 2024-09-16T01:54:19.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.972+0000 7f3feffff640 1 -- 172.21.15.42:0/2089950171 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3ffc045020 con 0x7f40080d3320 2024-09-16T01:54:19.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.973+0000 7f3feffff640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3ff406c2e0 0x7f3ff406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:19.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.973+0000 7f3feffff640 1 -- 172.21.15.42:0/2089950171 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f3ffc0abd50 con 0x7f40080d3320 2024-09-16T01:54:19.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.973+0000 7f40077fe640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3ff406c2e0 0x7f3ff406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:19.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.974+0000 7f40077fe640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3ff406c2e0 0x7f3ff406e7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009b90 tx=0x7f3ff8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:19.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:19.978+0000 7f3feffff640 1 -- 172.21.15.42:0/2089950171 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ffc0af030 con 0x7f40080d3320 2024-09-16T01:54:20.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.155+0000 7f400e02e640 1 -- 172.21.15.42:0/2089950171 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f40080c7bb0 con 0x7f40080d3320 2024-09-16T01:54:20.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.834+0000 7f3feffff640 1 -- 172.21.15.42:0/2089950171 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f3ffc04c030 con 0x7f40080d3320 2024-09-16T01:54:20.836 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-16T01:54:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.837+0000 7f400e02e640 1 -- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3ff406c2e0 msgr2=0x7f3ff406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.837+0000 7f400e02e640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3ff406c2e0 0x7f3ff406e7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009b90 tx=0x7f3ff8008040 comp rx=0 tx=0).stop 2024-09-16T01:54:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.837+0000 7f400e02e640 1 -- 172.21.15.42:0/2089950171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d3320 msgr2=0x7f40080b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.837+0000 7f400e02e640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d3320 0x7f40080b1b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc035040 tx=0x7f3ffc0046c0 comp rx=0 tx=0).stop 2024-09-16T01:54:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.838+0000 7f400e02e640 1 -- 172.21.15.42:0/2089950171 shutdown_connections 2024-09-16T01:54:20.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.838+0000 7f400e02e640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3ff406c2e0 0x7f3ff406e7a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:20.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.838+0000 7f400e02e640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40080d4c10 0x7f400815b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:20.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.838+0000 7f400e02e640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40080d3320 0x7f40080b1b60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:20.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.838+0000 7f400e02e640 1 --2- 172.21.15.42:0/2089950171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40080b5f80 0x7f40081f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:20.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.838+0000 7f400e02e640 1 -- 172.21.15.42:0/2089950171 >> 172.21.15.42:0/2089950171 conn(0x7f400808bfc0 msgr2=0x7f40080d3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:20.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.838+0000 7f400e02e640 1 -- 172.21.15.42:0/2089950171 shutdown_connections 2024-09-16T01:54:20.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.838+0000 7f400e02e640 1 -- 172.21.15.42:0/2089950171 wait complete. 2024-09-16T01:54:20.863 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:54:20.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.972+0000 7fd91de1e640 1 Processor -- start 2024-09-16T01:54:20.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.972+0000 7fd91de1e640 1 -- start start 2024-09-16T01:54:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.973+0000 7fd91de1e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd918162340 0x7fd91806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.973+0000 7fd91de1e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd91815ff70 con 0x7fd918162e30 2024-09-16T01:54:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.973+0000 7fd91de1e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9180d4d10 con 0x7fd9180cf280 2024-09-16T01:54:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.973+0000 7fd91de1e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd9181632a0 con 0x7fd918162340 2024-09-16T01:54:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.973+0000 7fd9177fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd918162340 0x7fd91806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.973+0000 7fd917fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd918162e30 0x7fd9180d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34592/0 (socket says 172.21.15.42:34592) 2024-09-16T01:54:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.973+0000 7fd917fff640 1 -- 172.21.15.42:0/1579459608 learned_addr learned my addr 172.21.15.42:0/1579459608 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.973+0000 7fd9177fe640 1 -- 172.21.15.42:0/1579459608 >> v1:172.21.15.107:6789/0 conn(0x7fd9180cf280 legacy=0x7fd918162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.973+0000 7fd9177fe640 1 -- 172.21.15.42:0/1579459608 >> v1:172.21.15.42:6789/0 conn(0x7fd918162e30 legacy=0x7fd9180d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:20.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.973+0000 7fd9177fe640 1 -- 172.21.15.42:0/1579459608 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9180d4ff0 con 0x7fd918162340 2024-09-16T01:54:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.974+0000 7fd9177fe640 1 --2- 172.21.15.42:0/1579459608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 0x7fd91806d740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097a0 tx=0x7fd90802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8498da4f8be81d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.974+0000 7fd9167fc640 1 -- 172.21.15.42:0/1579459608 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908037070 con 0x7fd918162340 2024-09-16T01:54:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.974+0000 7fd9167fc640 1 -- 172.21.15.42:0/1579459608 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90802ae50 con 0x7fd918162340 2024-09-16T01:54:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.974+0000 7fd9167fc640 1 -- 172.21.15.42:0/1579459608 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908032660 con 0x7fd918162340 2024-09-16T01:54:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.975+0000 7fd91de1e640 1 -- 172.21.15.42:0/1579459608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 msgr2=0x7fd91806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.975+0000 7fd91de1e640 1 --2- 172.21.15.42:0/1579459608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 0x7fd91806d740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097a0 tx=0x7fd90802a140 comp rx=0 tx=0).stop 2024-09-16T01:54:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.975+0000 7fd91de1e640 1 -- 172.21.15.42:0/1579459608 shutdown_connections 2024-09-16T01:54:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.975+0000 7fd91de1e640 1 --2- 172.21.15.42:0/1579459608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 0x7fd91806d740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.975+0000 7fd91de1e640 1 -- 172.21.15.42:0/1579459608 >> 172.21.15.42:0/1579459608 conn(0x7fd91808bfc0 msgr2=0x7fd9180d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:20.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.975+0000 7fd91de1e640 1 -- 172.21.15.42:0/1579459608 shutdown_connections 2024-09-16T01:54:20.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.975+0000 7fd91de1e640 1 -- 172.21.15.42:0/1579459608 wait complete. 2024-09-16T01:54:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.976+0000 7fd91de1e640 1 Processor -- start 2024-09-16T01:54:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.976+0000 7fd91de1e640 1 -- start start 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd91de1e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9180cf280 0x7fd918159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd91de1e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 0x7fd91815c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd91de1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd918162e30 0x7fd9180b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd91de1e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd9180d52d0 con 0x7fd918162340 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd91de1e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd91806de90 con 0x7fd918162e30 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd91de1e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9180cf6c0 con 0x7fd9180cf280 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd916ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 0x7fd91815c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd916ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 0x7fd91815c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55628/0 (socket says 172.21.15.42:55628) 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd916ffd640 1 -- 172.21.15.42:0/1042968891 learned_addr learned my addr 172.21.15.42:0/1042968891 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd917fff640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd918162e30 0x7fd9180b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd9177fe640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9180cf280 0x7fd918159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd916ffd640 1 -- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9180cf280 msgr2=0x7fd918159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd916ffd640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9180cf280 0x7fd918159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd916ffd640 1 -- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd918162e30 msgr2=0x7fd9180b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.977+0000 7fd916ffd640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd918162e30 0x7fd9180b16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.978+0000 7fd916ffd640 1 -- 172.21.15.42:0/1042968891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91815c6d0 con 0x7fd918162340 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.978+0000 7fd916ffd640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 0x7fd91815c190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c450 tx=0x7fd90c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.978+0000 7fd8fffff640 1 -- 172.21.15.42:0/1042968891 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c016020 con 0x7fd918162340 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.978+0000 7fd8fffff640 1 -- 172.21.15.42:0/1042968891 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c012830 con 0x7fd918162340 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.978+0000 7fd91de1e640 1 -- 172.21.15.42:0/1042968891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91815c970 con 0x7fd918162340 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.978+0000 7fd8fffff640 1 -- 172.21.15.42:0/1042968891 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c012c20 con 0x7fd918162340 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.978+0000 7fd91de1e640 1 -- 172.21.15.42:0/1042968891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd91815cf30 con 0x7fd918162340 2024-09-16T01:54:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.979+0000 7fd91de1e640 1 -- 172.21.15.42:0/1042968891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd91806d740 con 0x7fd918162340 2024-09-16T01:54:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.980+0000 7fd8fffff640 1 -- 172.21.15.42:0/1042968891 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd90c019020 con 0x7fd918162340 2024-09-16T01:54:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.980+0000 7fd8fffff640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd90406c2b0 0x7fd90406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.980+0000 7fd8fffff640 1 -- 172.21.15.42:0/1042968891 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fd90c08b130 con 0x7fd918162340 2024-09-16T01:54:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.980+0000 7fd9177fe640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd90406c2b0 0x7fd90406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.981+0000 7fd9177fe640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd90406c2b0 0x7fd90406e770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd908034000 tx=0x7fd90802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:20.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:20.985+0000 7fd8fffff640 1 -- 172.21.15.42:0/1042968891 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd90c059990 con 0x7fd918162340 2024-09-16T01:54:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.195+0000 7fd91de1e640 1 -- 172.21.15.42:0/1042968891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd91808e640 con 0x7fd918162340 2024-09-16T01:54:21.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.835+0000 7fd8fffff640 1 -- 172.21.15.42:0/1042968891 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd90c059290 con 0x7fd918162340 2024-09-16T01:54:21.837 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 2 and data pool 3 2024-09-16T01:54:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.839+0000 7fd91de1e640 1 -- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd90406c2b0 msgr2=0x7fd90406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.839+0000 7fd91de1e640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd90406c2b0 0x7fd90406e770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd908034000 tx=0x7fd90802e000 comp rx=0 tx=0).stop 2024-09-16T01:54:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.839+0000 7fd91de1e640 1 -- 172.21.15.42:0/1042968891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 msgr2=0x7fd91815c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.839+0000 7fd91de1e640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 0x7fd91815c190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c450 tx=0x7fd90c00c910 comp rx=0 tx=0).stop 2024-09-16T01:54:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.840+0000 7fd91de1e640 1 -- 172.21.15.42:0/1042968891 shutdown_connections 2024-09-16T01:54:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.840+0000 7fd91de1e640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd90406c2b0 0x7fd90406e770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.840+0000 7fd91de1e640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd918162e30 0x7fd9180b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.840+0000 7fd91de1e640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd918162340 0x7fd91815c190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.840+0000 7fd91de1e640 1 --2- 172.21.15.42:0/1042968891 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9180cf280 0x7fd918159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.840+0000 7fd91de1e640 1 -- 172.21.15.42:0/1042968891 >> 172.21.15.42:0/1042968891 conn(0x7fd91808bfc0 msgr2=0x7fd91806e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.840+0000 7fd91de1e640 1 -- 172.21.15.42:0/1042968891 shutdown_connections 2024-09-16T01:54:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.840+0000 7fd91de1e640 1 -- 172.21.15.42:0/1042968891 wait complete. 2024-09-16T01:54:21.867 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-16T01:54:21.867 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-16T01:54:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.979+0000 7fe5d76a5640 1 Processor -- start 2024-09-16T01:54:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.979+0000 7fe5d76a5640 1 -- start start 2024-09-16T01:54:21.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.980+0000 7fe5d76a5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162e30 0x7fe5d006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:21.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.980+0000 7fe5d76a5640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d015ff70 con 0x7fe5d0162340 2024-09-16T01:54:21.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.980+0000 7fe5d76a5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d00d4d10 con 0x7fe5d00cf280 2024-09-16T01:54:21.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.980+0000 7fe5d76a5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d006de90 con 0x7fe5d0162e30 2024-09-16T01:54:21.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.980+0000 7fe5d5441640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe5d0162340 0x7fe5d0162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34604/0 (socket says 172.21.15.42:34604) 2024-09-16T01:54:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.980+0000 7fe5d5441640 1 -- 172.21.15.42:0/3860014747 learned_addr learned my addr 172.21.15.42:0/3860014747 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.980+0000 7fe5d4c40640 1 --2- 172.21.15.42:0/3860014747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162e30 0x7fe5d006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.980+0000 7fe5cffff640 1 -- 172.21.15.42:0/3860014747 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198534829 0 0) 0x7fe5d015ff70 con 0x7fe5d0162340 2024-09-16T01:54:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.980+0000 7fe5cffff640 1 -- 172.21.15.42:0/3860014747 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5b8003520 con 0x7fe5d0162340 2024-09-16T01:54:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.981+0000 7fe5cffff640 1 -- 172.21.15.42:0/3860014747 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638667971 0 0) 0x7fe5d00d4d10 con 0x7fe5d00cf280 2024-09-16T01:54:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.981+0000 7fe5cffff640 1 -- 172.21.15.42:0/3860014747 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5d015ff70 con 0x7fe5d00cf280 2024-09-16T01:54:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.981+0000 7fe5d4c40640 1 -- 172.21.15.42:0/3860014747 >> v1:172.21.15.107:6789/0 conn(0x7fe5d00cf280 legacy=0x7fe5d00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.981+0000 7fe5d4c40640 1 -- 172.21.15.42:0/3860014747 >> v1:172.21.15.42:6789/0 conn(0x7fe5d0162340 legacy=0x7fe5d0162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.981+0000 7fe5cffff640 1 -- 172.21.15.42:0/3860014747 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 826119780 0 0) 0x7fe5b8003520 con 0x7fe5d0162340 2024-09-16T01:54:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.981+0000 7fe5d4c40640 1 -- 172.21.15.42:0/3860014747 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d00d4ff0 con 0x7fe5d0162e30 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.981+0000 7fe5d4c40640 1 --2- 172.21.15.42:0/3860014747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162e30 0x7fe5d006d740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40097c0 tx=0x7fe5c402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fb437b2c29a0b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.982+0000 7fe5cffff640 1 -- 172.21.15.42:0/3860014747 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4037070 con 0x7fe5d0162e30 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.982+0000 7fe5cffff640 1 -- 172.21.15.42:0/3860014747 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c402ab90 con 0x7fe5d0162e30 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.982+0000 7fe5cffff640 1 -- 172.21.15.42:0/3860014747 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00019f0 con 0x7fe5d0162e30 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.982+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3860014747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162e30 msgr2=0x7fe5d006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.982+0000 7fe5d76a5640 1 --2- 172.21.15.42:0/3860014747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162e30 0x7fe5d006d740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40097c0 tx=0x7fe5c402a100 comp rx=0 tx=0).stop 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.982+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3860014747 shutdown_connections 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.982+0000 7fe5d76a5640 1 --2- 172.21.15.42:0/3860014747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162e30 0x7fe5d006d740 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.982+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3860014747 >> 172.21.15.42:0/3860014747 conn(0x7fe5d008bfc0 msgr2=0x7fe5d00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.982+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3860014747 shutdown_connections 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.982+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3860014747 wait complete. 2024-09-16T01:54:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.983+0000 7fe5d76a5640 1 Processor -- start 2024-09-16T01:54:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d76a5640 1 -- start start 2024-09-16T01:54:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d76a5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5d00cf280 0x7fe5d00b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d76a5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162340 0x7fe5d014e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d76a5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d0162e30 0x7fe5d00cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d76a5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d00cf710 con 0x7fe5d00cf280 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d76a5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d0163270 con 0x7fe5d0162e30 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d76a5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d00d52d0 con 0x7fe5d0162340 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d5441640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5d00cf280 0x7fe5d00b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d5441640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5d00cf280 0x7fe5d00b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55632/0 (socket says 172.21.15.42:55632) 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d5441640 1 -- 172.21.15.42:0/3587762256 learned_addr learned my addr 172.21.15.42:0/3587762256 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d5c42640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d0162e30 0x7fe5d00cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.984+0000 7fe5d4c40640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162340 0x7fe5d014e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5d5441640 1 -- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162340 msgr2=0x7fe5d014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5d5441640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162340 0x7fe5d014e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:21.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5d5441640 1 -- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d0162e30 msgr2=0x7fe5d00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5d5441640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d0162e30 0x7fe5d00cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5d5441640 1 -- 172.21.15.42:0/3587762256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d00b4de0 con 0x7fe5d00cf280 2024-09-16T01:54:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5d5c42640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d0162e30 0x7fe5d00cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5d5441640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5d00cf280 0x7fe5d00b48a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0001f80 tx=0x7fe5c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5cdffb640 1 -- 172.21.15.42:0/3587762256 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0017070 con 0x7fe5d00cf280 2024-09-16T01:54:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5cdffb640 1 -- 172.21.15.42:0/3587762256 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c0012400 con 0x7fe5d00cf280 2024-09-16T01:54:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3587762256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d014ee50 con 0x7fe5d00cf280 2024-09-16T01:54:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5cdffb640 1 -- 172.21.15.42:0/3587762256 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00127f0 con 0x7fe5d00cf280 2024-09-16T01:54:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.985+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3587762256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d00cca00 con 0x7fe5d00cf280 2024-09-16T01:54:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.986+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3587762256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d006d740 con 0x7fe5d00cf280 2024-09-16T01:54:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.987+0000 7fe5cdffb640 1 -- 172.21.15.42:0/3587762256 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe5c001a070 con 0x7fe5d00cf280 2024-09-16T01:54:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.987+0000 7fe5cdffb640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe5bc06c2b0 0x7fe5bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.987+0000 7fe5cdffb640 1 -- 172.21.15.42:0/3587762256 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe5c008b4a0 con 0x7fe5d00cf280 2024-09-16T01:54:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.987+0000 7fe5d4c40640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe5bc06c2b0 0x7fe5bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.988+0000 7fe5d4c40640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe5bc06c2b0 0x7fe5bc06e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4034000 tx=0x7fe5c402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:21.991+0000 7fe5cdffb640 1 -- 172.21.15.42:0/3587762256 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5d014ee50 con 0x7fe5d00cf280 2024-09-16T01:54:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.175+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3587762256 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fe5d00ba450 con 0x7fe5d00cf280 2024-09-16T01:54:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.848+0000 7fe5cdffb640 1 -- 172.21.15.42:0/3587762256 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fe5d00b4de0 con 0x7fe5d00cf280 2024-09-16T01:54:22.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.852+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe5bc06c2b0 msgr2=0x7fe5bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:22.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.852+0000 7fe5d76a5640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe5bc06c2b0 0x7fe5bc06e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4034000 tx=0x7fe5c402e000 comp rx=0 tx=0).stop 2024-09-16T01:54:22.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.852+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3587762256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5d00cf280 msgr2=0x7fe5d00b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:22.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.852+0000 7fe5d76a5640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5d00cf280 0x7fe5d00b48a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0001f80 tx=0x7fe5c000a430 comp rx=0 tx=0).stop 2024-09-16T01:54:22.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.852+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3587762256 shutdown_connections 2024-09-16T01:54:22.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.852+0000 7fe5d76a5640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe5bc06c2b0 0x7fe5bc06e770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:22.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.852+0000 7fe5d76a5640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d0162e30 0x7fe5d00cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:22.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.852+0000 7fe5d76a5640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5d0162340 0x7fe5d014e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:22.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.852+0000 7fe5d76a5640 1 --2- 172.21.15.42:0/3587762256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5d00cf280 0x7fe5d00b48a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:22.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.852+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3587762256 >> 172.21.15.42:0/3587762256 conn(0x7fe5d008bfc0 msgr2=0x7fe5d006e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:22.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.853+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3587762256 shutdown_connections 2024-09-16T01:54:22.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.853+0000 7fe5d76a5640 1 -- 172.21.15.42:0/3587762256 wait complete. 2024-09-16T01:54:22.867 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:54:22.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.982+0000 7fba6c074640 1 Processor -- start 2024-09-16T01:54:22.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.982+0000 7fba6c074640 1 -- start start 2024-09-16T01:54:22.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.983+0000 7fba6c074640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162340 0x7fba6406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:22.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.983+0000 7fba6c074640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fba64162e30 0x7fba640d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:22.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.983+0000 7fba6c074640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba6415ff70 con 0x7fba640cf280 2024-09-16T01:54:22.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.983+0000 7fba6c074640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fba6406de90 con 0x7fba64162e30 2024-09-16T01:54:22.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.983+0000 7fba6c074640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fba640d4d10 con 0x7fba64162340 2024-09-16T01:54:22.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.983+0000 7fba6a611640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fba64162e30 0x7fba640d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:22.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.983+0000 7fba6960f640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fba640cf280 0x7fba64162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34608/0 (socket says 172.21.15.42:34608) 2024-09-16T01:54:22.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.983+0000 7fba6960f640 1 -- 172.21.15.42:0/3722243788 learned_addr learned my addr 172.21.15.42:0/3722243788 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:22.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.983+0000 7fba69e10640 1 --2- 172.21.15.42:0/3722243788 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162340 0x7fba6406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:22.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.984+0000 7fba6a611640 1 -- 172.21.15.42:0/3722243788 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162340 msgr2=0x7fba6406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:22.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.984+0000 7fba6a611640 1 --2- 172.21.15.42:0/3722243788 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162340 0x7fba6406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:22.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.984+0000 7fba6a611640 1 -- 172.21.15.42:0/3722243788 >> v1:172.21.15.42:6789/0 conn(0x7fba640cf280 legacy=0x7fba64162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:22.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.984+0000 7fba68e0e640 1 -- 172.21.15.42:0/3722243788 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561331156 0 0) 0x7fba6415ff70 con 0x7fba640cf280 2024-09-16T01:54:22.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.984+0000 7fba6a611640 1 -- 172.21.15.42:0/3722243788 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba640d4ff0 con 0x7fba64162e30 2024-09-16T01:54:22.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.984+0000 7fba6a611640 1 --2- 172.21.15.42:0/3722243788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162e30 0x7fba640d2990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009d90 tx=0x7fba5c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e05fe077ed5b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba68e0e640 1 -- 172.21.15.42:0/3722243788 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c031600 con 0x7fba64162e30 2024-09-16T01:54:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba68e0e640 1 -- 172.21.15.42:0/3722243788 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5c0317a0 con 0x7fba64162e30 2024-09-16T01:54:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba68e0e640 1 -- 172.21.15.42:0/3722243788 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c031b70 con 0x7fba64162e30 2024-09-16T01:54:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba6c074640 1 -- 172.21.15.42:0/3722243788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162e30 msgr2=0x7fba640d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba6c074640 1 --2- 172.21.15.42:0/3722243788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162e30 0x7fba640d2990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009d90 tx=0x7fba5c02a5d0 comp rx=0 tx=0).stop 2024-09-16T01:54:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba6c074640 1 -- 172.21.15.42:0/3722243788 shutdown_connections 2024-09-16T01:54:22.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba6c074640 1 --2- 172.21.15.42:0/3722243788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162e30 0x7fba640d2990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:22.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba6c074640 1 --2- 172.21.15.42:0/3722243788 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162340 0x7fba6406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:22.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba6c074640 1 -- 172.21.15.42:0/3722243788 >> 172.21.15.42:0/3722243788 conn(0x7fba6408bfc0 msgr2=0x7fba640d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:22.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba6c074640 1 -- 172.21.15.42:0/3722243788 shutdown_connections 2024-09-16T01:54:22.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.985+0000 7fba6c074640 1 -- 172.21.15.42:0/3722243788 wait complete. 2024-09-16T01:54:22.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.986+0000 7fba6c074640 1 Processor -- start 2024-09-16T01:54:22.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.986+0000 7fba6c074640 1 -- start start 2024-09-16T01:54:22.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.987+0000 7fba6c074640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba640cf280 0x7fba640cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.987+0000 7fba6c074640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162340 0x7fba640b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.987+0000 7fba6c074640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162e30 0x7fba640b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.987+0000 7fba6c074640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fba640cf6c0 con 0x7fba64162340 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.987+0000 7fba6c074640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fba640d52d0 con 0x7fba640cf280 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.987+0000 7fba6c074640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fba640d2ed0 con 0x7fba64162e30 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.987+0000 7fba6960f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162340 0x7fba640b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.987+0000 7fba6960f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162340 0x7fba640b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55658/0 (socket says 172.21.15.42:55658) 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.987+0000 7fba6960f640 1 -- 172.21.15.42:0/3501506029 learned_addr learned my addr 172.21.15.42:0/3501506029 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba6a611640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162e30 0x7fba640b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba69e10640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba640cf280 0x7fba640cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba6960f640 1 -- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162e30 msgr2=0x7fba640b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:22.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba6960f640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162e30 0x7fba640b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba6960f640 1 -- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba640cf280 msgr2=0x7fba640cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba6960f640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba640cf280 0x7fba640cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba6960f640 1 -- 172.21.15.42:0/3501506029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba640b65a0 con 0x7fba64162340 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba69e10640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba640cf280 0x7fba640cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba6a611640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162e30 0x7fba640b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba6960f640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162340 0x7fba640b5290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fba5400c760 tx=0x7fba5400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba5a7fc640 1 -- 172.21.15.42:0/3501506029 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54007270 con 0x7fba64162340 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba5a7fc640 1 -- 172.21.15.42:0/3501506029 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba54007410 con 0x7fba64162340 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba5a7fc640 1 -- 172.21.15.42:0/3501506029 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54001d00 con 0x7fba64162340 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba6c074640 1 -- 172.21.15.42:0/3501506029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba640cbc80 con 0x7fba64162340 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.988+0000 7fba6c074640 1 -- 172.21.15.42:0/3501506029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba640cc240 con 0x7fba64162340 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.989+0000 7fba6c074640 1 -- 172.21.15.42:0/3501506029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba640d2990 con 0x7fba64162340 2024-09-16T01:54:22.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.990+0000 7fba5a7fc640 1 -- 172.21.15.42:0/3501506029 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fba540057a0 con 0x7fba64162340 2024-09-16T01:54:22.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.990+0000 7fba5a7fc640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba4806c2e0 0x7fba4806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:22.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.990+0000 7fba5a7fc640 1 -- 172.21.15.42:0/3501506029 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fba5408b1f0 con 0x7fba64162340 2024-09-16T01:54:22.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.990+0000 7fba69e10640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba4806c2e0 0x7fba4806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:22.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.991+0000 7fba69e10640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba4806c2e0 0x7fba4806e7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba60006fd0 tx=0x7fba60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:22.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:22.994+0000 7fba5a7fc640 1 -- 172.21.15.42:0/3501506029 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba640b65a0 con 0x7fba64162340 2024-09-16T01:54:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:23.171+0000 7fba6c074640 1 -- 172.21.15.42:0/3501506029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fba6408e640 con 0x7fba64162340 2024-09-16T01:54:24.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.852+0000 7fba5a7fc640 1 -- 172.21.15.42:0/3501506029 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fba54059830 con 0x7fba64162340 2024-09-16T01:54:24.854 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data_ec' created 2024-09-16T01:54:24.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.855+0000 7fba6c074640 1 -- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba4806c2e0 msgr2=0x7fba4806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:24.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.855+0000 7fba6c074640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba4806c2e0 0x7fba4806e7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba60006fd0 tx=0x7fba60008040 comp rx=0 tx=0).stop 2024-09-16T01:54:24.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.855+0000 7fba6c074640 1 -- 172.21.15.42:0/3501506029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162340 msgr2=0x7fba640b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:24.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.855+0000 7fba6c074640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162340 0x7fba640b5290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fba5400c760 tx=0x7fba5400cc20 comp rx=0 tx=0).stop 2024-09-16T01:54:24.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.856+0000 7fba6c074640 1 -- 172.21.15.42:0/3501506029 shutdown_connections 2024-09-16T01:54:24.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.856+0000 7fba6c074640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba4806c2e0 0x7fba4806e7a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:24.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.856+0000 7fba6c074640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba64162e30 0x7fba640b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:24.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.856+0000 7fba6c074640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba64162340 0x7fba640b5290 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:24.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.856+0000 7fba6c074640 1 --2- 172.21.15.42:0/3501506029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba640cf280 0x7fba640cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:24.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.856+0000 7fba6c074640 1 -- 172.21.15.42:0/3501506029 >> 172.21.15.42:0/3501506029 conn(0x7fba6408bfc0 msgr2=0x7fba64162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:24.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.858+0000 7fba6c074640 1 -- 172.21.15.42:0/3501506029 shutdown_connections 2024-09-16T01:54:24.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.858+0000 7fba6c074640 1 -- 172.21.15.42:0/3501506029 wait complete. 2024-09-16T01:54:24.879 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-16T01:54:24.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.990+0000 7fe6f2a77640 1 Processor -- start 2024-09-16T01:54:24.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.990+0000 7fe6f2a77640 1 -- start start 2024-09-16T01:54:25.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6f2a77640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe6ec0d15f0 0x7fe6ec0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:25.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6f2a77640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe6ec0cf160 0x7fe6ec06d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:25.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6f2a77640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec0cf980 con 0x7fe6ec161a20 2024-09-16T01:54:25.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6f2a77640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec161e00 con 0x7fe6ec0d15f0 2024-09-16T01:54:25.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6f2a77640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec06d050 con 0x7fe6ec0cf160 2024-09-16T01:54:25.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6e3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe6ec0d15f0 0x7fe6ec0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:25.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6f0813640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe6ec161a20 0x7fe6ec0d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34614/0 (socket says 172.21.15.42:34614) 2024-09-16T01:54:25.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6f0813640 1 -- 172.21.15.42:0/3963747984 learned_addr learned my addr 172.21.15.42:0/3963747984 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:25.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6f1014640 1 --2- 172.21.15.42:0/3963747984 >> v2:172.21.15.107:3300/0 conn(0x7fe6ec0cf160 0x7fe6ec06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:25.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6e3fff640 1 -- 172.21.15.42:0/3963747984 >> v2:172.21.15.107:3300/0 conn(0x7fe6ec0cf160 msgr2=0x7fe6ec06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:25.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6e3fff640 1 --2- 172.21.15.42:0/3963747984 >> v2:172.21.15.107:3300/0 conn(0x7fe6ec0cf160 0x7fe6ec06d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:25.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6e3fff640 1 -- 172.21.15.42:0/3963747984 >> v1:172.21.15.42:6789/0 conn(0x7fe6ec161a20 legacy=0x7fe6ec0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:25.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.991+0000 7fe6e3fff640 1 -- 172.21.15.42:0/3963747984 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec0cfc20 con 0x7fe6ec0d15f0 2024-09-16T01:54:25.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.992+0000 7fe6e3fff640 1 --2- 172.21.15.42:0/3963747984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0d15f0 0x7fe6ec0cec20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0d4410 tx=0x7fe6dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca619dca741ab0d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:25.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.992+0000 7fe6e37fe640 1 -- 172.21.15.42:0/3963747984 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc037070 con 0x7fe6ec0d15f0 2024-09-16T01:54:25.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.992+0000 7fe6e37fe640 1 -- 172.21.15.42:0/3963747984 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc032440 con 0x7fe6ec0d15f0 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.992+0000 7fe6e37fe640 1 -- 172.21.15.42:0/3963747984 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc032810 con 0x7fe6ec0d15f0 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.993+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3963747984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0d15f0 msgr2=0x7fe6ec0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.993+0000 7fe6f2a77640 1 --2- 172.21.15.42:0/3963747984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0d15f0 0x7fe6ec0cec20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0d4410 tx=0x7fe6dc02a1a0 comp rx=0 tx=0).stop 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.993+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3963747984 shutdown_connections 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.993+0000 7fe6f2a77640 1 --2- 172.21.15.42:0/3963747984 >> v2:172.21.15.107:3300/0 conn(0x7fe6ec0cf160 0x7fe6ec06d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.993+0000 7fe6f2a77640 1 --2- 172.21.15.42:0/3963747984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0d15f0 0x7fe6ec0cec20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.993+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3963747984 >> 172.21.15.42:0/3963747984 conn(0x7fe6ec09d850 msgr2=0x7fe6ec08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.993+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3963747984 shutdown_connections 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.993+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3963747984 wait complete. 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.994+0000 7fe6f2a77640 1 Processor -- start 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.994+0000 7fe6f2a77640 1 -- start start 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f2a77640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0cf160 0x7fe6ec0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:25.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f2a77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6ec0d15f0 0x7fe6ec0b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f2a77640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6ec161a20 0x7fe6ec0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f2a77640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0b1040 con 0x7fe6ec0cf160 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f2a77640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec06d2f0 con 0x7fe6ec0d15f0 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f2a77640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec0cf590 con 0x7fe6ec161a20 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f0813640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0cf160 0x7fe6ec0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f0813640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0cf160 0x7fe6ec0b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55688/0 (socket says 172.21.15.42:55688) 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f0813640 1 -- 172.21.15.42:0/3232802196 learned_addr learned my addr 172.21.15.42:0/3232802196 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f0813640 1 -- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6ec161a20 msgr2=0x7fe6ec0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6e3fff640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6ec0d15f0 0x7fe6ec0b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f0813640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6ec161a20 0x7fe6ec0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f0813640 1 -- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6ec0d15f0 msgr2=0x7fe6ec0b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f0813640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6ec0d15f0 0x7fe6ec0b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f0813640 1 -- 172.21.15.42:0/3232802196 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec0b4060 con 0x7fe6ec0cf160 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6f0813640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0cf160 0x7fe6ec0b77f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800ca70 tx=0x7fe6e800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.995+0000 7fe6e17fa640 1 -- 172.21.15.42:0/3232802196 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8017070 con 0x7fe6ec0cf160 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.996+0000 7fe6e17fa640 1 -- 172.21.15.42:0/3232802196 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e800abf0 con 0x7fe6ec0cf160 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.996+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3232802196 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec0b4340 con 0x7fe6ec0cf160 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.996+0000 7fe6e17fa640 1 -- 172.21.15.42:0/3232802196 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8012400 con 0x7fe6ec0cf160 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.996+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3232802196 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec0b7320 con 0x7fe6ec0cf160 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.996+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3232802196 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec0cec20 con 0x7fe6ec0cf160 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.997+0000 7fe6e17fa640 1 -- 172.21.15.42:0/3232802196 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe6e801a070 con 0x7fe6ec0cf160 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.997+0000 7fe6e17fa640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe6d806c2b0 0x7fe6d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.998+0000 7fe6e17fa640 1 -- 172.21.15.42:0/3232802196 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fe6e808b3b0 con 0x7fe6ec0cf160 2024-09-16T01:54:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.998+0000 7fe6e3fff640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe6d806c2b0 0x7fe6d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:25.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:24.998+0000 7fe6e3fff640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe6d806c2b0 0x7fe6d806e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc034000 tx=0x7fe6dc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:25.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.002+0000 7fe6e17fa640 1 -- 172.21.15.42:0/3232802196 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6e8059890 con 0x7fe6ec0cf160 2024-09-16T01:54:25.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.175+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3232802196 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fe6ec0b75b0 con 0x7fe6ec0cf160 2024-09-16T01:54:25.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.853+0000 7fe6e17fa640 1 -- 172.21.15.42:0/3232802196 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7fe6e8059190 con 0x7fe6ec0cf160 2024-09-16T01:54:25.855 INFO:teuthology.orchestra.run.smithi042.stderr:set pool 4 allow_ec_overwrites to true 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.858+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe6d806c2b0 msgr2=0x7fe6d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.858+0000 7fe6f2a77640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe6d806c2b0 0x7fe6d806e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc034000 tx=0x7fe6dc02e000 comp rx=0 tx=0).stop 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.858+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3232802196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0cf160 msgr2=0x7fe6ec0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.858+0000 7fe6f2a77640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0cf160 0x7fe6ec0b77f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800ca70 tx=0x7fe6e800cf30 comp rx=0 tx=0).stop 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.858+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3232802196 shutdown_connections 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.858+0000 7fe6f2a77640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe6d806c2b0 0x7fe6d806e770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.858+0000 7fe6f2a77640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe6ec161a20 0x7fe6ec0b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.858+0000 7fe6f2a77640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6ec0d15f0 0x7fe6ec0b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.858+0000 7fe6f2a77640 1 --2- 172.21.15.42:0/3232802196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6ec0cf160 0x7fe6ec0b77f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.858+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3232802196 >> 172.21.15.42:0/3232802196 conn(0x7fe6ec09d850 msgr2=0x7fe6ec0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:25.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.859+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3232802196 shutdown_connections 2024-09-16T01:54:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:25.859+0000 7fe6f2a77640 1 -- 172.21.15.42:0/3232802196 wait complete. 2024-09-16T01:54:25.889 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-16T01:54:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.000+0000 7fd685077640 1 Processor -- start 2024-09-16T01:54:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.000+0000 7fd685077640 1 -- start start 2024-09-16T01:54:26.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.000+0000 7fd685077640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd68015e6c0 0x7fd6800cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:26.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.000+0000 7fd685077640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd6800d5090 0x7fd6800cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:26.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.000+0000 7fd685077640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6800cfee0 con 0x7fd6800cfae0 2024-09-16T01:54:26.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.000+0000 7fd685077640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd6800cf400 con 0x7fd68015e6c0 2024-09-16T01:54:26.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.000+0000 7fd685077640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd6800b10d0 con 0x7fd6800d5090 2024-09-16T01:54:26.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.001+0000 7fd67ed9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd68015e6c0 0x7fd6800cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:26.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.001+0000 7fd67f59e640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd6800cfae0 0x7fd6801622d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34630/0 (socket says 172.21.15.42:34630) 2024-09-16T01:54:26.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.001+0000 7fd67f59e640 1 -- 172.21.15.42:0/2531471173 learned_addr learned my addr 172.21.15.42:0/2531471173 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:26.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.001+0000 7fd67e59c640 1 --2- 172.21.15.42:0/2531471173 >> v2:172.21.15.107:3300/0 conn(0x7fd6800d5090 0x7fd6800cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:26.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.001+0000 7fd67dd9b640 1 -- 172.21.15.42:0/2531471173 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292216800 0 0) 0x7fd6800cfee0 con 0x7fd6800cfae0 2024-09-16T01:54:26.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.001+0000 7fd67dd9b640 1 -- 172.21.15.42:0/2531471173 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd668003520 con 0x7fd6800cfae0 2024-09-16T01:54:26.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.001+0000 7fd67ed9d640 1 -- 172.21.15.42:0/2531471173 >> v2:172.21.15.107:3300/0 conn(0x7fd6800d5090 msgr2=0x7fd6800cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:26.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.001+0000 7fd67ed9d640 1 --2- 172.21.15.42:0/2531471173 >> v2:172.21.15.107:3300/0 conn(0x7fd6800d5090 0x7fd6800cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:26.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.001+0000 7fd67ed9d640 1 -- 172.21.15.42:0/2531471173 >> v1:172.21.15.42:6789/0 conn(0x7fd6800cfae0 legacy=0x7fd6801622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:26.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.001+0000 7fd67ed9d640 1 -- 172.21.15.42:0/2531471173 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6800d34f0 con 0x7fd68015e6c0 2024-09-16T01:54:26.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.002+0000 7fd67ed9d640 1 --2- 172.21.15.42:0/2531471173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd68015e6c0 0x7fd6800cebb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd68008d110 tx=0x7fd67002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b73c8cd2f3b9ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:26.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.002+0000 7fd67dd9b640 1 -- 172.21.15.42:0/2531471173 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670037070 con 0x7fd68015e6c0 2024-09-16T01:54:26.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.002+0000 7fd67dd9b640 1 -- 172.21.15.42:0/2531471173 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd670032440 con 0x7fd68015e6c0 2024-09-16T01:54:26.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.002+0000 7fd67dd9b640 1 -- 172.21.15.42:0/2531471173 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67002ae60 con 0x7fd68015e6c0 2024-09-16T01:54:26.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.002+0000 7fd685077640 1 -- 172.21.15.42:0/2531471173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd68015e6c0 msgr2=0x7fd6800cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:26.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.002+0000 7fd685077640 1 --2- 172.21.15.42:0/2531471173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd68015e6c0 0x7fd6800cebb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd68008d110 tx=0x7fd67002a110 comp rx=0 tx=0).stop 2024-09-16T01:54:26.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.002+0000 7fd685077640 1 -- 172.21.15.42:0/2531471173 shutdown_connections 2024-09-16T01:54:26.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.002+0000 7fd685077640 1 --2- 172.21.15.42:0/2531471173 >> v2:172.21.15.107:3300/0 conn(0x7fd6800d5090 0x7fd6800cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:26.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.002+0000 7fd685077640 1 --2- 172.21.15.42:0/2531471173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd68015e6c0 0x7fd6800cebb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:26.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.002+0000 7fd685077640 1 -- 172.21.15.42:0/2531471173 >> 172.21.15.42:0/2531471173 conn(0x7fd68008bfc0 msgr2=0x7fd6800d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:26.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.003+0000 7fd685077640 1 -- 172.21.15.42:0/2531471173 shutdown_connections 2024-09-16T01:54:26.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.003+0000 7fd685077640 1 -- 172.21.15.42:0/2531471173 wait complete. 2024-09-16T01:54:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.004+0000 7fd685077640 1 Processor -- start 2024-09-16T01:54:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.004+0000 7fd685077640 1 -- start start 2024-09-16T01:54:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd685077640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6800cfae0 0x7fd6801532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd685077640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6800d5090 0x7fd6800b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:26.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd685077640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd68015e6c0 0x7fd6800b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd685077640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd6800cf0f0 con 0x7fd6800cfae0 2024-09-16T01:54:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd685077640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd6800d3a70 con 0x7fd68015e6c0 2024-09-16T01:54:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd685077640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd68015eaa0 con 0x7fd6800d5090 2024-09-16T01:54:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd67ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6800cfae0 0x7fd6801532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd67ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6800cfae0 0x7fd6801532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55694/0 (socket says 172.21.15.42:55694) 2024-09-16T01:54:26.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd67ed9d640 1 -- 172.21.15.42:0/2126964779 learned_addr learned my addr 172.21.15.42:0/2126964779 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd67f59e640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd68015e6c0 0x7fd6800b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd67e59c640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6800d5090 0x7fd6800b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd67ed9d640 1 -- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6800d5090 msgr2=0x7fd6800b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd67ed9d640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6800d5090 0x7fd6800b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd67ed9d640 1 -- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd68015e6c0 msgr2=0x7fd6800b8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:26.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd67ed9d640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd68015e6c0 0x7fd6800b8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.005+0000 7fd67ed9d640 1 -- 172.21.15.42:0/2126964779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6800cd430 con 0x7fd6800cfae0 2024-09-16T01:54:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.006+0000 7fd67ed9d640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6800cfae0 0x7fd6801532c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd670000c00 tx=0x7fd6700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.006+0000 7fd6677fe640 1 -- 172.21.15.42:0/2126964779 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670041030 con 0x7fd6800cfae0 2024-09-16T01:54:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.006+0000 7fd6677fe640 1 -- 172.21.15.42:0/2126964779 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67003d420 con 0x7fd6800cfae0 2024-09-16T01:54:26.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.006+0000 7fd685077640 1 -- 172.21.15.42:0/2126964779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6800cd710 con 0x7fd6800cfae0 2024-09-16T01:54:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.006+0000 7fd6677fe640 1 -- 172.21.15.42:0/2126964779 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670037040 con 0x7fd6800cfae0 2024-09-16T01:54:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.006+0000 7fd685077640 1 -- 172.21.15.42:0/2126964779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6800cdcd0 con 0x7fd6800cfae0 2024-09-16T01:54:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.007+0000 7fd685077640 1 -- 172.21.15.42:0/2126964779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6800ce0b0 con 0x7fd6800cfae0 2024-09-16T01:54:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.007+0000 7fd6677fe640 1 -- 172.21.15.42:0/2126964779 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd670044070 con 0x7fd6800cfae0 2024-09-16T01:54:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.008+0000 7fd6677fe640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd66c06c2e0 0x7fd66c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:26.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.008+0000 7fd6677fe640 1 -- 172.21.15.42:0/2126964779 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fd6700abc40 con 0x7fd6800cfae0 2024-09-16T01:54:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.008+0000 7fd67e59c640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd66c06c2e0 0x7fd66c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.009+0000 7fd67e59c640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd66c06c2e0 0x7fd66c06e7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6800b85a0 tx=0x7fd674009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:26.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.012+0000 7fd6677fe640 1 -- 172.21.15.42:0/2126964779 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6800ce0b0 con 0x7fd6800cfae0 2024-09-16T01:54:26.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.226+0000 7fd685077640 1 -- 172.21.15.42:0/2126964779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fd6800cf5a0 con 0x7fd6800cfae0 2024-09-16T01:54:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.900+0000 7fd6677fe640 1 -- 172.21.15.42:0/2126964779 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7fd670079a50 con 0x7fd6800cfae0 2024-09-16T01:54:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:added data pool 4 to fsmap 2024-09-16T01:54:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 -- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd66c06c2e0 msgr2=0x7fd66c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd66c06c2e0 0x7fd66c06e7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6800b85a0 tx=0x7fd674009190 comp rx=0 tx=0).stop 2024-09-16T01:54:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 -- 172.21.15.42:0/2126964779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6800cfae0 msgr2=0x7fd6801532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6800cfae0 0x7fd6801532c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd670000c00 tx=0x7fd6700046c0 comp rx=0 tx=0).stop 2024-09-16T01:54:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 -- 172.21.15.42:0/2126964779 shutdown_connections 2024-09-16T01:54:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd66c06c2e0 0x7fd66c06e7a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd68015e6c0 0x7fd6800b8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd6800d5090 0x7fd6800b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 --2- 172.21.15.42:0/2126964779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd6800cfae0 0x7fd6801532c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 -- 172.21.15.42:0/2126964779 >> 172.21.15.42:0/2126964779 conn(0x7fd68008bfc0 msgr2=0x7fd6800d2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 -- 172.21.15.42:0/2126964779 shutdown_connections 2024-09-16T01:54:26.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:26.904+0000 7fd685077640 1 -- 172.21.15.42:0/2126964779 wait complete. 2024-09-16T01:54:26.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:54:27.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.026+0000 7f813a4dd640 1 Processor -- start 2024-09-16T01:54:27.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.026+0000 7f813a4dd640 1 -- start start 2024-09-16T01:54:27.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.027+0000 7f813a4dd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8134162060 0x7f81340b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.027+0000 7f813a4dd640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813406d9f0 con 0x7f8134161c80 2024-09-16T01:54:27.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.027+0000 7f813a4dd640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813406dcd0 con 0x7f81340b64b0 2024-09-16T01:54:27.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.027+0000 7f813a4dd640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f813406dfb0 con 0x7f8134162060 2024-09-16T01:54:27.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.027+0000 7f81337fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8134162060 0x7f81340b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.027+0000 7f8133fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8134161c80 0x7f813406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34642/0 (socket says 172.21.15.42:34642) 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.027+0000 7f8133fff640 1 -- 172.21.15.42:0/413945334 learned_addr learned my addr 172.21.15.42:0/413945334 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.028+0000 7f81337fe640 1 -- 172.21.15.42:0/413945334 >> v1:172.21.15.107:6789/0 conn(0x7f81340b64b0 legacy=0x7f81340cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.028+0000 7f81337fe640 1 -- 172.21.15.42:0/413945334 >> v1:172.21.15.42:6789/0 conn(0x7f8134161c80 legacy=0x7f813406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.028+0000 7f81337fe640 1 -- 172.21.15.42:0/413945334 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81340d2890 con 0x7f8134162060 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.028+0000 7f8132ffd640 1 -- 172.21.15.42:0/413945334 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098700187 0 0) 0x7f813406d9f0 con 0x7f8134161c80 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.028+0000 7f81337fe640 1 --2- 172.21.15.42:0/413945334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8134162060 0x7f81340b5f70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81280097a0 tx=0x7f812802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6058cfc6cc004df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.029+0000 7f8132ffd640 1 -- 172.21.15.42:0/413945334 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128037070 con 0x7f8134162060 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.029+0000 7f8132ffd640 1 -- 172.21.15.42:0/413945334 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128032440 con 0x7f8134162060 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.029+0000 7f8132ffd640 1 -- 172.21.15.42:0/413945334 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128032810 con 0x7f8134162060 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.029+0000 7f813a4dd640 1 -- 172.21.15.42:0/413945334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8134162060 msgr2=0x7f81340b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.029+0000 7f813a4dd640 1 --2- 172.21.15.42:0/413945334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8134162060 0x7f81340b5f70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81280097a0 tx=0x7f812802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.029+0000 7f813a4dd640 1 -- 172.21.15.42:0/413945334 shutdown_connections 2024-09-16T01:54:27.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.029+0000 7f813a4dd640 1 --2- 172.21.15.42:0/413945334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8134162060 0x7f81340b5f70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.029+0000 7f813a4dd640 1 -- 172.21.15.42:0/413945334 >> 172.21.15.42:0/413945334 conn(0x7f81340d44f0 msgr2=0x7f81340d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.029+0000 7f813a4dd640 1 -- 172.21.15.42:0/413945334 shutdown_connections 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.029+0000 7f813a4dd640 1 -- 172.21.15.42:0/413945334 wait complete. 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.030+0000 7f813a4dd640 1 Processor -- start 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.031+0000 7f813a4dd640 1 -- start start 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.031+0000 7f813a4dd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b64b0 0x7f81340b8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.031+0000 7f813a4dd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8134161c80 0x7f8134156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.031+0000 7f813a4dd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8134162060 0x7f81340c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.031+0000 7f813a4dd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f81340b6d30 con 0x7f81340b64b0 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.031+0000 7f813a4dd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f81340b6bb0 con 0x7f8134161c80 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.031+0000 7f813a4dd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f81340cf8f0 con 0x7f8134162060 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.031+0000 7f8133fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b64b0 0x7f81340b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.031+0000 7f8133fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b64b0 0x7f81340b8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55704/0 (socket says 172.21.15.42:55704) 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.031+0000 7f8133fff640 1 -- 172.21.15.42:0/4154454671 learned_addr learned my addr 172.21.15.42:0/4154454671 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f81337fe640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8134161c80 0x7f8134156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8133fff640 1 -- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8134162060 msgr2=0x7f81340c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8138a7a640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8134162060 0x7f81340c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8133fff640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8134162060 0x7f81340c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8133fff640 1 -- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8134161c80 msgr2=0x7f8134156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8133fff640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8134161c80 0x7f8134156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8133fff640 1 -- 172.21.15.42:0/4154454671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81340c8990 con 0x7f81340b64b0 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f81337fe640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8134161c80 0x7f8134156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8138a7a640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8134162060 0x7f81340c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8133fff640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b64b0 0x7f81340b8340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f812400c500 tx=0x7f812400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8130ff9640 1 -- 172.21.15.42:0/4154454671 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124018070 con 0x7f81340b64b0 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8130ff9640 1 -- 172.21.15.42:0/4154454671 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8124007580 con 0x7f81340b64b0 2024-09-16T01:54:27.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f813a4dd640 1 -- 172.21.15.42:0/4154454671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81340c8c70 con 0x7f81340b64b0 2024-09-16T01:54:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f8130ff9640 1 -- 172.21.15.42:0/4154454671 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124004a20 con 0x7f81340b64b0 2024-09-16T01:54:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.032+0000 7f813a4dd640 1 -- 172.21.15.42:0/4154454671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81340b8c20 con 0x7f81340b64b0 2024-09-16T01:54:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.033+0000 7f813a4dd640 1 -- 172.21.15.42:0/4154454671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813406d9f0 con 0x7f81340b64b0 2024-09-16T01:54:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.033+0000 7f8130ff9640 1 -- 172.21.15.42:0/4154454671 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f812401b070 con 0x7f81340b64b0 2024-09-16T01:54:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.034+0000 7f8130ff9640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f812006c2b0 0x7f812006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.034+0000 7f8130ff9640 1 -- 172.21.15.42:0/4154454671 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f812408aa50 con 0x7f81340b64b0 2024-09-16T01:54:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.034+0000 7f81337fe640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f812006c2b0 0x7f812006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.035+0000 7f81337fe640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f812006c2b0 0x7f812006e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8128034000 tx=0x7f812802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.038+0000 7f8130ff9640 1 -- 172.21.15.42:0/4154454671 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8124058f10 con 0x7f81340b64b0 2024-09-16T01:54:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.248+0000 7f813a4dd640 1 -- 172.21.15.42:0/4154454671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f813415ff90 con 0x7f81340b64b0 2024-09-16T01:54:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.249+0000 7f8130ff9640 1 -- 172.21.15.42:0/4154454671 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5231 (secure 0 0 0) 0x7f8124058810 con 0x7f81340b64b0 2024-09-16T01:54:27.250 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:27.250 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":6,"btime":"2024-09-16T01:54:26:895293+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:54:21.197115+0000","modified":"2024-09-16T01:54:26.227748+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34157,"qdb_cluster":[34157]},"id":1}]} 2024-09-16T01:54:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 6 2024-09-16T01:54:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.250+0000 7f813a4dd640 1 -- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f812006c2b0 msgr2=0x7f812006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.250+0000 7f813a4dd640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f812006c2b0 0x7f812006e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8128034000 tx=0x7f812802e000 comp rx=0 tx=0).stop 2024-09-16T01:54:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.250+0000 7f813a4dd640 1 -- 172.21.15.42:0/4154454671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b64b0 msgr2=0x7f81340b8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.250+0000 7f813a4dd640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b64b0 0x7f81340b8340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f812400c500 tx=0x7f812400c9c0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.250+0000 7f813a4dd640 1 -- 172.21.15.42:0/4154454671 shutdown_connections 2024-09-16T01:54:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.251+0000 7f813a4dd640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f812006c2b0 0x7f812006e770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.251+0000 7f813a4dd640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8134162060 0x7f81340c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.251+0000 7f813a4dd640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8134161c80 0x7f8134156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.251+0000 7f813a4dd640 1 --2- 172.21.15.42:0/4154454671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b64b0 0x7f81340b8340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.251+0000 7f813a4dd640 1 -- 172.21.15.42:0/4154454671 >> 172.21.15.42:0/4154454671 conn(0x7f81340d44f0 msgr2=0x7f813406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.251+0000 7f813a4dd640 1 -- 172.21.15.42:0/4154454671 shutdown_connections 2024-09-16T01:54:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.251+0000 7f813a4dd640 1 -- 172.21.15.42:0/4154454671 wait complete. 2024-09-16T01:54:27.263 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.363+0000 7fd3f8e65640 1 Processor -- start 2024-09-16T01:54:27.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.363+0000 7fd3f8e65640 1 -- start start 2024-09-16T01:54:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.364+0000 7fd3f8e65640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 0x7fd3f40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.364+0000 7fd3f8e65640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd3f40b64b0 0x7fd3f40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.364+0000 7fd3f8e65640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f406d9f0 con 0x7fd3f4161c80 2024-09-16T01:54:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.364+0000 7fd3f8e65640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd3f406dcd0 con 0x7fd3f40b64b0 2024-09-16T01:54:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.364+0000 7fd3f8e65640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f406dfb0 con 0x7fd3f4162060 2024-09-16T01:54:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.364+0000 7fd3f2d9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd3f40b64b0 0x7fd3f40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.364+0000 7fd3f259c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd3f4161c80 0x7fd3f406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34656/0 (socket says 172.21.15.42:34656) 2024-09-16T01:54:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.364+0000 7fd3f2d9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd3f40b64b0 0x7fd3f40b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55714/0 (socket says 172.21.15.42:55714) 2024-09-16T01:54:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.364+0000 7fd3f259c640 1 -- 172.21.15.42:0/9739435 learned_addr learned my addr 172.21.15.42:0/9739435 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.365+0000 7fd3f1d9b640 1 --2- 172.21.15.42:0/9739435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 0x7fd3f40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.365+0000 7fd3f2d9d640 1 -- 172.21.15.42:0/9739435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 msgr2=0x7fd3f40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.365+0000 7fd3f2d9d640 1 --2- 172.21.15.42:0/9739435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 0x7fd3f40b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.365+0000 7fd3f2d9d640 1 -- 172.21.15.42:0/9739435 >> v1:172.21.15.42:6789/0 conn(0x7fd3f4161c80 legacy=0x7fd3f406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.365+0000 7fd3f159a640 1 -- 172.21.15.42:0/9739435 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268389108 0 0) 0x7fd3f406d9f0 con 0x7fd3f4161c80 2024-09-16T01:54:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.365+0000 7fd3f2d9d640 1 -- 172.21.15.42:0/9739435 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f40d01f0 con 0x7fd3f40b64b0 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.365+0000 7fd3f2d9d640 1 --2- 172.21.15.42:0/9739435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f40b64b0 0x7fd3f40b6960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009d90 tx=0x7fd3ec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127fae4a2f189404 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f159a640 1 -- 172.21.15.42:0/9739435 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec007740 con 0x7fd3f40b64b0 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f159a640 1 -- 172.21.15.42:0/9739435 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec0078e0 con 0x7fd3f40b64b0 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f159a640 1 -- 172.21.15.42:0/9739435 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec007cb0 con 0x7fd3f40b64b0 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f8e65640 1 -- 172.21.15.42:0/9739435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f40b64b0 msgr2=0x7fd3f40b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f8e65640 1 --2- 172.21.15.42:0/9739435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f40b64b0 0x7fd3f40b6960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009d90 tx=0x7fd3ec02a660 comp rx=0 tx=0).stop 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f8e65640 1 -- 172.21.15.42:0/9739435 shutdown_connections 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f8e65640 1 --2- 172.21.15.42:0/9739435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f40b64b0 0x7fd3f40b6960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f8e65640 1 --2- 172.21.15.42:0/9739435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 0x7fd3f40b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f8e65640 1 -- 172.21.15.42:0/9739435 >> 172.21.15.42:0/9739435 conn(0x7fd3f40d44f0 msgr2=0x7fd3f40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f8e65640 1 -- 172.21.15.42:0/9739435 shutdown_connections 2024-09-16T01:54:27.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.366+0000 7fd3f8e65640 1 -- 172.21.15.42:0/9739435 wait complete. 2024-09-16T01:54:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f8e65640 1 Processor -- start 2024-09-16T01:54:27.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f8e65640 1 -- start start 2024-09-16T01:54:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f8e65640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40b64b0 0x7fd3f4159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f8e65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f4161c80 0x7fd3f40cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f8e65640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 0x7fd3f40b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f8e65640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f40cf1e0 con 0x7fd3f4161c80 2024-09-16T01:54:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f8e65640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f40d2aa0 con 0x7fd3f40b64b0 2024-09-16T01:54:27.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f8e65640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f40cf360 con 0x7fd3f4162060 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f4161c80 0x7fd3f40cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f1d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f4161c80 0x7fd3f40cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55720/0 (socket says 172.21.15.42:55720) 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.368+0000 7fd3f1d9b640 1 -- 172.21.15.42:0/2406737946 learned_addr learned my addr 172.21.15.42:0/2406737946 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f259c640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40b64b0 0x7fd3f4159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f2d9d640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 0x7fd3f40b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f1d9b640 1 -- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 msgr2=0x7fd3f40b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f1d9b640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 0x7fd3f40b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f1d9b640 1 -- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40b64b0 msgr2=0x7fd3f4159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f1d9b640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40b64b0 0x7fd3f4159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f1d9b640 1 -- 172.21.15.42:0/2406737946 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f40cbb00 con 0x7fd3f4161c80 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f2d9d640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 0x7fd3f40b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f1d9b640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f4161c80 0x7fd3f40cb5c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800d5d0 tx=0x7fd3e800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3e2ffd640 1 -- 172.21.15.42:0/2406737946 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8004240 con 0x7fd3f4161c80 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3e2ffd640 1 -- 172.21.15.42:0/2406737946 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e80043e0 con 0x7fd3f4161c80 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3e2ffd640 1 -- 172.21.15.42:0/2406737946 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8003830 con 0x7fd3f4161c80 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f8e65640 1 -- 172.21.15.42:0/2406737946 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f40cbda0 con 0x7fd3f4161c80 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.369+0000 7fd3f8e65640 1 -- 172.21.15.42:0/2406737946 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f40cc640 con 0x7fd3f4161c80 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.370+0000 7fd3f8e65640 1 -- 172.21.15.42:0/2406737946 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f40b5f70 con 0x7fd3f4161c80 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.371+0000 7fd3e2ffd640 1 -- 172.21.15.42:0/2406737946 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd3e80039d0 con 0x7fd3f4161c80 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.371+0000 7fd3e2ffd640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3d406c2e0 0x7fd3d406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.371+0000 7fd3e2ffd640 1 -- 172.21.15.42:0/2406737946 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd3e808b9c0 con 0x7fd3f4161c80 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.371+0000 7fd3f259c640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3d406c2e0 0x7fd3d406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.372+0000 7fd3f259c640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3d406c2e0 0x7fd3d406e7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4000f60 tx=0x7fd3e4007b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:27.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.375+0000 7fd3e2ffd640 1 -- 172.21.15.42:0/2406737946 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3e808de20 con 0x7fd3f4161c80 2024-09-16T01:54:27.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.549+0000 7fd3f8e65640 1 -- 172.21.15.42:0/2406737946 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3f4163380 con 0x7fd3f4161c80 2024-09-16T01:54:27.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.551+0000 7fd3e2ffd640 1 -- 172.21.15.42:0/2406737946 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7fd3e8059d70 con 0x7fd3f4161c80 2024-09-16T01:54:27.552 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:27.553 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:27.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 -- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3d406c2e0 msgr2=0x7fd3d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3d406c2e0 0x7fd3d406e7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4000f60 tx=0x7fd3e4007b70 comp rx=0 tx=0).stop 2024-09-16T01:54:27.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 -- 172.21.15.42:0/2406737946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f4161c80 msgr2=0x7fd3f40cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f4161c80 0x7fd3f40cb5c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800d5d0 tx=0x7fd3e800da90 comp rx=0 tx=0).stop 2024-09-16T01:54:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 -- 172.21.15.42:0/2406737946 shutdown_connections 2024-09-16T01:54:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3d406c2e0 0x7fd3d406e7a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3f4162060 0x7fd3f40b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3f4161c80 0x7fd3f40cb5c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 --2- 172.21.15.42:0/2406737946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3f40b64b0 0x7fd3f4159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 -- 172.21.15.42:0/2406737946 >> 172.21.15.42:0/2406737946 conn(0x7fd3f40d44f0 msgr2=0x7fd3f40b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 -- 172.21.15.42:0/2406737946 shutdown_connections 2024-09-16T01:54:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.553+0000 7fd3f8e65640 1 -- 172.21.15.42:0/2406737946 wait complete. 2024-09-16T01:54:27.565 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:27.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.666+0000 7f2ca6bf1640 1 Processor -- start 2024-09-16T01:54:27.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.666+0000 7f2ca6bf1640 1 -- start start 2024-09-16T01:54:27.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.667+0000 7f2ca6bf1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2ca0147360 0x7f2ca0070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.667+0000 7f2ca6bf1640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca006cb30 con 0x7f2ca00d0bb0 2024-09-16T01:54:27.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.667+0000 7f2ca6bf1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca006bfb0 con 0x7f2ca0070dd0 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.667+0000 7f2ca6bf1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca006c290 con 0x7f2ca0147360 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.667+0000 7f2ca518e640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2ca00d0bb0 0x7f2ca00ae550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:34662/0 (socket says 172.21.15.42:34662) 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.667+0000 7f2ca518e640 1 -- 172.21.15.42:0/1776848653 learned_addr learned my addr 172.21.15.42:0/1776848653 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.667+0000 7f2ca498d640 1 --2- 172.21.15.42:0/1776848653 >> v2:172.21.15.107:3300/0 conn(0x7f2ca0147360 0x7f2ca0070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.667+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875201769 0 0) 0x7f2ca006cb30 con 0x7f2ca00d0bb0 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.667+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c88003520 con 0x7f2ca00d0bb0 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1044999606 0 0) 0x7f2c88003520 con 0x7f2ca00d0bb0 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 >> v2:172.21.15.107:3300/0 conn(0x7f2ca0147360 msgr2=0x7f2ca0070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 --2- 172.21.15.42:0/1776848653 >> v2:172.21.15.107:3300/0 conn(0x7f2ca0147360 0x7f2ca0070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 >> v1:172.21.15.107:6789/0 conn(0x7f2ca0070dd0 legacy=0x7f2ca00d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca006c570 con 0x7f2ca00d0bb0 2024-09-16T01:54:27.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f2c980019f0 con 0x7f2ca00d0bb0 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 >> v1:172.21.15.42:6789/0 conn(0x7f2ca00d0bb0 legacy=0x7f2ca00ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c880039b0 0x7f2c88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c88004800 0x7f2c88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c880052e0 0x7f2c8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca006c290 con 0x7f2c880052e0 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8800c1b0 con 0x7f2c880039b0 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8800c3b0 con 0x7f2c88004800 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2ca498d640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c880039b0 0x7f2c88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2ca518e640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c880052e0 0x7f2c8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2c9ffff640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c88004800 0x7f2c88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2ca498d640 1 -- 172.21.15.42:0/1776848653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c88004800 msgr2=0x7f2c88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2ca498d640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c88004800 0x7f2c88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2ca498d640 1 -- 172.21.15.42:0/1776848653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c880052e0 msgr2=0x7f2c8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2ca498d640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c880052e0 0x7f2c8800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2ca498d640 1 -- 172.21.15.42:0/1776848653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c88003520 con 0x7f2c880039b0 2024-09-16T01:54:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2ca518e640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c880052e0 0x7f2c8800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.668+0000 7f2ca518e640 1 -- 172.21.15.42:0/1776848653 reap_dead start 2024-09-16T01:54:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.669+0000 7f2ca498d640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c880039b0 0x7f2c88003dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009a90 tx=0x7f2c88005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f850bd76184df6f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.669+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90036070 con 0x7f2c880039b0 2024-09-16T01:54:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.669+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c90031400 con 0x7f2c880039b0 2024-09-16T01:54:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.669+0000 7f2c9f7fe640 1 -- 172.21.15.42:0/1776848653 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90009690 con 0x7f2c880039b0 2024-09-16T01:54:27.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.670+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/1776848653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c880039b0 msgr2=0x7f2c88003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.670+0000 7f2ca6bf1640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c880039b0 0x7f2c88003dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009a90 tx=0x7f2c88005830 comp rx=0 tx=0).stop 2024-09-16T01:54:27.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.670+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/1776848653 shutdown_connections 2024-09-16T01:54:27.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.670+0000 7f2ca6bf1640 1 --2- 172.21.15.42:0/1776848653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c880039b0 0x7f2c88003dd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.670+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/1776848653 >> 172.21.15.42:0/1776848653 conn(0x7f2ca00b2f40 msgr2=0x7f2ca00b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:27.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.670+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/1776848653 shutdown_connections 2024-09-16T01:54:27.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.670+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/1776848653 wait complete. 2024-09-16T01:54:27.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.671+0000 7f2ca6bf1640 1 Processor -- start 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.671+0000 7f2ca6bf1640 1 -- start start 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca6bf1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c880039b0 0x7f2ca01f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca6bf1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca0161b70 0x7f2ca013cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca6bf1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ca00b68c0 0x7f2ca00b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca6bf1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca006bd90 con 0x7f2ca00b68c0 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca6bf1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca006bc10 con 0x7f2ca0161b70 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca6bf1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca0070890 con 0x7f2c880039b0 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca518e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ca00b68c0 0x7f2ca00b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca518e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ca00b68c0 0x7f2ca00b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55740/0 (socket says 172.21.15.42:55740) 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca518e640 1 -- 172.21.15.42:0/3024180662 learned_addr learned my addr 172.21.15.42:0/3024180662 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:27.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2c9ffff640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca0161b70 0x7f2ca013cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca498d640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c880039b0 0x7f2ca01f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca518e640 1 -- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c880039b0 msgr2=0x7f2ca01f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca518e640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c880039b0 0x7f2ca01f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca518e640 1 -- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca0161b70 msgr2=0x7f2ca013cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca518e640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca0161b70 0x7f2ca013cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca518e640 1 -- 172.21.15.42:0/3024180662 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca013d4c0 con 0x7f2ca00b68c0 2024-09-16T01:54:27.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca518e640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ca00b68c0 0x7f2ca00b6d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00706e0 tx=0x7f2c98007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:27.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2c9d7fa640 1 -- 172.21.15.42:0/3024180662 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800a480 con 0x7f2ca00b68c0 2024-09-16T01:54:27.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2c9d7fa640 1 -- 172.21.15.42:0/3024180662 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c98018070 con 0x7f2ca00b68c0 2024-09-16T01:54:27.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.672+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/3024180662 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca013d7a0 con 0x7f2ca00b68c0 2024-09-16T01:54:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.673+0000 7f2c9d7fa640 1 -- 172.21.15.42:0/3024180662 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98007ad0 con 0x7f2ca00b68c0 2024-09-16T01:54:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.673+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/3024180662 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca00b4520 con 0x7f2ca00b68c0 2024-09-16T01:54:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.674+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/3024180662 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca00d04a0 con 0x7f2ca00b68c0 2024-09-16T01:54:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.674+0000 7f2c9d7fa640 1 -- 172.21.15.42:0/3024180662 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2c98013610 con 0x7f2ca00b68c0 2024-09-16T01:54:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.674+0000 7f2c9d7fa640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2c8c06c2b0 0x7f2c8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.674+0000 7f2c9d7fa640 1 -- 172.21.15.42:0/3024180662 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2c9808bbd0 con 0x7f2ca00b68c0 2024-09-16T01:54:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.675+0000 7f2ca498d640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2c8c06c2b0 0x7f2c8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.675+0000 7f2ca498d640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2c8c06c2b0 0x7f2c8c06e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c90033000 tx=0x7f2c90008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:27.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.679+0000 7f2c9d7fa640 1 -- 172.21.15.42:0/3024180662 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c980599b0 con 0x7f2ca00b68c0 2024-09-16T01:54:27.826 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-09-16T01:54:27.825+0000 7fcb379f6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:54:27.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.856+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/3024180662 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ca013d970 con 0x7f2ca00b68c0 2024-09-16T01:54:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.857+0000 7f2c9d7fa640 1 -- 172.21.15.42:0/3024180662 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7f2c9805dcb0 con 0x7f2ca00b68c0 2024-09-16T01:54:27.859 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:27.859 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2c8c06c2b0 msgr2=0x7f2c8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2c8c06c2b0 0x7f2c8c06e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c90033000 tx=0x7f2c90008030 comp rx=0 tx=0).stop 2024-09-16T01:54:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/3024180662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ca00b68c0 msgr2=0x7f2ca00b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ca00b68c0 0x7f2ca00b6d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00706e0 tx=0x7f2c98007430 comp rx=0 tx=0).stop 2024-09-16T01:54:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/3024180662 shutdown_connections 2024-09-16T01:54:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2c8c06c2b0 0x7f2c8c06e770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ca00b68c0 0x7f2ca00b6d50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca0161b70 0x7f2ca013cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 --2- 172.21.15.42:0/3024180662 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c880039b0 0x7f2ca01f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/3024180662 >> 172.21.15.42:0/3024180662 conn(0x7f2ca00b2f40 msgr2=0x7f2ca0145b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/3024180662 shutdown_connections 2024-09-16T01:54:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.860+0000 7f2ca6bf1640 1 -- 172.21.15.42:0/3024180662 wait complete. 2024-09-16T01:54:27.889 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:54:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.990+0000 7faccff42640 1 Processor -- start 2024-09-16T01:54:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.990+0000 7faccff42640 1 -- start start 2024-09-16T01:54:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccff42640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7facc8145e00 0x7facc80cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccff42640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facc815d460 0x7facc80d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccff42640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7facc80d0a10 0x7facc806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccff42640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7facc80d0e80 con 0x7facc8145e00 2024-09-16T01:54:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccff42640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7facc81461e0 con 0x7facc80d0a10 2024-09-16T01:54:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccff42640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7facc80af720 con 0x7facc815d460 2024-09-16T01:54:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccdcde640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7facc8145e00 0x7facc80cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccdcde640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7facc8145e00 0x7facc80cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55756/0 (socket says 172.21.15.42:55756) 2024-09-16T01:54:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccdcde640 1 -- 172.21.15.42:0/1100523162 learned_addr learned my addr 172.21.15.42:0/1100523162 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccd4dd640 1 --2- 172.21.15.42:0/1100523162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facc815d460 0x7facc80d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7facce4df640 1 --2- 172.21.15.42:0/1100523162 >> v2:172.21.15.107:3300/0 conn(0x7facc80d0a10 0x7facc806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccdcde640 1 -- 172.21.15.42:0/1100523162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facc815d460 msgr2=0x7facc80d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccdcde640 1 --2- 172.21.15.42:0/1100523162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facc815d460 0x7facc80d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccdcde640 1 -- 172.21.15.42:0/1100523162 >> v2:172.21.15.107:3300/0 conn(0x7facc80d0a10 msgr2=0x7facc806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccdcde640 1 --2- 172.21.15.42:0/1100523162 >> v2:172.21.15.107:3300/0 conn(0x7facc80d0a10 0x7facc806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.991+0000 7faccdcde640 1 -- 172.21.15.42:0/1100523162 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc815d8c0 con 0x7facc8145e00 2024-09-16T01:54:27.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccdcde640 1 --2- 172.21.15.42:0/1100523162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc8145e00 0x7facc80cd8a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7facc8073f70 tx=0x7facc402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3987b567134b682 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccccdc640 1 -- 172.21.15.42:0/1100523162 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4037070 con 0x7facc8145e00 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccccdc640 1 -- 172.21.15.42:0/1100523162 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc4032440 con 0x7facc8145e00 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccccdc640 1 -- 172.21.15.42:0/1100523162 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4032810 con 0x7facc8145e00 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccff42640 1 -- 172.21.15.42:0/1100523162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc8145e00 msgr2=0x7facc80cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccff42640 1 --2- 172.21.15.42:0/1100523162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc8145e00 0x7facc80cd8a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7facc8073f70 tx=0x7facc402a1e0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccff42640 1 -- 172.21.15.42:0/1100523162 shutdown_connections 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccff42640 1 --2- 172.21.15.42:0/1100523162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facc815d460 0x7facc80d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccff42640 1 --2- 172.21.15.42:0/1100523162 >> v2:172.21.15.107:3300/0 conn(0x7facc80d0a10 0x7facc806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccff42640 1 --2- 172.21.15.42:0/1100523162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc8145e00 0x7facc80cd8a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.992+0000 7faccff42640 1 -- 172.21.15.42:0/1100523162 >> 172.21.15.42:0/1100523162 conn(0x7facc80b2f40 msgr2=0x7facc80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.993+0000 7faccff42640 1 -- 172.21.15.42:0/1100523162 shutdown_connections 2024-09-16T01:54:27.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.993+0000 7faccff42640 1 -- 172.21.15.42:0/1100523162 wait complete. 2024-09-16T01:54:27.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.994+0000 7faccff42640 1 Processor -- start 2024-09-16T01:54:27.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.994+0000 7faccff42640 1 -- start start 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.994+0000 7faccff42640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facc80d0a10 0x7facc81f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.994+0000 7faccff42640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facc8145e00 0x7facc8143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.994+0000 7faccff42640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc815d460 0x7facc815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.994+0000 7faccff42640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7facc80ce550 con 0x7facc815d460 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.994+0000 7faccff42640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7facc80ce270 con 0x7facc80d0a10 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.994+0000 7faccff42640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7facc80ce830 con 0x7facc8145e00 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facce4df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc815d460 0x7facc815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facce4df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc815d460 0x7facc815b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55766/0 (socket says 172.21.15.42:55766) 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facce4df640 1 -- 172.21.15.42:0/4069258406 learned_addr learned my addr 172.21.15.42:0/4069258406 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7faccdcde640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facc80d0a10 0x7facc81f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7faccd4dd640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facc8145e00 0x7facc8143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facce4df640 1 -- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facc8145e00 msgr2=0x7facc8143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facce4df640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facc8145e00 0x7facc8143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facce4df640 1 -- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facc80d0a10 msgr2=0x7facc81f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facce4df640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facc80d0a10 0x7facc81f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facce4df640 1 -- 172.21.15.42:0/4069258406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc81437a0 con 0x7facc815d460 2024-09-16T01:54:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facce4df640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc815d460 0x7facc815b450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7facc0007e90 tx=0x7facc000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facbe7fc640 1 -- 172.21.15.42:0/4069258406 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0014420 con 0x7facc815d460 2024-09-16T01:54:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facbe7fc640 1 -- 172.21.15.42:0/4069258406 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc0019070 con 0x7facc815d460 2024-09-16T01:54:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7faccff42640 1 -- 172.21.15.42:0/4069258406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc81f4860 con 0x7facc815d460 2024-09-16T01:54:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7facbe7fc640 1 -- 172.21.15.42:0/4069258406 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0014820 con 0x7facc815d460 2024-09-16T01:54:28.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.995+0000 7faccff42640 1 -- 172.21.15.42:0/4069258406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc8143a80 con 0x7facc815d460 2024-09-16T01:54:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.996+0000 7faccff42640 1 -- 172.21.15.42:0/4069258406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc80cede0 con 0x7facc815d460 2024-09-16T01:54:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.997+0000 7facbe7fc640 1 -- 172.21.15.42:0/4069258406 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7facc00149c0 con 0x7facc815d460 2024-09-16T01:54:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.997+0000 7facbe7fc640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7facac06c2b0 0x7facac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.997+0000 7facbe7fc640 1 -- 172.21.15.42:0/4069258406 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7facc008be10 con 0x7facc815d460 2024-09-16T01:54:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.997+0000 7faccdcde640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7facac06c2b0 0x7facac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:27.998+0000 7faccdcde640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7facac06c2b0 0x7facac06e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7facc4034000 tx=0x7facc402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:28.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.002+0000 7facbe7fc640 1 -- 172.21.15.42:0/4069258406 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facc0059c80 con 0x7facc815d460 2024-09-16T01:54:28.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.213+0000 7faccff42640 1 -- 172.21.15.42:0/4069258406 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facc80cfef0 con 0x7facc815d460 2024-09-16T01:54:28.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.213+0000 7facbe7fc640 1 -- 172.21.15.42:0/4069258406 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5231 (secure 0 0 0) 0x7facc005df80 con 0x7facc815d460 2024-09-16T01:54:28.215 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:28.216 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":6,"btime":"2024-09-16T01:54:26:895293+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:54:21.197115+0000","modified":"2024-09-16T01:54:26.227748+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34157,"qdb_cluster":[34157]},"id":1}]} 2024-09-16T01:54:28.216 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 6 2024-09-16T01:54:28.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 -- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7facac06c2b0 msgr2=0x7facac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:28.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7facac06c2b0 0x7facac06e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7facc4034000 tx=0x7facc402e000 comp rx=0 tx=0).stop 2024-09-16T01:54:28.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 -- 172.21.15.42:0/4069258406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc815d460 msgr2=0x7facc815b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:28.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc815d460 0x7facc815b450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7facc0007e90 tx=0x7facc000e4b0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 -- 172.21.15.42:0/4069258406 shutdown_connections 2024-09-16T01:54:28.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7facac06c2b0 0x7facac06e770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc815d460 0x7facc815b450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7facc8145e00 0x7facc8143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 --2- 172.21.15.42:0/4069258406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facc80d0a10 0x7facc81f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 -- 172.21.15.42:0/4069258406 >> 172.21.15.42:0/4069258406 conn(0x7facc80b2f40 msgr2=0x7facc80b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:28.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 -- 172.21.15.42:0/4069258406 shutdown_connections 2024-09-16T01:54:28.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.216+0000 7faccff42640 1 -- 172.21.15.42:0/4069258406 wait complete. 2024-09-16T01:54:28.227 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.327+0000 7f87dc6c9640 1 Processor -- start 2024-09-16T01:54:28.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.327+0000 7f87dc6c9640 1 -- start start 2024-09-16T01:54:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.328+0000 7f87dc6c9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d415b340 0x7f87d409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.328+0000 7f87dc6c9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f87d40b43f0 0x7f87d40b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.328+0000 7f87dc6c9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f87d40b4e80 0x7f87d415de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.328+0000 7f87dc6c9640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f87d40b5bd0 con 0x7f87d40b4e80 2024-09-16T01:54:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.328+0000 7f87dc6c9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f87d40b3830 con 0x7f87d40b43f0 2024-09-16T01:54:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.328+0000 7f87dc6c9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f87d40b5610 con 0x7f87d415b340 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.329+0000 7f87dac66640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f87d40b4e80 0x7f87d415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.329+0000 7f87dac66640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f87d40b4e80 0x7f87d415de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55026/0 (socket says 172.21.15.42:55026) 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.329+0000 7f87dac66640 1 -- 172.21.15.42:0/2085791003 learned_addr learned my addr 172.21.15.42:0/2085791003 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.329+0000 7f87da465640 1 --2- 172.21.15.42:0/2085791003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d415b340 0x7f87d409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.329+0000 7f87d9c64640 1 --2- 172.21.15.42:0/2085791003 >> v2:172.21.15.107:3300/0 conn(0x7f87d40b43f0 0x7f87d40b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.329+0000 7f87dac66640 1 -- 172.21.15.42:0/2085791003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d415b340 msgr2=0x7f87d409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.329+0000 7f87dac66640 1 --2- 172.21.15.42:0/2085791003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d415b340 0x7f87d409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.329+0000 7f87dac66640 1 -- 172.21.15.42:0/2085791003 >> v2:172.21.15.107:3300/0 conn(0x7f87d40b43f0 msgr2=0x7f87d40b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.329+0000 7f87dac66640 1 --2- 172.21.15.42:0/2085791003 >> v2:172.21.15.107:3300/0 conn(0x7f87d40b43f0 0x7f87d40b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.329+0000 7f87dac66640 1 -- 172.21.15.42:0/2085791003 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d40b58f0 con 0x7f87d40b4e80 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87dac66640 1 --2- 172.21.15.42:0/2085791003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 0x7f87d415de10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87d4068930 tx=0x7f87cc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224d22bd6313681d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87d9463640 1 -- 172.21.15.42:0/2085791003 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc036070 con 0x7f87d40b4e80 2024-09-16T01:54:28.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87d9463640 1 -- 172.21.15.42:0/2085791003 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87cc031600 con 0x7f87d40b4e80 2024-09-16T01:54:28.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87d9463640 1 -- 172.21.15.42:0/2085791003 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0319d0 con 0x7f87d40b4e80 2024-09-16T01:54:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87dc6c9640 1 -- 172.21.15.42:0/2085791003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 msgr2=0x7f87d415de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87dc6c9640 1 --2- 172.21.15.42:0/2085791003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 0x7f87d415de10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87d4068930 tx=0x7f87cc02a730 comp rx=0 tx=0).stop 2024-09-16T01:54:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87dc6c9640 1 -- 172.21.15.42:0/2085791003 shutdown_connections 2024-09-16T01:54:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87dc6c9640 1 --2- 172.21.15.42:0/2085791003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 0x7f87d415de10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87dc6c9640 1 --2- 172.21.15.42:0/2085791003 >> v2:172.21.15.107:3300/0 conn(0x7f87d40b43f0 0x7f87d40b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87dc6c9640 1 --2- 172.21.15.42:0/2085791003 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d415b340 0x7f87d409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87dc6c9640 1 -- 172.21.15.42:0/2085791003 >> 172.21.15.42:0/2085791003 conn(0x7f87d4073490 msgr2=0x7f87d40b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87dc6c9640 1 -- 172.21.15.42:0/2085791003 shutdown_connections 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.330+0000 7f87dc6c9640 1 -- 172.21.15.42:0/2085791003 wait complete. 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.332+0000 7f87dc6c9640 1 Processor -- start 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.332+0000 7f87dc6c9640 1 -- start start 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.332+0000 7f87dc6c9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d40b43f0 0x7f87d41f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.332+0000 7f87dc6c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 0x7f87d4147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.332+0000 7f87dc6c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d415b340 0x7f87d409b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.332+0000 7f87dc6c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f87d40b5330 con 0x7f87d40b4e80 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.332+0000 7f87dc6c9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f87d415d8f0 con 0x7f87d415b340 2024-09-16T01:54:28.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.332+0000 7f87dc6c9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f87d40cdb30 con 0x7f87d40b43f0 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87d9c64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 0x7f87d4147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87d9c64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 0x7f87d4147820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55028/0 (socket says 172.21.15.42:55028) 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87d9c64640 1 -- 172.21.15.42:0/686517425 learned_addr learned my addr 172.21.15.42:0/686517425 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87da465640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d40b43f0 0x7f87d41f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87dac66640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d415b340 0x7f87d409b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87d9c64640 1 -- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d40b43f0 msgr2=0x7f87d41f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87d9c64640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d40b43f0 0x7f87d41f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87d9c64640 1 -- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d415b340 msgr2=0x7f87d409b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87d9c64640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d415b340 0x7f87d409b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87d9c64640 1 -- 172.21.15.42:0/686517425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d4157fc0 con 0x7f87d40b4e80 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87dac66640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d415b340 0x7f87d409b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87d9c64640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 0x7f87d4147820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f87c400d800 tx=0x7f87c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:28.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87caffd640 1 -- 172.21.15.42:0/686517425 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c4004020 con 0x7f87d40b4e80 2024-09-16T01:54:28.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87caffd640 1 -- 172.21.15.42:0/686517425 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c40041c0 con 0x7f87d40b4e80 2024-09-16T01:54:28.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87dc6c9640 1 -- 172.21.15.42:0/686517425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d4147d60 con 0x7f87d40b4e80 2024-09-16T01:54:28.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87caffd640 1 -- 172.21.15.42:0/686517425 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c4004390 con 0x7f87d40b4e80 2024-09-16T01:54:28.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.333+0000 7f87dc6c9640 1 -- 172.21.15.42:0/686517425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d4158260 con 0x7f87d40b4e80 2024-09-16T01:54:28.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.334+0000 7f87dc6c9640 1 -- 172.21.15.42:0/686517425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d40b4940 con 0x7f87d40b4e80 2024-09-16T01:54:28.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.335+0000 7f87caffd640 1 -- 172.21.15.42:0/686517425 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f87c401b020 con 0x7f87d40b4e80 2024-09-16T01:54:28.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.335+0000 7f87caffd640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87b806c2b0 0x7f87b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:28.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.335+0000 7f87caffd640 1 -- 172.21.15.42:0/686517425 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f87c408b460 con 0x7f87d40b4e80 2024-09-16T01:54:28.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.335+0000 7f87da465640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87b806c2b0 0x7f87b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:28.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.336+0000 7f87da465640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87b806c2b0 0x7f87b806e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87d0007920 tx=0x7f87d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:28.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.340+0000 7f87caffd640 1 -- 172.21.15.42:0/686517425 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87c4059920 con 0x7f87d40b4e80 2024-09-16T01:54:28.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.516+0000 7f87dc6c9640 1 -- 172.21.15.42:0/686517425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87d4156180 con 0x7f87d40b4e80 2024-09-16T01:54:28.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.518+0000 7f87caffd640 1 -- 172.21.15.42:0/686517425 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7f87c4059220 con 0x7f87d40b4e80 2024-09-16T01:54:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:28.519 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 -- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87b806c2b0 msgr2=0x7f87b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87b806c2b0 0x7f87b806e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87d0007920 tx=0x7f87d0008040 comp rx=0 tx=0).stop 2024-09-16T01:54:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 -- 172.21.15.42:0/686517425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 msgr2=0x7f87d4147820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 0x7f87d4147820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f87c400d800 tx=0x7f87c400dcc0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 -- 172.21.15.42:0/686517425 shutdown_connections 2024-09-16T01:54:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87b806c2b0 0x7f87b806e770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87d415b340 0x7f87d409b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87d40b4e80 0x7f87d4147820 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 --2- 172.21.15.42:0/686517425 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f87d40b43f0 0x7f87d41f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 -- 172.21.15.42:0/686517425 >> 172.21.15.42:0/686517425 conn(0x7f87d4073490 msgr2=0x7f87d4158810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 -- 172.21.15.42:0/686517425 shutdown_connections 2024-09-16T01:54:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:28.520+0000 7f87dc6c9640 1 -- 172.21.15.42:0/686517425 wait complete. 2024-09-16T01:54:28.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:54:21.197115+0000', 'modified': '2024-09-16T01:54:26.227748+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34157}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34157': {'gid': 34157, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.107:6837/2229527903', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6835', 'nonce': 2229527903}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 2229527903}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 34157, 'qdb_cluster': [34157]} 2024-09-16T01:54:28.935 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:54:28.935 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-16T01:54:29.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.038+0000 7fc1328eb640 1 Processor -- start 2024-09-16T01:54:29.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.038+0000 7fc1328eb640 1 -- start start 2024-09-16T01:54:29.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc1328eb640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc12c15e5f0 0x7fc12c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc1328eb640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc12c0b6690 0x7fc12c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc1328eb640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc12c0d3690 con 0x7fc12c0d30f0 2024-09-16T01:54:29.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc1328eb640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fc12c06d530 con 0x7fc12c0b6690 2024-09-16T01:54:29.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc1328eb640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc12c0d3970 con 0x7fc12c15e5f0 2024-09-16T01:54:29.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc130e88640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc12c0b6690 0x7fc12c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc130e88640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc12c0b6690 0x7fc12c06d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55030/0 (socket says 172.21.15.42:55030) 2024-09-16T01:54:29.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc130e88640 1 -- 172.21.15.42:0/761671764 learned_addr learned my addr 172.21.15.42:0/761671764 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:29.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc130e88640 1 -- 172.21.15.42:0/761671764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc12c15e5f0 msgr2=0x7fc12c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc130e88640 1 --2- 172.21.15.42:0/761671764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc12c15e5f0 0x7fc12c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.039+0000 7fc130e88640 1 -- 172.21.15.42:0/761671764 >> v1:172.21.15.107:6789/0 conn(0x7fc12c0d30f0 legacy=0x7fc12c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.040+0000 7fc130e88640 1 -- 172.21.15.42:0/761671764 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12c06cee0 con 0x7fc12c0b6690 2024-09-16T01:54:29.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.040+0000 7fc130e88640 1 --2- 172.21.15.42:0/761671764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c0b6690 0x7fc12c06d9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc124009e50 tx=0x7fc12402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf09229b8567ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:29.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.040+0000 7fc12affd640 1 -- 172.21.15.42:0/761671764 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124036070 con 0x7fc12c0b6690 2024-09-16T01:54:29.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.040+0000 7fc12affd640 1 -- 172.21.15.42:0/761671764 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc124031600 con 0x7fc12c0b6690 2024-09-16T01:54:29.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.040+0000 7fc12affd640 1 -- 172.21.15.42:0/761671764 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1240319d0 con 0x7fc12c0b6690 2024-09-16T01:54:29.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.041+0000 7fc1328eb640 1 -- 172.21.15.42:0/761671764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c0b6690 msgr2=0x7fc12c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.041+0000 7fc1328eb640 1 --2- 172.21.15.42:0/761671764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c0b6690 0x7fc12c06d9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc124009e50 tx=0x7fc12402a6c0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.041+0000 7fc1328eb640 1 -- 172.21.15.42:0/761671764 shutdown_connections 2024-09-16T01:54:29.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.041+0000 7fc1328eb640 1 --2- 172.21.15.42:0/761671764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c0b6690 0x7fc12c06d9c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.041+0000 7fc1328eb640 1 --2- 172.21.15.42:0/761671764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc12c15e5f0 0x7fc12c0d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.041+0000 7fc1328eb640 1 -- 172.21.15.42:0/761671764 >> 172.21.15.42:0/761671764 conn(0x7fc12c08bfc0 msgr2=0x7fc12c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:29.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.041+0000 7fc1328eb640 1 -- 172.21.15.42:0/761671764 shutdown_connections 2024-09-16T01:54:29.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.041+0000 7fc1328eb640 1 -- 172.21.15.42:0/761671764 wait complete. 2024-09-16T01:54:29.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.042+0000 7fc1328eb640 1 Processor -- start 2024-09-16T01:54:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.042+0000 7fc1328eb640 1 -- start start 2024-09-16T01:54:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc1328eb640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc12c0b6690 0x7fc12c15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc1328eb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc12c0d30f0 0x7fc12c1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc1328eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c15e5f0 0x7fc12c15f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc1328eb640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c0d5310 con 0x7fc12c15e5f0 2024-09-16T01:54:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc1328eb640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c15e9d0 con 0x7fc12c0d30f0 2024-09-16T01:54:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc1328eb640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc12c06df00 con 0x7fc12c0b6690 2024-09-16T01:54:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc130e88640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c15e5f0 0x7fc12c15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc130e88640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c15e5f0 0x7fc12c15f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55046/0 (socket says 172.21.15.42:55046) 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc130e88640 1 -- 172.21.15.42:0/1763535322 learned_addr learned my addr 172.21.15.42:0/1763535322 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc12b7fe640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc12c0d30f0 0x7fc12c1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.043+0000 7fc12bfff640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc12c0b6690 0x7fc12c15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc130e88640 1 -- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc12c0b6690 msgr2=0x7fc12c15ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc130e88640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc12c0b6690 0x7fc12c15ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc130e88640 1 -- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc12c0d30f0 msgr2=0x7fc12c1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc130e88640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc12c0d30f0 0x7fc12c1529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc130e88640 1 -- 172.21.15.42:0/1763535322 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12c152f30 con 0x7fc12c15e5f0 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc12bfff640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc12c0b6690 0x7fc12c15ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc130e88640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c15e5f0 0x7fc12c15f400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc124034040 tx=0x7fc124004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc128ff9640 1 -- 172.21.15.42:0/1763535322 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124041020 con 0x7fc12c15e5f0 2024-09-16T01:54:29.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc128ff9640 1 -- 172.21.15.42:0/1763535322 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1240077a0 con 0x7fc12c15e5f0 2024-09-16T01:54:29.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc1328eb640 1 -- 172.21.15.42:0/1763535322 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc12c0b8bf0 con 0x7fc12c15e5f0 2024-09-16T01:54:29.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc128ff9640 1 -- 172.21.15.42:0/1763535322 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124036040 con 0x7fc12c15e5f0 2024-09-16T01:54:29.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.044+0000 7fc1328eb640 1 -- 172.21.15.42:0/1763535322 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc12c0b91b0 con 0x7fc12c15e5f0 2024-09-16T01:54:29.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.046+0000 7fc128ff9640 1 -- 172.21.15.42:0/1763535322 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc124044020 con 0x7fc12c15e5f0 2024-09-16T01:54:29.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.046+0000 7fc128ff9640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc11806c2e0 0x7fc11806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.046+0000 7fc128ff9640 1 -- 172.21.15.42:0/1763535322 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc1240ac4e0 con 0x7fc12c15e5f0 2024-09-16T01:54:29.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.046+0000 7fc12bfff640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc11806c2e0 0x7fc11806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.047+0000 7fc12bfff640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc11806c2e0 0x7fc11806e7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009890 tx=0x7fc11c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.047+0000 7fc13568a740 1 Processor -- start 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.047+0000 7fc13568a740 1 -- start start 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc13568a740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a8302c0 0x55d01a875a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc13568a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a82da80 0x55d01a8306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc13568a740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a831a50 0x55d01a82a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc13568a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d01a792520 con 0x55d01a82da80 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc13568a740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d01a73a3e0 con 0x55d01a8302c0 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc13568a740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55d01a78e4e0 con 0x55d01a831a50 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc12b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a82da80 0x55d01a8306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc12b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a82da80 0x55d01a8306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55060/0 (socket says 172.21.15.42:55060) 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc12b7fe640 1 -- 172.21.15.42:0/15813290 learned_addr learned my addr 172.21.15.42:0/15813290 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc130e88640 1 --2- 172.21.15.42:0/15813290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a831a50 0x55d01a82a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc12bfff640 1 --2- 172.21.15.42:0/15813290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a8302c0 0x55d01a875a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc12b7fe640 1 -- 172.21.15.42:0/15813290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a831a50 msgr2=0x55d01a82a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc12b7fe640 1 --2- 172.21.15.42:0/15813290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a831a50 0x55d01a82a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc12b7fe640 1 -- 172.21.15.42:0/15813290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a8302c0 msgr2=0x55d01a875a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc12b7fe640 1 --2- 172.21.15.42:0/15813290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a8302c0 0x55d01a875a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc12b7fe640 1 -- 172.21.15.42:0/15813290 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01a7552f0 con 0x55d01a82da80 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc12b7fe640 1 --2- 172.21.15.42:0/15813290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a82da80 0x55d01a8306a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc120004fd0 tx=0x7fc120005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f90c5b5f53d2f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc111ffb640 1 -- 172.21.15.42:0/15813290 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc120018030 con 0x55d01a82da80 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc111ffb640 1 -- 172.21.15.42:0/15813290 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12000fa80 con 0x55d01a82da80 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.048+0000 7fc111ffb640 1 -- 172.21.15.42:0/15813290 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12000fc70 con 0x55d01a82da80 2024-09-16T01:54:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.049+0000 7fc13568a740 1 -- 172.21.15.42:0/15813290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a82da80 msgr2=0x55d01a8306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.049+0000 7fc13568a740 1 --2- 172.21.15.42:0/15813290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a82da80 0x55d01a8306a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc120004fd0 tx=0x7fc120005490 comp rx=0 tx=0).stop 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.049+0000 7fc13568a740 1 -- 172.21.15.42:0/15813290 shutdown_connections 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.049+0000 7fc13568a740 1 --2- 172.21.15.42:0/15813290 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a831a50 0x55d01a82a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.049+0000 7fc13568a740 1 --2- 172.21.15.42:0/15813290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a82da80 0x55d01a8306a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.049+0000 7fc13568a740 1 --2- 172.21.15.42:0/15813290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a8302c0 0x55d01a875a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.049+0000 7fc13568a740 1 -- 172.21.15.42:0/15813290 >> 172.21.15.42:0/15813290 conn(0x55d01a82ca80 msgr2=0x55d01a874f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.049+0000 7fc13568a740 1 -- 172.21.15.42:0/15813290 shutdown_connections 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.049+0000 7fc13568a740 1 -- 172.21.15.42:0/15813290 wait complete. 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.050+0000 7fc13568a740 1 -- start start 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.050+0000 7fc13568a740 1 Processor -- start 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc13568a740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a8302c0 0x55d01a846af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc13568a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a831a50 0x55d01a857dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc13568a740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a858300 0x55d01a85a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc13568a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d01a82bf20 con 0x55d01a831a50 2024-09-16T01:54:29.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc13568a740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d01a71b450 con 0x55d01a858300 2024-09-16T01:54:29.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc13568a740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55d01a876290 con 0x55d01a8302c0 2024-09-16T01:54:29.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc13568a740 10 client.0 _ll_register_callbacks cb 0x55d01a4a4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:54:29.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc12b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a831a50 0x55d01a857dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc12b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a831a50 0x55d01a857dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55070/0 (socket says 172.21.15.42:55070) 2024-09-16T01:54:29.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc12b7fe640 1 -- 172.21.15.42:0/611958961 learned_addr learned my addr 172.21.15.42:0/611958961 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:29.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc12bfff640 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a8302c0 0x55d01a846af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc130e88640 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a858300 0x55d01a85a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc12b7fe640 1 -- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a8302c0 msgr2=0x55d01a846af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc12b7fe640 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a8302c0 0x55d01a846af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc12b7fe640 1 -- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a858300 msgr2=0x55d01a85a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc12b7fe640 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a858300 0x55d01a85a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc12b7fe640 1 -- 172.21.15.42:0/611958961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d01a4a52d0 con 0x55d01a831a50 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc130e88640 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a858300 0x55d01a85a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc12b7fe640 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a831a50 0x55d01a857dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc120007ca0 tx=0x7fc1200036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da79f4f68f9e6358 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc10affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc10affd640 1 -- 172.21.15.42:0/611958961 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc120006d90 con 0x55d01a831a50 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc10affd640 1 -- 172.21.15.42:0/611958961 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc120025df0 con 0x55d01a831a50 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc13568a740 1 -- 172.21.15.42:0/611958961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc12000fa80 con 0x55d01a831a50 2024-09-16T01:54:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.051+0000 7fc10affd640 1 -- 172.21.15.42:0/611958961 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fc12002c050 con 0x55d01a831a50 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc13568a740 10 client.4401 fetch_fsmap learned FSMap version 6 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc13568a740 1 -- 172.21.15.42:0/611958961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55d01a56f6b0 con 0x55d01a831a50 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc10affd640 1 -- 172.21.15.42:0/611958961 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12000fa80 con 0x55d01a831a50 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc10affd640 1 -- 172.21.15.42:0/611958961 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7fc12002f020 con 0x55d01a831a50 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc13568a740 10 client.4401 fetch_fsmap finished waiting for FSMap version 6 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc13568a740 10 client.4401 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc13568a740 20 client.4401 populate_metadata read hostname 'smithi042' 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc13568a740 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x55d01a851bf0 0x55d01a870000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc13568a740 4 client.4401 mds_command: new command op to 34157 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc13568a740 1 -- 172.21.15.42:0/611958961 --> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d01a79fc50 con 0x55d01a851bf0 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.052+0000 7fc12bfff640 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x55d01a851bf0 0x55d01a870000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.053+0000 7fc10affd640 10 client.4401 ms_handle_connect on v2:172.21.15.107:6835/2229527903 2024-09-16T01:54:29.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.053+0000 7fc12bfff640 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x55d01a851bf0 0x55d01a870000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1b7b059de59cb80 server_cookie=3ce0dc9229df7b98 in_seq=0 out_seq=0 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.053+0000 7fc10affd640 1 -- 172.21.15.42:0/611958961 <== mds.0 v2:172.21.15.107:6835/2229527903 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d01a79fc50 con 0x55d01a851bf0 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.053+0000 7fc10affd640 10 client.4401 handle_command_reply: tid=0 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.053+0000 7fc13568a740 1 client.4401 shutdown 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 1 -- 172.21.15.42:0/611958961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a831a50 msgr2=0x55d01a857dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a831a50 0x55d01a857dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc120007ca0 tx=0x7fc1200036f0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 1 -- 172.21.15.42:0/611958961 shutdown_connections 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x55d01a851bf0 0x55d01a870000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a858300 0x55d01a85a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a831a50 0x55d01a857dc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc10affd640 0 client.4401 ms_handle_reset on v2:172.21.15.107:6835/2229527903 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 1 --2- 172.21.15.42:0/611958961 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a8302c0 0x55d01a846af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 1 -- 172.21.15.42:0/611958961 >> 172.21.15.42:0/611958961 conn(0x55d01a82da80 msgr2=0x55d01a872ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:29.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 1 -- 172.21.15.42:0/611958961 shutdown_connections 2024-09-16T01:54:29.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 1 -- 172.21.15.42:0/611958961 wait complete. 2024-09-16T01:54:29.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.054+0000 7fc13568a740 20 client.4401 trim_cache size 0 max 16384 2024-09-16T01:54:29.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.072+0000 7fc13568a740 1 Processor -- start 2024-09-16T01:54:29.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.072+0000 7fc13568a740 1 -- start start 2024-09-16T01:54:29.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.072+0000 7fc13568a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a872770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.072+0000 7fc13568a740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a831a50 0x55d01a899220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.072+0000 7fc13568a740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a858300 0x55d01a856360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.072+0000 7fc13568a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c201180 con 0x55d01a8302c0 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.072+0000 7fc13568a740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c2004e0 con 0x55d01a831a50 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.072+0000 7fc13568a740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc12c200b30 con 0x55d01a858300 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc12bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a872770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc12bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a872770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55086/0 (socket says 172.21.15.42:55086) 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc12bfff640 1 -- 172.21.15.42:0/302660877 learned_addr learned my addr 172.21.15.42:0/302660877 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc12bfff640 1 -- 172.21.15.42:0/302660877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a858300 msgr2=0x55d01a856360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc12bfff640 1 --2- 172.21.15.42:0/302660877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a858300 0x55d01a856360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc12bfff640 1 -- 172.21.15.42:0/302660877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a831a50 msgr2=0x55d01a899220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc12bfff640 1 --2- 172.21.15.42:0/302660877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a831a50 0x55d01a899220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc12bfff640 1 -- 172.21.15.42:0/302660877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01a79db30 con 0x55d01a8302c0 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc12bfff640 1 --2- 172.21.15.42:0/302660877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a872770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55d01a859530 tx=0x7fc11c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4cf885cb6c86caa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc1117fa640 1 -- 172.21.15.42:0/302660877 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c031070 con 0x55d01a8302c0 2024-09-16T01:54:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc1117fa640 1 -- 172.21.15.42:0/302660877 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11c0144f0 con 0x55d01a8302c0 2024-09-16T01:54:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.073+0000 7fc1117fa640 1 -- 172.21.15.42:0/302660877 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0146a0 con 0x55d01a8302c0 2024-09-16T01:54:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.074+0000 7fc13568a740 1 -- 172.21.15.42:0/302660877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 msgr2=0x55d01a872770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.074+0000 7fc13568a740 1 --2- 172.21.15.42:0/302660877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a872770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55d01a859530 tx=0x7fc11c013000 comp rx=0 tx=0).stop 2024-09-16T01:54:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.074+0000 7fc13568a740 1 -- 172.21.15.42:0/302660877 shutdown_connections 2024-09-16T01:54:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.074+0000 7fc13568a740 1 --2- 172.21.15.42:0/302660877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a858300 0x55d01a856360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.074+0000 7fc13568a740 1 --2- 172.21.15.42:0/302660877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a831a50 0x55d01a899220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.074+0000 7fc13568a740 1 --2- 172.21.15.42:0/302660877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a872770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.074+0000 7fc13568a740 1 -- 172.21.15.42:0/302660877 >> 172.21.15.42:0/302660877 conn(0x55d01a82da80 msgr2=0x55d01a826100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:29.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.074+0000 7fc13568a740 1 -- 172.21.15.42:0/302660877 shutdown_connections 2024-09-16T01:54:29.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.074+0000 7fc13568a740 1 -- 172.21.15.42:0/302660877 wait complete. 2024-09-16T01:54:29.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.074+0000 7fc13568a740 1 -- start start 2024-09-16T01:54:29.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc13568a740 1 Processor -- start 2024-09-16T01:54:29.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc13568a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a8f3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc13568a740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a831a50 0x55d01a874df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc13568a740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a858300 0x55d01a875330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc13568a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d01a851a70 con 0x55d01a8302c0 2024-09-16T01:54:29.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc13568a740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55d01a847030 con 0x55d01a831a50 2024-09-16T01:54:29.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc13568a740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55d01a852000 con 0x55d01a858300 2024-09-16T01:54:29.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc13568a740 10 client.0 _ll_register_callbacks cb 0x7fc120004dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:54:29.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc12bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a8f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc12bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a8f3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55090/0 (socket says 172.21.15.42:55090) 2024-09-16T01:54:29.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc12bfff640 1 -- 172.21.15.42:0/2395369680 learned_addr learned my addr 172.21.15.42:0/2395369680 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:29.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.075+0000 7fc12b7fe640 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a831a50 0x55d01a874df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc130e88640 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a858300 0x55d01a875330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc12bfff640 1 -- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a858300 msgr2=0x55d01a875330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc12bfff640 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a858300 0x55d01a875330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc12bfff640 1 -- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a831a50 msgr2=0x55d01a874df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc12bfff640 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a831a50 0x55d01a874df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc12bfff640 1 -- 172.21.15.42:0/2395369680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d01a889d00 con 0x55d01a8302c0 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc12bfff640 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a8f3150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009750 tx=0x7fc11c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152acbdd84b19de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc10affd640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc10affd640 1 -- 172.21.15.42:0/2395369680 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c031070 con 0x55d01a8302c0 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc10affd640 1 -- 172.21.15.42:0/2395369680 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc11c00f040 con 0x55d01a8302c0 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc13568a740 1 -- 172.21.15.42:0/2395369680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc11c0144f0 con 0x55d01a8302c0 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc10affd640 1 -- 172.21.15.42:0/2395369680 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fc11c015dc0 con 0x55d01a8302c0 2024-09-16T01:54:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc13568a740 10 client.4407 fetch_fsmap learned FSMap version 6 2024-09-16T01:54:29.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc13568a740 1 -- 172.21.15.42:0/2395369680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55d01a8f4d20 con 0x55d01a8302c0 2024-09-16T01:54:29.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc10affd640 1 -- 172.21.15.42:0/2395369680 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11c0144f0 con 0x55d01a8302c0 2024-09-16T01:54:29.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc10affd640 1 -- 172.21.15.42:0/2395369680 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7fc11c013070 con 0x55d01a8302c0 2024-09-16T01:54:29.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc13568a740 10 client.4407 fetch_fsmap finished waiting for FSMap version 6 2024-09-16T01:54:29.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc13568a740 10 client.4407 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:54:29.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc13568a740 20 client.4407 populate_metadata read hostname 'smithi042' 2024-09-16T01:54:29.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc13568a740 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x55d01a8557c0 0x55d01a8f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc13568a740 4 client.4407 mds_command: new command op to 34157 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:54:29.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.076+0000 7fc13568a740 1 -- 172.21.15.42:0/2395369680 --> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] -- command(tid 0: {"prefix": "status"}) -- 0x55d01a799fa0 con 0x55d01a8557c0 2024-09-16T01:54:29.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc12b7fe640 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x55d01a8557c0 0x55d01a8f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc12b7fe640 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x55d01a8557c0 0x55d01a8f3ca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39a0f036837211aa server_cookie=9a3e94221be6e33c in_seq=0 out_seq=0 2024-09-16T01:54:29.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc10affd640 10 client.4407 ms_handle_connect on v2:172.21.15.107:6835/2229527903 2024-09-16T01:54:29.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc10affd640 1 -- 172.21.15.42:0/2395369680 <== mds.0 v2:172.21.15.107:6835/2229527903 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d01a799fa0 con 0x55d01a8557c0 2024-09-16T01:54:29.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc10affd640 10 client.4407 handle_command_reply: tid=0 2024-09-16T01:54:29.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc13568a740 1 client.4407 shutdown 2024-09-16T01:54:29.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc13568a740 1 -- 172.21.15.42:0/2395369680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 msgr2=0x55d01a8f3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc13568a740 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a8f3150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009750 tx=0x7fc11c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc13568a740 1 -- 172.21.15.42:0/2395369680 shutdown_connections 2024-09-16T01:54:29.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc13568a740 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x55d01a8557c0 0x55d01a8f3ca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc13568a740 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55d01a858300 0x55d01a875330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc13568a740 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d01a831a50 0x55d01a874df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc13568a740 1 --2- 172.21.15.42:0/2395369680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d01a8302c0 0x55d01a8f3150 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc13568a740 1 -- 172.21.15.42:0/2395369680 >> 172.21.15.42:0/2395369680 conn(0x55d01a82da80 msgr2=0x55d01a854680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:29.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc10affd640 0 client.4407 ms_handle_reset on v2:172.21.15.107:6835/2229527903 2024-09-16T01:54:29.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.077+0000 7fc13568a740 1 -- 172.21.15.42:0/2395369680 shutdown_connections 2024-09-16T01:54:29.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc13568a740 1 -- 172.21.15.42:0/2395369680 wait complete. 2024-09-16T01:54:29.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc13568a740 20 client.4407 trim_cache size 0 max 16384 2024-09-16T01:54:29.088 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:54:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "356ce71f-2ad9-4fe3-af21-266c510b09c8", 2024-09-16T01:54:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-16T01:54:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 34157, 2024-09-16T01:54:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-16T01:54:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-16T01:54:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-16T01:54:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 7.2385813649999999, 2024-09-16T01:54:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 6, 2024-09-16T01:54:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 25, 2024-09-16T01:54:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 25, 2024-09-16T01:54:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 13.249511807999999 2024-09-16T01:54:29.089 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 -- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc11806c2e0 msgr2=0x7fc11806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc11806c2e0 0x7fc11806e7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009890 tx=0x7fc11c008040 comp rx=0 tx=0).stop 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 -- 172.21.15.42:0/1763535322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c15e5f0 msgr2=0x7fc12c15f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c15e5f0 0x7fc12c15f400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc124034040 tx=0x7fc124004a40 comp rx=0 tx=0).stop 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 -- 172.21.15.42:0/1763535322 shutdown_connections 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc11806c2e0 0x7fc11806e7a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc12c15e5f0 0x7fc12c15f400 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc12c0d30f0 0x7fc12c1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 --2- 172.21.15.42:0/1763535322 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc12c0b6690 0x7fc12c15ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 -- 172.21.15.42:0/1763535322 >> 172.21.15.42:0/1763535322 conn(0x7fc12c08bfc0 msgr2=0x7fc12c06e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 -- 172.21.15.42:0/1763535322 shutdown_connections 2024-09-16T01:54:29.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.078+0000 7fc1328eb640 1 -- 172.21.15.42:0/1763535322 wait complete. 2024-09-16T01:54:29.092 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:54:29.092 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:54:29.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:54:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.194+0000 7fd3dd986640 1 Processor -- start 2024-09-16T01:54:29.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.194+0000 7fd3dd986640 1 -- start start 2024-09-16T01:54:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3dd986640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d8161c80 0x7fd3d806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3dd986640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd3d80b6680 0x7fd3d80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3dd986640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3d806e870 con 0x7fd3d8162060 2024-09-16T01:54:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3dd986640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd3d806d9f0 con 0x7fd3d80b6680 2024-09-16T01:54:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3dd986640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d806dcd0 con 0x7fd3d8161c80 2024-09-16T01:54:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3ce7fc640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd3d8162060 0x7fd3d80b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56994/0 (socket says 172.21.15.42:56994) 2024-09-16T01:54:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3ce7fc640 1 -- 172.21.15.42:0/1764186963 learned_addr learned my addr 172.21.15.42:0/1764186963 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3d77fe640 1 --2- 172.21.15.42:0/1764186963 >> v2:172.21.15.107:3300/0 conn(0x7fd3d80b6680 0x7fd3d80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3d6ffd640 1 --2- 172.21.15.42:0/1764186963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d8161c80 0x7fd3d806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3d67fc640 1 -- 172.21.15.42:0/1764186963 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107923907 0 0) 0x7fd3c0001110 con 0x7fd3d8162060 2024-09-16T01:54:29.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3d67fc640 1 -- 172.21.15.42:0/1764186963 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3c4003520 con 0x7fd3d8162060 2024-09-16T01:54:29.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3d77fe640 1 -- 172.21.15.42:0/1764186963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d8161c80 msgr2=0x7fd3d806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:29.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3d77fe640 1 --2- 172.21.15.42:0/1764186963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d8161c80 0x7fd3d806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3d77fe640 1 -- 172.21.15.42:0/1764186963 >> v1:172.21.15.42:6789/0 conn(0x7fd3d8162060 legacy=0x7fd3d80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3d67fc640 1 -- 172.21.15.42:0/1764186963 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1649105275 0 0) 0x7fd3c4003520 con 0x7fd3d8162060 2024-09-16T01:54:29.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.195+0000 7fd3d77fe640 1 -- 172.21.15.42:0/1764186963 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d806dfb0 con 0x7fd3d80b6680 2024-09-16T01:54:29.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.196+0000 7fd3d77fe640 1 --2- 172.21.15.42:0/1764186963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d80b6680 0x7fd3d80cf1e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009d90 tx=0x7fd3d002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc160b5626305f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.196+0000 7fd3d67fc640 1 -- 172.21.15.42:0/1764186963 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0001840 con 0x7fd3d80b6680 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.196+0000 7fd3d67fc640 1 -- 172.21.15.42:0/1764186963 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d0007540 con 0x7fd3d80b6680 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.196+0000 7fd3d67fc640 1 -- 172.21.15.42:0/1764186963 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0007910 con 0x7fd3d80b6680 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.197+0000 7fd3dd986640 1 -- 172.21.15.42:0/1764186963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d80b6680 msgr2=0x7fd3d80cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.197+0000 7fd3dd986640 1 --2- 172.21.15.42:0/1764186963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d80b6680 0x7fd3d80cf1e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009d90 tx=0x7fd3d002a5f0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.197+0000 7fd3dd986640 1 -- 172.21.15.42:0/1764186963 shutdown_connections 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.197+0000 7fd3dd986640 1 --2- 172.21.15.42:0/1764186963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d80b6680 0x7fd3d80cf1e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.197+0000 7fd3dd986640 1 --2- 172.21.15.42:0/1764186963 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d8161c80 0x7fd3d806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.197+0000 7fd3dd986640 1 -- 172.21.15.42:0/1764186963 >> 172.21.15.42:0/1764186963 conn(0x7fd3d80d44f0 msgr2=0x7fd3d80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.197+0000 7fd3dd986640 1 -- 172.21.15.42:0/1764186963 shutdown_connections 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.197+0000 7fd3dd986640 1 -- 172.21.15.42:0/1764186963 wait complete. 2024-09-16T01:54:29.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.198+0000 7fd3dd986640 1 Processor -- start 2024-09-16T01:54:29.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.198+0000 7fd3dd986640 1 -- start start 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3dd986640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d80b6680 0x7fd3d80b9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3dd986640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3d8161c80 0x7fd3d80ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3dd986640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d8162060 0x7fd3d8155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3dd986640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d80b6b30 con 0x7fd3d8161c80 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3dd986640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d80d2aa0 con 0x7fd3d8162060 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3dd986640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d80b6cb0 con 0x7fd3d80b6680 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3ce7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3d8161c80 0x7fd3d80ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3ce7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3d8161c80 0x7fd3d80ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55092/0 (socket says 172.21.15.42:55092) 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3ce7fc640 1 -- 172.21.15.42:0/2841284509 learned_addr learned my addr 172.21.15.42:0/2841284509 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3d6ffd640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d80b6680 0x7fd3d80b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3d77fe640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d8162060 0x7fd3d8155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3ce7fc640 1 -- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d80b6680 msgr2=0x7fd3d80b9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3ce7fc640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d80b6680 0x7fd3d80b9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3ce7fc640 1 -- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d8162060 msgr2=0x7fd3d8155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3ce7fc640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d8162060 0x7fd3d8155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3ce7fc640 1 -- 172.21.15.42:0/2841284509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d8156070 con 0x7fd3d8161c80 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3d6ffd640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d80b6680 0x7fd3d80b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.199+0000 7fd3d77fe640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d8162060 0x7fd3d8155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.200+0000 7fd3ce7fc640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3d8161c80 0x7fd3d80ccca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c750 tx=0x7fd3c000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.200+0000 7fd3d4ff9640 1 -- 172.21.15.42:0/2841284509 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0017070 con 0x7fd3d8161c80 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.200+0000 7fd3d4ff9640 1 -- 172.21.15.42:0/2841284509 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c0005ad0 con 0x7fd3d8161c80 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.200+0000 7fd3dd986640 1 -- 172.21.15.42:0/2841284509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d80cd410 con 0x7fd3d8161c80 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.200+0000 7fd3d4ff9640 1 -- 172.21.15.42:0/2841284509 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0007070 con 0x7fd3d8161c80 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.200+0000 7fd3dd986640 1 -- 172.21.15.42:0/2841284509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d80cb810 con 0x7fd3d8161c80 2024-09-16T01:54:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.201+0000 7fd3dd986640 1 -- 172.21.15.42:0/2841284509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d806e330 con 0x7fd3d8161c80 2024-09-16T01:54:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.201+0000 7fd3d4ff9640 1 -- 172.21.15.42:0/2841284509 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd3c001a070 con 0x7fd3d8161c80 2024-09-16T01:54:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.202+0000 7fd3d4ff9640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3b806c2e0 0x7fd3b806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.202+0000 7fd3d4ff9640 1 -- 172.21.15.42:0/2841284509 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd3c008aa50 con 0x7fd3d8161c80 2024-09-16T01:54:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.202+0000 7fd3d6ffd640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3b806c2e0 0x7fd3b806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.203+0000 7fd3d6ffd640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3b806c2e0 0x7fd3b806e7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009a20 tx=0x7fd3c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:29.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.207+0000 7fd3d4ff9640 1 -- 172.21.15.42:0/2841284509 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3d8156070 con 0x7fd3d8161c80 2024-09-16T01:54:29.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.416+0000 7fd3dd986640 1 -- 172.21.15.42:0/2841284509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd3d80b3c30 con 0x7fd3d8161c80 2024-09-16T01:54:29.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.417+0000 7fd3d4ff9640 1 -- 172.21.15.42:0/2841284509 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fd3d806e870 con 0x7fd3d8161c80 2024-09-16T01:54:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:54:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 -- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3b806c2e0 msgr2=0x7fd3b806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3b806c2e0 0x7fd3b806e7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009a20 tx=0x7fd3c8008040 comp rx=0 tx=0).stop 2024-09-16T01:54:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 -- 172.21.15.42:0/2841284509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3d8161c80 msgr2=0x7fd3d80ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3d8161c80 0x7fd3d80ccca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c750 tx=0x7fd3c000cc10 comp rx=0 tx=0).stop 2024-09-16T01:54:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 -- 172.21.15.42:0/2841284509 shutdown_connections 2024-09-16T01:54:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3b806c2e0 0x7fd3b806e7a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3d8162060 0x7fd3d8155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3d8161c80 0x7fd3d80ccca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 --2- 172.21.15.42:0/2841284509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3d80b6680 0x7fd3d80b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 -- 172.21.15.42:0/2841284509 >> 172.21.15.42:0/2841284509 conn(0x7fd3d80d44f0 msgr2=0x7fd3d806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 -- 172.21.15.42:0/2841284509 shutdown_connections 2024-09-16T01:54:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29.419+0000 7fd3dd986640 1 -- 172.21.15.42:0/2841284509 wait complete. 2024-09-16T01:54:29.431 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:54:29.431 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:54:29.431 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-16T01:54:29.431 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-16T01:54:29.431 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:54:29.432 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:54:29.432 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:54:29.432 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:54:29.432 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-16T01:54:29.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:29.433 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-16T01:54:29.449 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:54:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-16T01:54:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-16T01:54:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42785sec preferred_lft 42785sec 2024-09-16T01:54:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-16T01:54:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:29.451 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-16T01:54:29.452 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T01:54:29.452 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:29.452 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:29.452 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2024-09-16T01:54:29.452 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2024-09-16T01:54:29.452 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2024-09-16T01:54:29.452 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T01:54:29.452 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:29.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:29.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:29.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:29.678 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:54:29.705 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-16T01:54:29.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:29.707 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-16T01:54:29.775 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-16T01:54:29.775 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:54:29.776 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-16T01:54:29.776 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-16T01:54:29.776 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:54:29.776 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:29.776 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:29.776 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-16T01:54:29.777 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-16T01:54:29.777 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-16T01:54:29.777 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:29.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:30.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:30.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:30.085 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-16T01:54:30.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:30.103 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-09-16T01:54:30.158 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:30.158 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:30.158 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:54:30.158 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-16T01:54:30.159 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:30.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:30.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:30.281 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-16T01:54:30.281 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:30.281 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:30.281 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-16T01:54:30.281 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T01:54:30.281 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-16T01:54:30.281 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-16T01:54:30.281 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-16T01:54:30.281 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:30.410 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:30.410 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:30.410 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-16T01:54:30.411 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T01:54:30.411 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:30.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:30.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:30.489 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-16T01:54:30.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:54:30.490 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:54:30.508 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-16T01:54:30.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:54:30.509 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:54:30.566 DEBUG:teuthology.orchestra.run.smithi042:> sudo modprobe fuse 2024-09-16T01:54:30.633 DEBUG:teuthology.orchestra.run.smithi042:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T01:54:30.690 INFO:teuthology.orchestra.run.smithi042.stdout:/proc 2024-09-16T01:54:30.690 INFO:teuthology.orchestra.run.smithi042.stdout:/sys 2024-09-16T01:54:30.690 INFO:teuthology.orchestra.run.smithi042.stdout:/dev 2024-09-16T01:54:30.690 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/security 2024-09-16T01:54:30.690 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/shm 2024-09-16T01:54:30.690 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/pts 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/run 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/cgroup 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/pstore 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/bpf 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/ 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/selinux 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/hugepages 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/mqueue 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/debug 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/tracing 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/fuse/connections 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T01:54:30.691 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/config 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/run/user/1000 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-0 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-1 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-2 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-3 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:54:30.692 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:54:30.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:30.693 DEBUG:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2024-09-16T01:54:30.745 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-16T01:54:30.746 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-16T01:54:30.788 DEBUG:teuthology.orchestra.run.smithi042:> sudo modprobe fuse 2024-09-16T01:54:30.814 DEBUG:teuthology.orchestra.run.smithi042:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T01:54:30.871 INFO:teuthology.orchestra.run.smithi042.stdout:/proc 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/sys 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/dev 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/security 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/shm 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/pts 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/run 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/cgroup 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/pstore 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/bpf 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/ 2024-09-16T01:54:30.872 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/selinux 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/hugepages 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/mqueue 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/debug 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/tracing 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/fs/fuse/connections 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/sys/kernel/config 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/run/user/1000 2024-09-16T01:54:30.873 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph 2024-09-16T01:54:30.874 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-0 2024-09-16T01:54:30.874 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-1 2024-09-16T01:54:30.874 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-2 2024-09-16T01:54:30.874 INFO:teuthology.orchestra.run.smithi042.stdout:/var/lib/ceph/osd/ceph-3 2024-09-16T01:54:30.874 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns 2024-09-16T01:54:30.874 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:54:30.874 INFO:teuthology.orchestra.run.smithi042.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:54:30.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:30.874 DEBUG:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2024-09-16T01:54:30.883 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:2024-09-16T01:54:30.882+0000 7fc337121480 -1 init, newargv = 0x5633eaed3930 newargc=15 2024-09-16T01:54:30.884 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:ceph-fuse[42772]: starting ceph client 2024-09-16T01:54:30.890 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:ceph-fuse[42772]: starting fuse 2024-09-16T01:54:30.901 INFO:teuthology.orchestra.run.smithi042.stdout:41 2024-09-16T01:54:30.901 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-16T01:54:30.901 DEBUG:teuthology.orchestra.run.smithi042:> sudo stdin-killer -- python3 -c ' 2024-09-16T01:54:30.901 DEBUG:teuthology.orchestra.run.smithi042:> import glob 2024-09-16T01:54:30.901 DEBUG:teuthology.orchestra.run.smithi042:> import re 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> import subprocess 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> def _find_admin_socket(client_name): 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> files = glob.glob(asok_path) 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> # Given a non-glob path, it better be there 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> if "*" not in asok_path: 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> assert(len(files) == 1) 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> return files[0] 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> for f in files: 2024-09-16T01:54:30.902 DEBUG:teuthology.orchestra.run.smithi042:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-16T01:54:30.903 DEBUG:teuthology.orchestra.run.smithi042:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-16T01:54:30.903 DEBUG:teuthology.orchestra.run.smithi042:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-16T01:54:30.903 DEBUG:teuthology.orchestra.run.smithi042:> contents = proc_f.read() 2024-09-16T01:54:30.903 DEBUG:teuthology.orchestra.run.smithi042:> if mountpoint in contents: 2024-09-16T01:54:30.903 DEBUG:teuthology.orchestra.run.smithi042:> return f 2024-09-16T01:54:30.903 DEBUG:teuthology.orchestra.run.smithi042:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-16T01:54:30.903 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:54:30.903 DEBUG:teuthology.orchestra.run.smithi042:> print(_find_admin_socket("client.admin")) 2024-09-16T01:54:30.903 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-16T01:54:31.022 INFO:teuthology.orchestra.run.smithi042.stdout:/var/run/ceph/ceph-client.admin.42772.asok 2024-09-16T01:54:31.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:31.032 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42772.asok 2024-09-16T01:54:31.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:31.032 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42772.asok status 2024-09-16T01:54:31.169 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:54:31.169 INFO:teuthology.orchestra.run.smithi042.stdout: "metadata": { 2024-09-16T01:54:31.169 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "entity_id": "admin", 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": "smithi042", 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "pid": "42772", 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "root": "/" 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_count": 0, 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_pinned_count": 0, 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4419, 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "inst": { 2024-09-16T01:54:31.170 INFO:teuthology.orchestra.run.smithi042.stdout: "name": { 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "client", 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: "num": 4419 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "192.168.0.1:0", 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1374917066 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "192.168.0.1:0", 2024-09-16T01:54:31.171 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1374917066 2024-09-16T01:54:31.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:54:31.172 INFO:teuthology.orchestra.run.smithi042.stdout: "inst_str": "client.4419 192.168.0.1:0/1374917066", 2024-09-16T01:54:31.172 INFO:teuthology.orchestra.run.smithi042.stdout: "addr_str": "192.168.0.1:0/1374917066", 2024-09-16T01:54:31.172 INFO:teuthology.orchestra.run.smithi042.stdout: "inode_count": 1, 2024-09-16T01:54:31.172 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_epoch": 6, 2024-09-16T01:54:31.172 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch": 25, 2024-09-16T01:54:31.172 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch_barrier": 0, 2024-09-16T01:54:31.172 INFO:teuthology.orchestra.run.smithi042.stdout: "blocklisted": false, 2024-09-16T01:54:31.172 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs" 2024-09-16T01:54:31.172 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:54:31.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:31.178 DEBUG:teuthology.orchestra.run.smithi042:> stat --file-system '--printf=%T 2024-09-16T01:54:31.178 DEBUG:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:54:31.194 INFO:teuthology.orchestra.run.smithi042.stdout:fuseblk 2024-09-16T01:54:31.194 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:54:31.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:31.195 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:54:31.262 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-16T01:54:31.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:31.371 INFO:teuthology.orchestra.run.smithi042.stdout:# file: . 2024-09-16T01:54:31.371 INFO:teuthology.orchestra.run.smithi042.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-16T01:54:31.371 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:31.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:31.377 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:54:31.377 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:54:31.393 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:54:31.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.535+0000 7f47bf77f640 1 Processor -- start 2024-09-16T01:54:31.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.535+0000 7f47bf77f640 1 -- start start 2024-09-16T01:54:31.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.536+0000 7f47bf77f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b8162060 0x7f47b80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.536+0000 7f47bf77f640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b806d9f0 con 0x7f47b8161c80 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.536+0000 7f47bf77f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b806dcd0 con 0x7f47b80b64b0 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.536+0000 7f47bf77f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f47b806dfb0 con 0x7f47b8162060 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.536+0000 7f47bd51b640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f47b8161c80 0x7f47b806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57006/0 (socket says 172.21.15.42:57006) 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.536+0000 7f47bd51b640 1 -- 172.21.15.42:0/3717023549 learned_addr learned my addr 172.21.15.42:0/3717023549 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.536+0000 7f47bcd1a640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b8162060 0x7f47b80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.536+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2127977939 0 0) 0x7f47b806d9f0 con 0x7f47b8161c80 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.536+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47a4003520 con 0x7f47b8161c80 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1824704828 0 0) 0x7f47a4003520 con 0x7f47b8161c80 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b8162060 msgr2=0x7f47b80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b8162060 0x7f47b80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 >> v1:172.21.15.107:6789/0 conn(0x7f47b80b64b0 legacy=0x7f47b80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b80d2890 con 0x7f47b8161c80 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f47b4001670 con 0x7f47b8161c80 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 >> v1:172.21.15.42:6789/0 conn(0x7f47b8161c80 legacy=0x7f47b806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47a40039e0 0x7f47a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 0x7f47a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b8162060 0x7f47a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47b806dfb0 con 0x7f47a4004800 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f47a400baa0 con 0x7f47a40039e0 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f47a400bca0 con 0x7f47b8162060 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47bcd1a640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 0x7f47a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47bd51b640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47a40039e0 0x7f47a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47bdd1c640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b8162060 0x7f47a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47bcd1a640 1 -- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b8162060 msgr2=0x7f47a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47bcd1a640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b8162060 0x7f47a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47bcd1a640 1 -- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47a40039e0 msgr2=0x7f47a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47bcd1a640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47a40039e0 0x7f47a4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.537+0000 7f47bcd1a640 1 -- 172.21.15.42:0/3717023549 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a4003520 con 0x7f47a4004800 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.538+0000 7f47bcd1a640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 0x7f47a4004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47b80cb570 tx=0x7f47a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9631912a479f1b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.538+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8036070 con 0x7f47a4004800 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.538+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a8031400 con 0x7f47a4004800 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.538+0000 7f47affff640 1 -- 172.21.15.42:0/3717023549 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8009690 con 0x7f47a4004800 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.539+0000 7f47bf77f640 1 -- 172.21.15.42:0/3717023549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 msgr2=0x7f47a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.539+0000 7f47bf77f640 1 --2- 172.21.15.42:0/3717023549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 0x7f47a4004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47b80cb570 tx=0x7f47a4005830 comp rx=0 tx=0).stop 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.539+0000 7f47bdd1c640 1 -- 172.21.15.42:0/3717023549 reap_dead start 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.539+0000 7f47bf77f640 1 -- 172.21.15.42:0/3717023549 shutdown_connections 2024-09-16T01:54:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.539+0000 7f47bf77f640 1 -- 172.21.15.42:0/3717023549 >> 172.21.15.42:0/3717023549 conn(0x7f47b80d44f0 msgr2=0x7f47b80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:31.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.539+0000 7f47bf77f640 1 -- 172.21.15.42:0/3717023549 shutdown_connections 2024-09-16T01:54:31.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.539+0000 7f47bf77f640 1 -- 172.21.15.42:0/3717023549 wait complete. 2024-09-16T01:54:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.540+0000 7f47bf77f640 1 Processor -- start 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.540+0000 7f47bf77f640 1 -- start start 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bf77f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 0x7f47b80c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bf77f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b8159e20 0x7f47b81590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bf77f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b81598f0 0x7f47b815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bf77f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80b6300 con 0x7f47a4004800 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bf77f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80b6180 con 0x7f47b8159e20 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bf77f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f47b80c7fc0 con 0x7f47b81598f0 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bd51b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 0x7f47b80c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bd51b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 0x7f47b80c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55116/0 (socket says 172.21.15.42:55116) 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bd51b640 1 -- 172.21.15.42:0/604316959 learned_addr learned my addr 172.21.15.42:0/604316959 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bcd1a640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b8159e20 0x7f47b81590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bdd1c640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b81598f0 0x7f47b815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bd51b640 1 -- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b81598f0 msgr2=0x7f47b815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bd51b640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b81598f0 0x7f47b815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bd51b640 1 -- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b8159e20 msgr2=0x7f47b81590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bd51b640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b8159e20 0x7f47b81590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bd51b640 1 -- 172.21.15.42:0/604316959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b80b9340 con 0x7f47a4004800 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.541+0000 7f47bd51b640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 0x7f47b80c8cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f47b4007290 tx=0x7f47b4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.542+0000 7f47adffb640 1 -- 172.21.15.42:0/604316959 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b400f960 con 0x7f47a4004800 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.542+0000 7f47adffb640 1 -- 172.21.15.42:0/604316959 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b4018070 con 0x7f47a4004800 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.542+0000 7f47bf77f640 1 -- 172.21.15.42:0/604316959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b80c8210 con 0x7f47a4004800 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.542+0000 7f47adffb640 1 -- 172.21.15.42:0/604316959 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b400fd20 con 0x7f47a4004800 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.542+0000 7f47bf77f640 1 -- 172.21.15.42:0/604316959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b80c87d0 con 0x7f47a4004800 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.543+0000 7f47bf77f640 1 -- 172.21.15.42:0/604316959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b80d2a60 con 0x7f47a4004800 2024-09-16T01:54:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.543+0000 7f47adffb640 1 -- 172.21.15.42:0/604316959 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f47b401d460 con 0x7f47a4004800 2024-09-16T01:54:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.544+0000 7f47adffb640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f479c06c2b0 0x7f479c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.544+0000 7f47adffb640 1 -- 172.21.15.42:0/604316959 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f47b408b890 con 0x7f47a4004800 2024-09-16T01:54:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.544+0000 7f47bcd1a640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f479c06c2b0 0x7f479c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.545+0000 7f47bcd1a640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f479c06c2b0 0x7f479c06e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47a8033000 tx=0x7f47a8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.548+0000 7f47adffb640 1 -- 172.21.15.42:0/604316959 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47b4059cc0 con 0x7f47a4004800 2024-09-16T01:54:31.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.734+0000 7f47bf77f640 1 -- 172.21.15.42:0/604316959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f47b80b6960 con 0x7f47a4004800 2024-09-16T01:54:31.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.735+0000 7f47adffb640 1 -- 172.21.15.42:0/604316959 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f47b40595c0 con 0x7f47a4004800 2024-09-16T01:54:31.736 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-16T01:54:31.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 -- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f479c06c2b0 msgr2=0x7f479c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:31.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f479c06c2b0 0x7f479c06e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47a8033000 tx=0x7f47a8008030 comp rx=0 tx=0).stop 2024-09-16T01:54:31.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 -- 172.21.15.42:0/604316959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 msgr2=0x7f47b80c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:31.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 0x7f47b80c8cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f47b4007290 tx=0x7f47b4007750 comp rx=0 tx=0).stop 2024-09-16T01:54:31.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 -- 172.21.15.42:0/604316959 shutdown_connections 2024-09-16T01:54:31.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f479c06c2b0 0x7f479c06e770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f47b81598f0 0x7f47b815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b8159e20 0x7f47b81590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 --2- 172.21.15.42:0/604316959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47a4004800 0x7f47b80c8cf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 -- 172.21.15.42:0/604316959 >> 172.21.15.42:0/604316959 conn(0x7f47b80d44f0 msgr2=0x7f47b815fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:31.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 -- 172.21.15.42:0/604316959 shutdown_connections 2024-09-16T01:54:31.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.737+0000 7f47bf77f640 1 -- 172.21.15.42:0/604316959 wait complete. 2024-09-16T01:54:31.749 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:54:31.750 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:54:31.766 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:54:31.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.909+0000 7ff1b512a640 1 Processor -- start 2024-09-16T01:54:31.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.909+0000 7ff1b512a640 1 -- start start 2024-09-16T01:54:31.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1b512a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1b015e5b0 0x7ff1b00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1b512a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff1b015e990 0x7ff1b00b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1b512a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff1b00ae140 0x7ff1b00ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1b512a640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff1b00aeb30 con 0x7ff1b00ae140 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1b512a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff1b00b6520 con 0x7ff1b015e990 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1b512a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b00b1a40 con 0x7ff1b015e5b0 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1af59e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff1b00ae140 0x7ff1b00ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1af59e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff1b00ae140 0x7ff1b00ae5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55130/0 (socket says 172.21.15.42:55130) 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1af59e640 1 -- 172.21.15.42:0/2240871097 learned_addr learned my addr 172.21.15.42:0/2240871097 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1aed9d640 1 --2- 172.21.15.42:0/2240871097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1b015e5b0 0x7ff1b00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1ae59c640 1 --2- 172.21.15.42:0/2240871097 >> v2:172.21.15.107:3300/0 conn(0x7ff1b015e990 0x7ff1b00b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1af59e640 1 -- 172.21.15.42:0/2240871097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1b015e5b0 msgr2=0x7ff1b00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1af59e640 1 --2- 172.21.15.42:0/2240871097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1b015e5b0 0x7ff1b00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1af59e640 1 -- 172.21.15.42:0/2240871097 >> v2:172.21.15.107:3300/0 conn(0x7ff1b015e990 msgr2=0x7ff1b00b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1af59e640 1 --2- 172.21.15.42:0/2240871097 >> v2:172.21.15.107:3300/0 conn(0x7ff1b015e990 0x7ff1b00b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.910+0000 7ff1af59e640 1 -- 172.21.15.42:0/2240871097 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b00b1d20 con 0x7ff1b00ae140 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.911+0000 7ff1af59e640 1 --2- 172.21.15.42:0/2240871097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 0x7ff1b00ae5f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0068930 tx=0x7ff1a802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f657e7d8b110de8d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.911+0000 7ff1add9b640 1 -- 172.21.15.42:0/2240871097 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8036070 con 0x7ff1b00ae140 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.911+0000 7ff1add9b640 1 -- 172.21.15.42:0/2240871097 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a8031600 con 0x7ff1b00ae140 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.911+0000 7ff1add9b640 1 -- 172.21.15.42:0/2240871097 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80319d0 con 0x7ff1b00ae140 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.912+0000 7ff1b512a640 1 -- 172.21.15.42:0/2240871097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 msgr2=0x7ff1b00ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.912+0000 7ff1b512a640 1 --2- 172.21.15.42:0/2240871097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 0x7ff1b00ae5f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0068930 tx=0x7ff1a802a6a0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.912+0000 7ff1b512a640 1 -- 172.21.15.42:0/2240871097 shutdown_connections 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.912+0000 7ff1b512a640 1 --2- 172.21.15.42:0/2240871097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 0x7ff1b00ae5f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.912+0000 7ff1b512a640 1 --2- 172.21.15.42:0/2240871097 >> v2:172.21.15.107:3300/0 conn(0x7ff1b015e990 0x7ff1b00b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.912+0000 7ff1b512a640 1 --2- 172.21.15.42:0/2240871097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1b015e5b0 0x7ff1b00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.912+0000 7ff1b512a640 1 -- 172.21.15.42:0/2240871097 >> 172.21.15.42:0/2240871097 conn(0x7ff1b0073490 msgr2=0x7ff1b00b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.912+0000 7ff1b512a640 1 -- 172.21.15.42:0/2240871097 shutdown_connections 2024-09-16T01:54:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.912+0000 7ff1b512a640 1 -- 172.21.15.42:0/2240871097 wait complete. 2024-09-16T01:54:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.913+0000 7ff1b512a640 1 Processor -- start 2024-09-16T01:54:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.913+0000 7ff1b512a640 1 -- start start 2024-09-16T01:54:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1b512a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 0x7ff1b014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1b512a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b015e5b0 0x7ff1b00ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1b512a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1b015e990 0x7ff1b009b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1b512a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00b2a60 con 0x7ff1b00ae140 2024-09-16T01:54:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1b512a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00b0490 con 0x7ff1b015e5b0 2024-09-16T01:54:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1b512a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b00b2be0 con 0x7ff1b015e990 2024-09-16T01:54:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1aed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 0x7ff1b014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1aed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 0x7ff1b014ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55138/0 (socket says 172.21.15.42:55138) 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1aed9d640 1 -- 172.21.15.42:0/2463518887 learned_addr learned my addr 172.21.15.42:0/2463518887 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1ae59c640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b015e5b0 0x7ff1b00ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.914+0000 7ff1af59e640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1b015e990 0x7ff1b009b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1aed9d640 1 -- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1b015e990 msgr2=0x7ff1b009b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1aed9d640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1b015e990 0x7ff1b009b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1aed9d640 1 -- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b015e5b0 msgr2=0x7ff1b00ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1aed9d640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b015e5b0 0x7ff1b00ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1aed9d640 1 -- 172.21.15.42:0/2463518887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b014f290 con 0x7ff1b00ae140 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1ae59c640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b015e5b0 0x7ff1b00ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1aed9d640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 0x7ff1b014ed50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000e890 tx=0x7ff1a000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1977fe640 1 -- 172.21.15.42:0/2463518887 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0017070 con 0x7ff1b00ae140 2024-09-16T01:54:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1977fe640 1 -- 172.21.15.42:0/2463518887 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a000c940 con 0x7ff1b00ae140 2024-09-16T01:54:31.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1b512a640 1 -- 172.21.15.42:0/2463518887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b009d330 con 0x7ff1b00ae140 2024-09-16T01:54:31.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1977fe640 1 -- 172.21.15.42:0/2463518887 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a000cd10 con 0x7ff1b00ae140 2024-09-16T01:54:31.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.915+0000 7ff1b512a640 1 -- 172.21.15.42:0/2463518887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b009d8f0 con 0x7ff1b00ae140 2024-09-16T01:54:31.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.916+0000 7ff1b512a640 1 -- 172.21.15.42:0/2463518887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b0068e10 con 0x7ff1b00ae140 2024-09-16T01:54:31.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.917+0000 7ff1977fe640 1 -- 172.21.15.42:0/2463518887 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff1a001a070 con 0x7ff1b00ae140 2024-09-16T01:54:31.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.917+0000 7ff1977fe640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff19c06c2b0 0x7ff19c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:31.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.917+0000 7ff1977fe640 1 -- 172.21.15.42:0/2463518887 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff1a008b620 con 0x7ff1b00ae140 2024-09-16T01:54:31.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.917+0000 7ff1ae59c640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff19c06c2b0 0x7ff19c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:31.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.918+0000 7ff1ae59c640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff19c06c2b0 0x7ff19c06e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff1b009f190 tx=0x7ff1a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:31.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:31.921+0000 7ff1977fe640 1 -- 172.21.15.42:0/2463518887 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1b0068e10 con 0x7ff1b00ae140 2024-09-16T01:54:32.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.109+0000 7ff1b512a640 1 -- 172.21.15.42:0/2463518887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff1b0070470 con 0x7ff1b00ae140 2024-09-16T01:54:32.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.109+0000 7ff1977fe640 1 -- 172.21.15.42:0/2463518887 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ff1a0059490 con 0x7ff1b00ae140 2024-09-16T01:54:32.111 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-16T01:54:32.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.111+0000 7ff1b512a640 1 -- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff19c06c2b0 msgr2=0x7ff19c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:32.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.111+0000 7ff1b512a640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff19c06c2b0 0x7ff19c06e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff1b009f190 tx=0x7ff1a4008040 comp rx=0 tx=0).stop 2024-09-16T01:54:32.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.111+0000 7ff1b512a640 1 -- 172.21.15.42:0/2463518887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 msgr2=0x7ff1b014ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:32.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.111+0000 7ff1b512a640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 0x7ff1b014ed50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000e890 tx=0x7ff1a000ed50 comp rx=0 tx=0).stop 2024-09-16T01:54:32.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.111+0000 7ff1b512a640 1 -- 172.21.15.42:0/2463518887 shutdown_connections 2024-09-16T01:54:32.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.111+0000 7ff1b512a640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff19c06c2b0 0x7ff19c06e770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:32.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.111+0000 7ff1b512a640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff1b015e990 0x7ff1b009b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:32.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.111+0000 7ff1b512a640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b015e5b0 0x7ff1b00ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:32.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.111+0000 7ff1b512a640 1 --2- 172.21.15.42:0/2463518887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1b00ae140 0x7ff1b014ed50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:32.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.111+0000 7ff1b512a640 1 -- 172.21.15.42:0/2463518887 >> 172.21.15.42:0/2463518887 conn(0x7ff1b0073490 msgr2=0x7ff1b00aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:32.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.112+0000 7ff1b512a640 1 -- 172.21.15.42:0/2463518887 shutdown_connections 2024-09-16T01:54:32.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:32.112+0000 7ff1b512a640 1 -- 172.21.15.42:0/2463518887 wait complete. 2024-09-16T01:54:32.124 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi042.front.sepia.ceph.com... 2024-09-16T01:54:32.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:32.124 DEBUG:teuthology.orchestra.run.smithi042:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:54:32.148 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:ceph-fuse[42772]: fuse finished with error 0 and tester_r 0 2024-09-16T01:54:32.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:54:38.254 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:54:38.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:38.255 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-16T01:54:38.284 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:38.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.436+0000 7f7adcced640 1 Processor -- start 2024-09-16T01:54:38.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.436+0000 7f7adcced640 1 -- start start 2024-09-16T01:54:38.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.437+0000 7f7adcced640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7ad80d1090 0x7f7ad809b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.437+0000 7f7adcced640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80b1620 0x7f7ad80b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.437+0000 7f7adcced640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad80cec00 con 0x7f7ad815c520 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.437+0000 7f7adcced640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad809bd90 con 0x7f7ad80d1090 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.437+0000 7f7adcced640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad80d0010 con 0x7f7ad80b1620 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.438+0000 7f7ad6d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80b1620 0x7f7ad80b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.438+0000 7f7ad5d9b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7ad80d1090 0x7f7ad809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.438+0000 7f7ad6d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80b1620 0x7f7ad80b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45196/0 (socket says 172.21.15.42:45196) 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.438+0000 7f7ad6d9d640 1 -- 172.21.15.42:0/1237562851 learned_addr learned my addr 172.21.15.42:0/1237562851 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.438+0000 7f7ad659c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7ad815c520 0x7f7ad80d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:50910/0 (socket says 172.21.15.42:50910) 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.438+0000 7f7ad6d9d640 1 -- 172.21.15.42:0/1237562851 >> v2:172.21.15.107:3300/0 conn(0x7f7ad80d1090 msgr2=0x7f7ad809b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.438+0000 7f7ad6d9d640 1 --2- 172.21.15.42:0/1237562851 >> v2:172.21.15.107:3300/0 conn(0x7f7ad80d1090 0x7f7ad809b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.438+0000 7f7ad6d9d640 1 -- 172.21.15.42:0/1237562851 >> v1:172.21.15.107:6789/0 conn(0x7f7ad815c520 legacy=0x7f7ad80d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.438+0000 7f7ad6d9d640 1 -- 172.21.15.42:0/1237562851 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad80d02f0 con 0x7f7ad80b1620 2024-09-16T01:54:38.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.438+0000 7f7ad5d9b640 1 --2- 172.21.15.42:0/1237562851 >> v2:172.21.15.107:3300/0 conn(0x7f7ad80d1090 0x7f7ad809b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:38.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.439+0000 7f7ad6d9d640 1 --2- 172.21.15.42:0/1237562851 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80b1620 0x7f7ad80b1d40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009870 tx=0x7f7ad002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947588cb0efbcf81 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:38.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.439+0000 7f7ad559a640 1 -- 172.21.15.42:0/1237562851 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0037070 con 0x7f7ad80b1620 2024-09-16T01:54:38.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.439+0000 7f7ad559a640 1 -- 172.21.15.42:0/1237562851 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad0032440 con 0x7f7ad80b1620 2024-09-16T01:54:38.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.439+0000 7f7ad559a640 1 -- 172.21.15.42:0/1237562851 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0032810 con 0x7f7ad80b1620 2024-09-16T01:54:38.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.440+0000 7f7adcced640 1 -- 172.21.15.42:0/1237562851 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80b1620 msgr2=0x7f7ad80b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.440+0000 7f7adcced640 1 --2- 172.21.15.42:0/1237562851 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80b1620 0x7f7ad80b1d40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009870 tx=0x7f7ad002a270 comp rx=0 tx=0).stop 2024-09-16T01:54:38.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.440+0000 7f7adcced640 1 -- 172.21.15.42:0/1237562851 shutdown_connections 2024-09-16T01:54:38.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.440+0000 7f7adcced640 1 --2- 172.21.15.42:0/1237562851 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80b1620 0x7f7ad80b1d40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.440+0000 7f7adcced640 1 --2- 172.21.15.42:0/1237562851 >> v2:172.21.15.107:3300/0 conn(0x7f7ad80d1090 0x7f7ad809b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.440+0000 7f7adcced640 1 -- 172.21.15.42:0/1237562851 >> 172.21.15.42:0/1237562851 conn(0x7f7ad80d23a0 msgr2=0x7f7ad80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:38.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.440+0000 7f7adcced640 1 -- 172.21.15.42:0/1237562851 shutdown_connections 2024-09-16T01:54:38.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.440+0000 7f7adcced640 1 -- 172.21.15.42:0/1237562851 wait complete. 2024-09-16T01:54:38.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.441+0000 7f7adcced640 1 Processor -- start 2024-09-16T01:54:38.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.441+0000 7f7adcced640 1 -- start start 2024-09-16T01:54:38.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7adcced640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ad80b1620 0x7f7ad80c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7adcced640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80d1090 0x7f7ad81538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7adcced640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ad815c520 0x7f7ad80cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7adcced640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad815c900 con 0x7f7ad80b1620 2024-09-16T01:54:38.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7adcced640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad80d05d0 con 0x7f7ad815c520 2024-09-16T01:54:38.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7adcced640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad80c97e0 con 0x7f7ad80d1090 2024-09-16T01:54:38.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7ad659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ad80b1620 0x7f7ad80c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7ad659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ad80b1620 0x7f7ad80c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52996/0 (socket says 172.21.15.42:52996) 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7ad659c640 1 -- 172.21.15.42:0/1024825689 learned_addr learned my addr 172.21.15.42:0/1024825689 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7ad5d9b640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80d1090 0x7f7ad81538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.442+0000 7f7ad6d9d640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ad815c520 0x7f7ad80cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ad659c640 1 -- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80d1090 msgr2=0x7f7ad81538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ad659c640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80d1090 0x7f7ad81538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ad659c640 1 -- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ad815c520 msgr2=0x7f7ad80cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ad659c640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ad815c520 0x7f7ad80cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ad659c640 1 -- 172.21.15.42:0/1024825689 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad80c9ac0 con 0x7f7ad80b1620 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ad5d9b640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80d1090 0x7f7ad81538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ad6d9d640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ad815c520 0x7f7ad80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ad659c640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ad80b1620 0x7f7ad80c64d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c730 tx=0x7f7ac800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:38.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ac6ffd640 1 -- 172.21.15.42:0/1024825689 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8017070 con 0x7f7ad80b1620 2024-09-16T01:54:38.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ac6ffd640 1 -- 172.21.15.42:0/1024825689 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac800ce40 con 0x7f7ad80b1620 2024-09-16T01:54:38.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7ac6ffd640 1 -- 172.21.15.42:0/1024825689 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800a860 con 0x7f7ad80b1620 2024-09-16T01:54:38.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7adcced640 1 -- 172.21.15.42:0/1024825689 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad80c9da0 con 0x7f7ad80b1620 2024-09-16T01:54:38.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.443+0000 7f7adcced640 1 -- 172.21.15.42:0/1024825689 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad80c9470 con 0x7f7ad80b1620 2024-09-16T01:54:38.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.444+0000 7f7adcced640 1 -- 172.21.15.42:0/1024825689 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad80b1d40 con 0x7f7ad80b1620 2024-09-16T01:54:38.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.445+0000 7f7ac6ffd640 1 -- 172.21.15.42:0/1024825689 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ac801a070 con 0x7f7ad80b1620 2024-09-16T01:54:38.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.445+0000 7f7ac6ffd640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ab806c2e0 0x7f7ab806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.445+0000 7f7ac6ffd640 1 -- 172.21.15.42:0/1024825689 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7ac808ac80 con 0x7f7ad80b1620 2024-09-16T01:54:38.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.446+0000 7f7ad5d9b640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ab806c2e0 0x7f7ab806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.446+0000 7f7ad5d9b640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ab806c2e0 0x7f7ab806e7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80ca590 tx=0x7f7acc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:38.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.450+0000 7f7ac6ffd640 1 -- 172.21.15.42:0/1024825689 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ac8058a70 con 0x7f7ad80b1620 2024-09-16T01:54:38.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.630+0000 7f7adcced640 1 -- 172.21.15.42:0/1024825689 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ad81f59f0 con 0x7f7ad80b1620 2024-09-16T01:54:38.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.631+0000 7f7ac6ffd640 1 -- 172.21.15.42:0/1024825689 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7f7ac805cd70 con 0x7f7ad80b1620 2024-09-16T01:54:38.634 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:38.634 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:38.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 -- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ab806c2e0 msgr2=0x7f7ab806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ab806c2e0 0x7f7ab806e7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80ca590 tx=0x7f7acc009190 comp rx=0 tx=0).stop 2024-09-16T01:54:38.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 -- 172.21.15.42:0/1024825689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ad80b1620 msgr2=0x7f7ad80c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ad80b1620 0x7f7ad80c64d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c730 tx=0x7f7ac800cbf0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 -- 172.21.15.42:0/1024825689 shutdown_connections 2024-09-16T01:54:38.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ab806c2e0 0x7f7ab806e7a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ad815c520 0x7f7ad80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7ad80d1090 0x7f7ad81538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 --2- 172.21.15.42:0/1024825689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ad80b1620 0x7f7ad80c64d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 -- 172.21.15.42:0/1024825689 >> 172.21.15.42:0/1024825689 conn(0x7f7ad80d23a0 msgr2=0x7f7ad80d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:38.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 -- 172.21.15.42:0/1024825689 shutdown_connections 2024-09-16T01:54:38.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.633+0000 7f7adcced640 1 -- 172.21.15.42:0/1024825689 wait complete. 2024-09-16T01:54:38.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:38.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.746+0000 7f1ba5d9f640 1 Processor -- start 2024-09-16T01:54:38.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.746+0000 7f1ba5d9f640 1 -- start start 2024-09-16T01:54:38.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.747+0000 7f1ba5d9f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1ba00b3760 0x7f1ba00b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.747+0000 7f1ba5d9f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 0x7f1ba0162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.747+0000 7f1ba5d9f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ba00b2790 con 0x7f1ba009aa30 2024-09-16T01:54:38.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.747+0000 7f1ba5d9f640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f1ba00d0670 con 0x7f1ba00b3760 2024-09-16T01:54:38.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.747+0000 7f1ba5d9f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba00b2a70 con 0x7f1ba006cd20 2024-09-16T01:54:38.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.747+0000 7f1b9effd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1ba00b3760 0x7f1ba00b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.747+0000 7f1b9effd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1ba00b3760 0x7f1ba00b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53010/0 (socket says 172.21.15.42:53010) 2024-09-16T01:54:38.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.747+0000 7f1b9effd640 1 -- 172.21.15.42:0/851240064 learned_addr learned my addr 172.21.15.42:0/851240064 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:38.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.748+0000 7f1b9ffff640 1 --2- 172.21.15.42:0/851240064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 0x7f1ba0162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.748+0000 7f1b9effd640 1 -- 172.21.15.42:0/851240064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 msgr2=0x7f1ba0162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:38.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.748+0000 7f1b9effd640 1 --2- 172.21.15.42:0/851240064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 0x7f1ba0162340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.748+0000 7f1b9effd640 1 -- 172.21.15.42:0/851240064 >> v1:172.21.15.107:6789/0 conn(0x7f1ba009aa30 legacy=0x7f1ba009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.748+0000 7f1b9effd640 1 -- 172.21.15.42:0/851240064 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba00b2d50 con 0x7f1ba00b3760 2024-09-16T01:54:38.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1b9effd640 1 --2- 172.21.15.42:0/851240064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 0x7f1ba00b3030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009870 tx=0x7f1b9402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113e110cbeaae819 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1b9e7fc640 1 -- 172.21.15.42:0/851240064 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94037070 con 0x7f1ba00b3760 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1b9e7fc640 1 -- 172.21.15.42:0/851240064 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b94032440 con 0x7f1ba00b3760 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1b9e7fc640 1 -- 172.21.15.42:0/851240064 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94032810 con 0x7f1ba00b3760 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/851240064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 msgr2=0x7f1ba00b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1ba5d9f640 1 --2- 172.21.15.42:0/851240064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 0x7f1ba00b3030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009870 tx=0x7f1b9402a1c0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/851240064 shutdown_connections 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1ba5d9f640 1 --2- 172.21.15.42:0/851240064 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 0x7f1ba0162340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1ba5d9f640 1 --2- 172.21.15.42:0/851240064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 0x7f1ba00b3030 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/851240064 >> 172.21.15.42:0/851240064 conn(0x7f1ba00d23a0 msgr2=0x7f1ba00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/851240064 shutdown_connections 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.749+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/851240064 wait complete. 2024-09-16T01:54:38.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.751+0000 7f1ba5d9f640 1 Processor -- start 2024-09-16T01:54:38.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.751+0000 7f1ba5d9f640 1 -- start start 2024-09-16T01:54:38.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.751+0000 7f1ba5d9f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 0x7f1ba00b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.751+0000 7f1ba5d9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ba009aa30 0x7f1ba0159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.751+0000 7f1ba5d9f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 0x7f1ba0160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.751+0000 7f1ba5d9f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba015fe20 con 0x7f1ba00b3760 2024-09-16T01:54:38.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.751+0000 7f1ba5d9f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba015fca0 con 0x7f1ba009aa30 2024-09-16T01:54:38.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.751+0000 7f1ba5d9f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba00d1fe0 con 0x7f1ba006cd20 2024-09-16T01:54:38.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 0x7f1ba0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 0x7f1ba0160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53024/0 (socket says 172.21.15.42:53024) 2024-09-16T01:54:38.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9ffff640 1 -- 172.21.15.42:0/1052182966 learned_addr learned my addr 172.21.15.42:0/1052182966 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9effd640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ba009aa30 0x7f1ba0159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9f7fe640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 0x7f1ba00b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9ffff640 1 -- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 msgr2=0x7f1ba00b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9ffff640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 0x7f1ba00b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9ffff640 1 -- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ba009aa30 msgr2=0x7f1ba0159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9ffff640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ba009aa30 0x7f1ba0159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9ffff640 1 -- 172.21.15.42:0/1052182966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba0161d30 con 0x7f1ba00b3760 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9f7fe640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 0x7f1ba00b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b9ffff640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 0x7f1ba0160030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b98007e40 tx=0x7f1b9800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b87fff640 1 -- 172.21.15.42:0/1052182966 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b98014620 con 0x7f1ba00b3760 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b87fff640 1 -- 172.21.15.42:0/1052182966 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b98019070 con 0x7f1ba00b3760 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/1052182966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba015d670 con 0x7f1ba00b3760 2024-09-16T01:54:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1b87fff640 1 -- 172.21.15.42:0/1052182966 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b98014a20 con 0x7f1ba00b3760 2024-09-16T01:54:38.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.752+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/1052182966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba015a370 con 0x7f1ba00b3760 2024-09-16T01:54:38.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.753+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/1052182966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba006e4f0 con 0x7f1ba00b3760 2024-09-16T01:54:38.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.754+0000 7f1b87fff640 1 -- 172.21.15.42:0/1052182966 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1b98014bc0 con 0x7f1ba00b3760 2024-09-16T01:54:38.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.754+0000 7f1b87fff640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b8c06c2e0 0x7f1b8c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:38.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.754+0000 7f1b87fff640 1 -- 172.21.15.42:0/1052182966 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1b9808bfb0 con 0x7f1ba00b3760 2024-09-16T01:54:38.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.754+0000 7f1b9f7fe640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b8c06c2e0 0x7f1b8c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:38.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.755+0000 7f1b9f7fe640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b8c06c2e0 0x7f1b8c06e7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1b90001700 tx=0x7f1b90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.758+0000 7f1b87fff640 1 -- 172.21.15.42:0/1052182966 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b9805a3f0 con 0x7f1ba00b3760 2024-09-16T01:54:38.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.935+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/1052182966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ba00b3030 con 0x7f1ba00b3760 2024-09-16T01:54:38.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.936+0000 7f1b87fff640 1 -- 172.21.15.42:0/1052182966 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7f1b98059cf0 con 0x7f1ba00b3760 2024-09-16T01:54:38.939 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:38.939 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:38.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.938+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b8c06c2e0 msgr2=0x7f1b8c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.938+0000 7f1ba5d9f640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b8c06c2e0 0x7f1b8c06e7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1b90001700 tx=0x7f1b90009040 comp rx=0 tx=0).stop 2024-09-16T01:54:38.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.938+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/1052182966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 msgr2=0x7f1ba0160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:38.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.938+0000 7f1ba5d9f640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 0x7f1ba0160030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b98007e40 tx=0x7f1b9800e4b0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.938+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/1052182966 shutdown_connections 2024-09-16T01:54:38.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.938+0000 7f1ba5d9f640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b8c06c2e0 0x7f1b8c06e7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.938+0000 7f1ba5d9f640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba00b3760 0x7f1ba0160030 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.938+0000 7f1ba5d9f640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ba009aa30 0x7f1ba0159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.938+0000 7f1ba5d9f640 1 --2- 172.21.15.42:0/1052182966 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1ba006cd20 0x7f1ba00b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:38.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.939+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/1052182966 >> 172.21.15.42:0/1052182966 conn(0x7f1ba00d23a0 msgr2=0x7f1ba015a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:38.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.939+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/1052182966 shutdown_connections 2024-09-16T01:54:38.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:38.939+0000 7f1ba5d9f640 1 -- 172.21.15.42:0/1052182966 wait complete. 2024-09-16T01:54:38.952 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:54:39.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.056+0000 7f9f05331640 1 Processor -- start 2024-09-16T01:54:39.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.056+0000 7f9f05331640 1 -- start start 2024-09-16T01:54:39.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9f05331640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9f0015e5a0 0x7f9f000cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:39.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9f05331640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9f0015e980 0x7f9f000d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9f05331640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f000d0df0 0x7f9f000d1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9f05331640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f9f000d1780 con 0x7f9f0015e5a0 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9f05331640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9f000d53f0 con 0x7f9f0015e980 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9f05331640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0006cd90 con 0x7f9f000d0df0 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9efeffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9f0015e5a0 0x7f9f000cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9efeffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9f0015e5a0 0x7f9f000cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53034/0 (socket says 172.21.15.42:53034) 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9efeffd640 1 -- 172.21.15.42:0/1533401274 learned_addr learned my addr 172.21.15.42:0/1533401274 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9efeffd640 1 -- 172.21.15.42:0/1533401274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f000d0df0 msgr2=0x7f9f000d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9ef67fc640 1 --2- 172.21.15.42:0/1533401274 >> v2:172.21.15.107:3300/0 conn(0x7f9f0015e980 0x7f9f000d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9efeffd640 1 --2- 172.21.15.42:0/1533401274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f000d0df0 0x7f9f000d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9efeffd640 1 -- 172.21.15.42:0/1533401274 >> v2:172.21.15.107:3300/0 conn(0x7f9f0015e980 msgr2=0x7f9f000d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9efeffd640 1 --2- 172.21.15.42:0/1533401274 >> v2:172.21.15.107:3300/0 conn(0x7f9f0015e980 0x7f9f000d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.057+0000 7f9efeffd640 1 -- 172.21.15.42:0/1533401274 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0006d070 con 0x7f9f0015e5a0 2024-09-16T01:54:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.058+0000 7f9efeffd640 1 --2- 172.21.15.42:0/1533401274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e5a0 0x7f9f000cfcd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9f000c7e30 tx=0x7f9ef002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7f1f1eddae4a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.058+0000 7f9efe7fc640 1 -- 172.21.15.42:0/1533401274 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0037070 con 0x7f9f0015e5a0 2024-09-16T01:54:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.058+0000 7f9efe7fc640 1 -- 172.21.15.42:0/1533401274 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef0032440 con 0x7f9f0015e5a0 2024-09-16T01:54:39.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.058+0000 7f9efe7fc640 1 -- 172.21.15.42:0/1533401274 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0032810 con 0x7f9f0015e5a0 2024-09-16T01:54:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.059+0000 7f9f05331640 1 -- 172.21.15.42:0/1533401274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e5a0 msgr2=0x7f9f000cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.059+0000 7f9f05331640 1 --2- 172.21.15.42:0/1533401274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e5a0 0x7f9f000cfcd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9f000c7e30 tx=0x7f9ef002a140 comp rx=0 tx=0).stop 2024-09-16T01:54:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.059+0000 7f9f05331640 1 -- 172.21.15.42:0/1533401274 shutdown_connections 2024-09-16T01:54:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.059+0000 7f9f05331640 1 --2- 172.21.15.42:0/1533401274 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f000d0df0 0x7f9f000d1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.059+0000 7f9f05331640 1 --2- 172.21.15.42:0/1533401274 >> v2:172.21.15.107:3300/0 conn(0x7f9f0015e980 0x7f9f000d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.059+0000 7f9f05331640 1 --2- 172.21.15.42:0/1533401274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e5a0 0x7f9f000cfcd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.059+0000 7f9f05331640 1 -- 172.21.15.42:0/1533401274 >> 172.21.15.42:0/1533401274 conn(0x7f9f0008bfc0 msgr2=0x7f9f000d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.059+0000 7f9f05331640 1 -- 172.21.15.42:0/1533401274 shutdown_connections 2024-09-16T01:54:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.059+0000 7f9f05331640 1 -- 172.21.15.42:0/1533401274 wait complete. 2024-09-16T01:54:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.060+0000 7f9f05331640 1 Processor -- start 2024-09-16T01:54:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.060+0000 7f9f05331640 1 -- start start 2024-09-16T01:54:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9f05331640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f000d0df0 0x7f9f00153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9f05331640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f0015e5a0 0x7f9f000c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9f05331640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e980 0x7f9f000ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9f05331640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0006d910 con 0x7f9f0015e980 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9f05331640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0006d630 con 0x7f9f000d0df0 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9f05331640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0006de30 con 0x7f9f0015e5a0 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9eff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e980 0x7f9f000ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9eff7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e980 0x7f9f000ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53036/0 (socket says 172.21.15.42:53036) 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9eff7fe640 1 -- 172.21.15.42:0/2397815651 learned_addr learned my addr 172.21.15.42:0/2397815651 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9ef67fc640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f0015e5a0 0x7f9f000c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9efeffd640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f000d0df0 0x7f9f00153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9eff7fe640 1 -- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f0015e5a0 msgr2=0x7f9f000c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9eff7fe640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f0015e5a0 0x7f9f000c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9eff7fe640 1 -- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f000d0df0 msgr2=0x7f9f00153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:39.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9eff7fe640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f000d0df0 0x7f9f00153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9eff7fe640 1 -- 172.21.15.42:0/2397815651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f000b76c0 con 0x7f9f0015e980 2024-09-16T01:54:39.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9eff7fe640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e980 0x7f9f000ca3b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800b970 tx=0x7f9ef800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:39.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.061+0000 7f9ef7fff640 1 -- 172.21.15.42:0/2397815651 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8019070 con 0x7f9f0015e980 2024-09-16T01:54:39.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.062+0000 7f9ef7fff640 1 -- 172.21.15.42:0/2397815651 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef800cb00 con 0x7f9f0015e980 2024-09-16T01:54:39.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.062+0000 7f9f05331640 1 -- 172.21.15.42:0/2397815651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f000c8890 con 0x7f9f0015e980 2024-09-16T01:54:39.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.062+0000 7f9ef7fff640 1 -- 172.21.15.42:0/2397815651 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8014440 con 0x7f9f0015e980 2024-09-16T01:54:39.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.062+0000 7f9f05331640 1 -- 172.21.15.42:0/2397815651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f000c8e50 con 0x7f9f0015e980 2024-09-16T01:54:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.063+0000 7f9f05331640 1 -- 172.21.15.42:0/2397815651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f000d1240 con 0x7f9f0015e980 2024-09-16T01:54:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.063+0000 7f9ef7fff640 1 -- 172.21.15.42:0/2397815651 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9ef801c070 con 0x7f9f0015e980 2024-09-16T01:54:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.063+0000 7f9ef7fff640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9ee006c2b0 0x7f9ee006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.064+0000 7f9ef7fff640 1 -- 172.21.15.42:0/2397815651 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9ef808b400 con 0x7f9f0015e980 2024-09-16T01:54:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.064+0000 7f9efeffd640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9ee006c2b0 0x7f9ee006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.064+0000 7f9efeffd640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9ee006c2b0 0x7f9ee006e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0034000 tx=0x7f9ef002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.068+0000 7f9ef7fff640 1 -- 172.21.15.42:0/2397815651 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ef80591e0 con 0x7f9f0015e980 2024-09-16T01:54:39.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.279+0000 7f9f05331640 1 -- 172.21.15.42:0/2397815651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9f000d1ba0 con 0x7f9f0015e980 2024-09-16T01:54:39.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.931+0000 7f9ef7fff640 1 -- 172.21.15.42:0/2397815651 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f9ef805d4e0 con 0x7f9f0015e980 2024-09-16T01:54:39.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.934+0000 7f9f05331640 1 -- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9ee006c2b0 msgr2=0x7f9ee006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:39.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.934+0000 7f9f05331640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9ee006c2b0 0x7f9ee006e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0034000 tx=0x7f9ef002e000 comp rx=0 tx=0).stop 2024-09-16T01:54:39.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.934+0000 7f9f05331640 1 -- 172.21.15.42:0/2397815651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e980 msgr2=0x7f9f000ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:39.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.934+0000 7f9f05331640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e980 0x7f9f000ca3b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800b970 tx=0x7f9ef800be30 comp rx=0 tx=0).stop 2024-09-16T01:54:39.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.935+0000 7f9f05331640 1 -- 172.21.15.42:0/2397815651 shutdown_connections 2024-09-16T01:54:39.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.935+0000 7f9f05331640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9ee006c2b0 0x7f9ee006e770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.935+0000 7f9f05331640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f0015e980 0x7f9f000ca3b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.935+0000 7f9f05331640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9f0015e5a0 0x7f9f000c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.935+0000 7f9f05331640 1 --2- 172.21.15.42:0/2397815651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f000d0df0 0x7f9f00153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:39.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.935+0000 7f9f05331640 1 -- 172.21.15.42:0/2397815651 >> 172.21.15.42:0/2397815651 conn(0x7f9f0008bfc0 msgr2=0x7f9f001545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:39.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.935+0000 7f9f05331640 1 -- 172.21.15.42:0/2397815651 shutdown_connections 2024-09-16T01:54:39.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:39.935+0000 7f9f05331640 1 -- 172.21.15.42:0/2397815651 wait complete. 2024-09-16T01:54:39.951 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-16T01:54:39.951 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:54:40.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.061+0000 7fc662f2c640 1 Processor -- start 2024-09-16T01:54:40.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.061+0000 7fc662f2c640 1 -- start start 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc662f2c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc65c162340 0x7fc65c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc662f2c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc65c0cf280 0x7fc65c162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc662f2c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc65c162c60 0x7fc65c0d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc662f2c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fc65c06de90 con 0x7fc65c162c60 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc662f2c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc65c15ff70 con 0x7fc65c162340 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc662f2c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc65c0d4d10 con 0x7fc65c0cf280 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc6614c9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc65c162c60 0x7fc65c0d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc6614c9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc65c162c60 0x7fc65c0d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53048/0 (socket says 172.21.15.42:53048) 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc6614c9640 1 -- 172.21.15.42:0/1310817990 learned_addr learned my addr 172.21.15.42:0/1310817990 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc660cc8640 1 --2- 172.21.15.42:0/1310817990 >> v2:172.21.15.107:3300/0 conn(0x7fc65c162340 0x7fc65c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc65bfff640 1 --2- 172.21.15.42:0/1310817990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc65c0cf280 0x7fc65c162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc6614c9640 1 -- 172.21.15.42:0/1310817990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc65c0cf280 msgr2=0x7fc65c162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc6614c9640 1 --2- 172.21.15.42:0/1310817990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc65c0cf280 0x7fc65c162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc6614c9640 1 -- 172.21.15.42:0/1310817990 >> v2:172.21.15.107:3300/0 conn(0x7fc65c162340 msgr2=0x7fc65c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc6614c9640 1 --2- 172.21.15.42:0/1310817990 >> v2:172.21.15.107:3300/0 conn(0x7fc65c162340 0x7fc65c06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.062+0000 7fc6614c9640 1 -- 172.21.15.42:0/1310817990 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65c0d4ff0 con 0x7fc65c162c60 2024-09-16T01:54:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.063+0000 7fc6614c9640 1 --2- 172.21.15.42:0/1310817990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c162c60 0x7fc65c0d2990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc65c08e4c0 tx=0x7fc65402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0be26f464f94a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.063+0000 7fc65b7fe640 1 -- 172.21.15.42:0/1310817990 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654036070 con 0x7fc65c162c60 2024-09-16T01:54:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.063+0000 7fc65b7fe640 1 -- 172.21.15.42:0/1310817990 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc654031600 con 0x7fc65c162c60 2024-09-16T01:54:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.063+0000 7fc65b7fe640 1 -- 172.21.15.42:0/1310817990 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540319d0 con 0x7fc65c162c60 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.063+0000 7fc662f2c640 1 -- 172.21.15.42:0/1310817990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c162c60 msgr2=0x7fc65c0d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.063+0000 7fc662f2c640 1 --2- 172.21.15.42:0/1310817990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c162c60 0x7fc65c0d2990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc65c08e4c0 tx=0x7fc65402a610 comp rx=0 tx=0).stop 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.064+0000 7fc662f2c640 1 -- 172.21.15.42:0/1310817990 shutdown_connections 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.064+0000 7fc662f2c640 1 --2- 172.21.15.42:0/1310817990 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc65c0cf280 0x7fc65c162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.064+0000 7fc662f2c640 1 --2- 172.21.15.42:0/1310817990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c162c60 0x7fc65c0d2990 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.064+0000 7fc662f2c640 1 --2- 172.21.15.42:0/1310817990 >> v2:172.21.15.107:3300/0 conn(0x7fc65c162340 0x7fc65c06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.064+0000 7fc662f2c640 1 -- 172.21.15.42:0/1310817990 >> 172.21.15.42:0/1310817990 conn(0x7fc65c08bfc0 msgr2=0x7fc65c0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.064+0000 7fc662f2c640 1 -- 172.21.15.42:0/1310817990 shutdown_connections 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.064+0000 7fc662f2c640 1 -- 172.21.15.42:0/1310817990 wait complete. 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.065+0000 7fc662f2c640 1 Processor -- start 2024-09-16T01:54:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.065+0000 7fc662f2c640 1 -- start start 2024-09-16T01:54:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc662f2c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c0cf280 0x7fc65c1ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc662f2c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc65c162340 0x7fc65c1ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc662f2c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc65c162c60 0x7fc65c15e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc662f2c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc65c0cf6c0 con 0x7fc65c0cf280 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc662f2c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc65c0d52d0 con 0x7fc65c162340 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc662f2c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc65c1630f0 con 0x7fc65c162c60 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc660cc8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c0cf280 0x7fc65c1ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc660cc8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c0cf280 0x7fc65c1ea360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53058/0 (socket says 172.21.15.42:53058) 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc660cc8640 1 -- 172.21.15.42:0/347431073 learned_addr learned my addr 172.21.15.42:0/347431073 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc65bfff640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc65c162340 0x7fc65c1ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc6614c9640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc65c162c60 0x7fc65c15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc660cc8640 1 -- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc65c162c60 msgr2=0x7fc65c15e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc660cc8640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc65c162c60 0x7fc65c15e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc660cc8640 1 -- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc65c162340 msgr2=0x7fc65c1ea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc660cc8640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc65c162340 0x7fc65c1ea8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc660cc8640 1 -- 172.21.15.42:0/347431073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65c0b7800 con 0x7fc65c0cf280 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc65bfff640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc65c162340 0x7fc65c1ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.066+0000 7fc660cc8640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c0cf280 0x7fc65c1ea360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc65000d5f0 tx=0x7fc65000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.067+0000 7fc6597fa640 1 -- 172.21.15.42:0/347431073 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6500125f0 con 0x7fc65c0cf280 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.067+0000 7fc6597fa640 1 -- 172.21.15.42:0/347431073 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc650019070 con 0x7fc65c0cf280 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.067+0000 7fc662f2c640 1 -- 172.21.15.42:0/347431073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc65c0b7ae0 con 0x7fc65c0cf280 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.067+0000 7fc6597fa640 1 -- 172.21.15.42:0/347431073 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6500129d0 con 0x7fc65c0cf280 2024-09-16T01:54:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.067+0000 7fc662f2c640 1 -- 172.21.15.42:0/347431073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc65c0b80a0 con 0x7fc65c0cf280 2024-09-16T01:54:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.068+0000 7fc662f2c640 1 -- 172.21.15.42:0/347431073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc65c162720 con 0x7fc65c0cf280 2024-09-16T01:54:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.068+0000 7fc6597fa640 1 -- 172.21.15.42:0/347431073 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc650012b70 con 0x7fc65c0cf280 2024-09-16T01:54:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.069+0000 7fc6597fa640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc64006c2b0 0x7fc64006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.069+0000 7fc6597fa640 1 -- 172.21.15.42:0/347431073 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc65008baa0 con 0x7fc65c0cf280 2024-09-16T01:54:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.069+0000 7fc65bfff640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc64006c2b0 0x7fc64006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.070+0000 7fc65bfff640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc64006c2b0 0x7fc64006e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc65c1eafc0 tx=0x7fc648008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.073+0000 7fc6597fa640 1 -- 172.21.15.42:0/347431073 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc650059f60 con 0x7fc65c0cf280 2024-09-16T01:54:40.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.287+0000 7fc662f2c640 1 -- 172.21.15.42:0/347431073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc65c0ba450 con 0x7fc65c0cf280 2024-09-16T01:54:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.936+0000 7fc6597fa640 1 -- 172.21.15.42:0/347431073 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fc650059860 con 0x7fc65c0cf280 2024-09-16T01:54:40.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 -- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc64006c2b0 msgr2=0x7fc64006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:40.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc64006c2b0 0x7fc64006e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc65c1eafc0 tx=0x7fc648008040 comp rx=0 tx=0).stop 2024-09-16T01:54:40.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 -- 172.21.15.42:0/347431073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c0cf280 msgr2=0x7fc65c1ea360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:40.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c0cf280 0x7fc65c1ea360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc65000d5f0 tx=0x7fc65000dab0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 -- 172.21.15.42:0/347431073 shutdown_connections 2024-09-16T01:54:40.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc64006c2b0 0x7fc64006e770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc65c162c60 0x7fc65c15e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc65c162340 0x7fc65c1ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 --2- 172.21.15.42:0/347431073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65c0cf280 0x7fc65c1ea360 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 -- 172.21.15.42:0/347431073 >> 172.21.15.42:0/347431073 conn(0x7fc65c08bfc0 msgr2=0x7fc65c0d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 -- 172.21.15.42:0/347431073 shutdown_connections 2024-09-16T01:54:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:40.939+0000 7fc662f2c640 1 -- 172.21.15.42:0/347431073 wait complete. 2024-09-16T01:54:40.954 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:54:40.954 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:54:41.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.061+0000 7f3998f16640 1 Processor -- start 2024-09-16T01:54:41.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.061+0000 7f3998f16640 1 -- start start 2024-09-16T01:54:41.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.061+0000 7f3998f16640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f39940d4330 0x7f39940d47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.061+0000 7f3998f16640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39940d1840 con 0x7f399415e260 2024-09-16T01:54:41.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.061+0000 7f3998f16640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39940d1b20 con 0x7f399415e640 2024-09-16T01:54:41.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.061+0000 7f3998f16640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f39940cf320 con 0x7f39940d4330 2024-09-16T01:54:41.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.062+0000 7f3993fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f39940d4330 0x7f39940d47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.062+0000 7f39937fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f399415e260 0x7f39940cfb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45358/0 (socket says 172.21.15.42:45358) 2024-09-16T01:54:41.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.062+0000 7f39937fe640 1 -- 172.21.15.42:0/3758134361 learned_addr learned my addr 172.21.15.42:0/3758134361 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:41.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.062+0000 7f3993fff640 1 -- 172.21.15.42:0/3758134361 >> v1:172.21.15.107:6789/0 conn(0x7f399415e640 legacy=0x7f399406d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.062+0000 7f3993fff640 1 -- 172.21.15.42:0/3758134361 >> v1:172.21.15.42:6789/0 conn(0x7f399415e260 legacy=0x7f39940cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.062+0000 7f39927fc640 1 -- 172.21.15.42:0/3758134361 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 376769207 0 0) 0x7f39940d1840 con 0x7f399415e260 2024-09-16T01:54:41.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.062+0000 7f3993fff640 1 -- 172.21.15.42:0/3758134361 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39940cf600 con 0x7f39940d4330 2024-09-16T01:54:41.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f3993fff640 1 --2- 172.21.15.42:0/3758134361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39940d4330 0x7f39940d47c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f398c009d90 tx=0x7f398c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bab35579bcad811 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:41.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f39927fc640 1 -- 172.21.15.42:0/3758134361 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c007740 con 0x7f39940d4330 2024-09-16T01:54:41.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f39927fc640 1 -- 172.21.15.42:0/3758134361 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c0078e0 con 0x7f39940d4330 2024-09-16T01:54:41.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f39927fc640 1 -- 172.21.15.42:0/3758134361 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c007cb0 con 0x7f39940d4330 2024-09-16T01:54:41.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f3998f16640 1 -- 172.21.15.42:0/3758134361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39940d4330 msgr2=0x7f39940d47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f3998f16640 1 --2- 172.21.15.42:0/3758134361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39940d4330 0x7f39940d47c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f398c009d90 tx=0x7f398c02a6f0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f3998f16640 1 -- 172.21.15.42:0/3758134361 shutdown_connections 2024-09-16T01:54:41.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f3998f16640 1 --2- 172.21.15.42:0/3758134361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39940d4330 0x7f39940d47c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f3998f16640 1 -- 172.21.15.42:0/3758134361 >> 172.21.15.42:0/3758134361 conn(0x7f399409d720 msgr2=0x7f399408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:41.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f3998f16640 1 -- 172.21.15.42:0/3758134361 shutdown_connections 2024-09-16T01:54:41.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.063+0000 7f3998f16640 1 -- 172.21.15.42:0/3758134361 wait complete. 2024-09-16T01:54:41.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.065+0000 7f3998f16640 1 Processor -- start 2024-09-16T01:54:41.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.065+0000 7f3998f16640 1 -- start start 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.065+0000 7f3998f16640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39940d4330 0x7f39940b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.065+0000 7f3998f16640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f399415e260 0x7f39940cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.065+0000 7f3998f16640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399415e640 0x7f39940cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.065+0000 7f3998f16640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f39940cf0c0 con 0x7f399415e260 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.065+0000 7f3998f16640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f39940cef40 con 0x7f399415e640 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.065+0000 7f3998f16640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f399406db70 con 0x7f39940d4330 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3992ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f399415e260 0x7f39940cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3992ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f399415e260 0x7f39940cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53064/0 (socket says 172.21.15.42:53064) 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3992ffd640 1 -- 172.21.15.42:0/2543521885 learned_addr learned my addr 172.21.15.42:0/2543521885 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3993fff640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399415e640 0x7f39940cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f39937fe640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39940d4330 0x7f39940b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3992ffd640 1 -- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39940d4330 msgr2=0x7f39940b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3992ffd640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39940d4330 0x7f39940b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3992ffd640 1 -- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399415e640 msgr2=0x7f39940cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3992ffd640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399415e640 0x7f39940cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3992ffd640 1 -- 172.21.15.42:0/2543521885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3994158510 con 0x7f399415e260 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3992ffd640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f399415e260 0x7f39940cd710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c3c0 tx=0x7f397c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f398bfff640 1 -- 172.21.15.42:0/2543521885 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c017070 con 0x7f399415e260 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f398bfff640 1 -- 172.21.15.42:0/2543521885 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f397c0052f0 con 0x7f399415e260 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f398bfff640 1 -- 172.21.15.42:0/2543521885 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c003830 con 0x7f399415e260 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3998f16640 1 -- 172.21.15.42:0/2543521885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39941587f0 con 0x7f399415e260 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.066+0000 7f3998f16640 1 -- 172.21.15.42:0/2543521885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39940b4b20 con 0x7f399415e260 2024-09-16T01:54:41.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.067+0000 7f3998f16640 1 -- 172.21.15.42:0/2543521885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39940cb550 con 0x7f399415e260 2024-09-16T01:54:41.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.068+0000 7f398bfff640 1 -- 172.21.15.42:0/2543521885 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f397c01a070 con 0x7f399415e260 2024-09-16T01:54:41.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.069+0000 7f398bfff640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f397406c2e0 0x7f397406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.069+0000 7f398bfff640 1 -- 172.21.15.42:0/2543521885 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f397c08a940 con 0x7f399415e260 2024-09-16T01:54:41.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.069+0000 7f39937fe640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f397406c2e0 0x7f397406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.069+0000 7f39937fe640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f397406c2e0 0x7f397406e7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3984007f70 tx=0x7f3984007f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:41.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.073+0000 7f398bfff640 1 -- 172.21.15.42:0/2543521885 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f397c058720 con 0x7f399415e260 2024-09-16T01:54:41.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.284+0000 7f3998f16640 1 -- 172.21.15.42:0/2543521885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f399406cf90 con 0x7f399415e260 2024-09-16T01:54:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.285+0000 7f398bfff640 1 -- 172.21.15.42:0/2543521885 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5231 (secure 0 0 0) 0x7f397c05ca20 con 0x7f399415e260 2024-09-16T01:54:41.287 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:41.288 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-16T01:54:40:934131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:54:21.197115+0000","modified":"2024-09-16T01:54:40.289757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34157,"qdb_cluster":[34157]},"id":1}]} 2024-09-16T01:54:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 -- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f397406c2e0 msgr2=0x7f397406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f397406c2e0 0x7f397406e7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3984007f70 tx=0x7f3984007f00 comp rx=0 tx=0).stop 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 -- 172.21.15.42:0/2543521885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f399415e260 msgr2=0x7f39940cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f399415e260 0x7f39940cd710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c3c0 tx=0x7f397c00c880 comp rx=0 tx=0).stop 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 -- 172.21.15.42:0/2543521885 shutdown_connections 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f397406c2e0 0x7f397406e7a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399415e640 0x7f39940cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f399415e260 0x7f39940cd710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 --2- 172.21.15.42:0/2543521885 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f39940d4330 0x7f39940b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 -- 172.21.15.42:0/2543521885 >> 172.21.15.42:0/2543521885 conn(0x7f399409d720 msgr2=0x7f39940cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 -- 172.21.15.42:0/2543521885 shutdown_connections 2024-09-16T01:54:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.287+0000 7f3998f16640 1 -- 172.21.15.42:0/2543521885 wait complete. 2024-09-16T01:54:41.301 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:41.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.400+0000 7f5bc0118640 1 Processor -- start 2024-09-16T01:54:41.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.400+0000 7f5bc0118640 1 -- start start 2024-09-16T01:54:41.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.401+0000 7f5bc0118640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bb8162060 0x7f5bb80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.401+0000 7f5bc0118640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5bb80b64b0 0x7f5bb80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.401+0000 7f5bc0118640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bb806d9f0 con 0x7f5bb8161c80 2024-09-16T01:54:41.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.401+0000 7f5bc0118640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb806dcd0 con 0x7f5bb80b64b0 2024-09-16T01:54:41.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.401+0000 7f5bc0118640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb806dfb0 con 0x7f5bb8162060 2024-09-16T01:54:41.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.401+0000 7f5bbe6b5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5bb80b64b0 0x7f5bb80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.401+0000 7f5bbe6b5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5bb80b64b0 0x7f5bb80b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53074/0 (socket says 172.21.15.42:53074) 2024-09-16T01:54:41.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.401+0000 7f5bbe6b5640 1 -- 172.21.15.42:0/1557133203 learned_addr learned my addr 172.21.15.42:0/1557133203 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:41.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.402+0000 7f5bbd6b3640 1 --2- 172.21.15.42:0/1557133203 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bb8162060 0x7f5bb80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.402+0000 7f5bbe6b5640 1 -- 172.21.15.42:0/1557133203 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bb8162060 msgr2=0x7f5bb80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:41.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.402+0000 7f5bbe6b5640 1 --2- 172.21.15.42:0/1557133203 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bb8162060 0x7f5bb80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.402+0000 7f5bbe6b5640 1 -- 172.21.15.42:0/1557133203 >> v1:172.21.15.107:6789/0 conn(0x7f5bb8161c80 legacy=0x7f5bb806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:41.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.402+0000 7f5bbe6b5640 1 -- 172.21.15.42:0/1557133203 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb80d01f0 con 0x7f5bb80b64b0 2024-09-16T01:54:41.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.402+0000 7f5bbe6b5640 1 --2- 172.21.15.42:0/1557133203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb80b64b0 0x7f5bb80b6960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009870 tx=0x7f5bb002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26792a1f1f94b4b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:41.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bbceb2640 1 -- 172.21.15.42:0/1557133203 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0037070 con 0x7f5bb80b64b0 2024-09-16T01:54:41.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bbceb2640 1 -- 172.21.15.42:0/1557133203 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb0032440 con 0x7f5bb80b64b0 2024-09-16T01:54:41.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bbceb2640 1 -- 172.21.15.42:0/1557133203 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0032810 con 0x7f5bb80b64b0 2024-09-16T01:54:41.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bc0118640 1 -- 172.21.15.42:0/1557133203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb80b64b0 msgr2=0x7f5bb80b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bc0118640 1 --2- 172.21.15.42:0/1557133203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb80b64b0 0x7f5bb80b6960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009870 tx=0x7f5bb002a210 comp rx=0 tx=0).stop 2024-09-16T01:54:41.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bc0118640 1 -- 172.21.15.42:0/1557133203 shutdown_connections 2024-09-16T01:54:41.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bc0118640 1 --2- 172.21.15.42:0/1557133203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb80b64b0 0x7f5bb80b6960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bc0118640 1 --2- 172.21.15.42:0/1557133203 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bb8162060 0x7f5bb80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bc0118640 1 -- 172.21.15.42:0/1557133203 >> 172.21.15.42:0/1557133203 conn(0x7f5bb80d44f0 msgr2=0x7f5bb80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:41.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bc0118640 1 -- 172.21.15.42:0/1557133203 shutdown_connections 2024-09-16T01:54:41.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.403+0000 7f5bc0118640 1 -- 172.21.15.42:0/1557133203 wait complete. 2024-09-16T01:54:41.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.404+0000 7f5bc0118640 1 Processor -- start 2024-09-16T01:54:41.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bc0118640 1 -- start start 2024-09-16T01:54:41.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bc0118640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bb80b64b0 0x7f5bb8159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bc0118640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb8161c80 0x7f5bb81f8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bc0118640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bb8162060 0x7f5bb81591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bc0118640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb80cf1e0 con 0x7f5bb8161c80 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bc0118640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb80d2aa0 con 0x7f5bb80b64b0 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bc0118640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb80cf360 con 0x7f5bb8162060 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bbd6b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb8161c80 0x7f5bb81f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bbd6b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb8161c80 0x7f5bb81f8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53090/0 (socket says 172.21.15.42:53090) 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bbd6b3640 1 -- 172.21.15.42:0/2141783934 learned_addr learned my addr 172.21.15.42:0/2141783934 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bbdeb4640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bb80b64b0 0x7f5bb8159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.405+0000 7f5bbe6b5640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bb8162060 0x7f5bb81591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bbd6b3640 1 -- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bb8162060 msgr2=0x7f5bb81591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bbd6b3640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bb8162060 0x7f5bb81591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bbd6b3640 1 -- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bb80b64b0 msgr2=0x7f5bb8159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bbd6b3640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bb80b64b0 0x7f5bb8159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bbd6b3640 1 -- 172.21.15.42:0/2141783934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb8159710 con 0x7f5bb8161c80 2024-09-16T01:54:41.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bbd6b3640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb8161c80 0x7f5bb81f8880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00d5d0 tx=0x7f5bac00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:41.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bb67fc640 1 -- 172.21.15.42:0/2141783934 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac004240 con 0x7f5bb8161c80 2024-09-16T01:54:41.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bb67fc640 1 -- 172.21.15.42:0/2141783934 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bac0043e0 con 0x7f5bb8161c80 2024-09-16T01:54:41.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bc0118640 1 -- 172.21.15.42:0/2141783934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb80b9270 con 0x7f5bb8161c80 2024-09-16T01:54:41.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bb67fc640 1 -- 172.21.15.42:0/2141783934 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac003830 con 0x7f5bb8161c80 2024-09-16T01:54:41.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.406+0000 7f5bc0118640 1 -- 172.21.15.42:0/2141783934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb80cb760 con 0x7f5bb8161c80 2024-09-16T01:54:41.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.407+0000 7f5bc0118640 1 -- 172.21.15.42:0/2141783934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb80b9790 con 0x7f5bb8161c80 2024-09-16T01:54:41.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.408+0000 7f5bb67fc640 1 -- 172.21.15.42:0/2141783934 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5bac0039d0 con 0x7f5bb8161c80 2024-09-16T01:54:41.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.408+0000 7f5bb67fc640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5ba406c2e0 0x7f5ba406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.408+0000 7f5bb67fc640 1 -- 172.21.15.42:0/2141783934 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5bac08b840 con 0x7f5bb8161c80 2024-09-16T01:54:41.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.408+0000 7f5bbdeb4640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5ba406c2e0 0x7f5ba406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.409+0000 7f5bbdeb4640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5ba406c2e0 0x7f5ba406e7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8005660 tx=0x7f5ba8003d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.412+0000 7f5bb67fc640 1 -- 172.21.15.42:0/2141783934 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5bac059630 con 0x7f5bb8161c80 2024-09-16T01:54:41.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.588+0000 7f5bc0118640 1 -- 172.21.15.42:0/2141783934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5bb80b5f70 con 0x7f5bb8161c80 2024-09-16T01:54:41.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.589+0000 7f5bb67fc640 1 -- 172.21.15.42:0/2141783934 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7f5bac05d930 con 0x7f5bb8161c80 2024-09-16T01:54:41.592 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:41.592 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.591+0000 7f5bc0118640 1 -- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5ba406c2e0 msgr2=0x7f5ba406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.591+0000 7f5bc0118640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5ba406c2e0 0x7f5ba406e7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8005660 tx=0x7f5ba8003d90 comp rx=0 tx=0).stop 2024-09-16T01:54:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.592+0000 7f5bc0118640 1 -- 172.21.15.42:0/2141783934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb8161c80 msgr2=0x7f5bb81f8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.592+0000 7f5bc0118640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb8161c80 0x7f5bb81f8880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00d5d0 tx=0x7f5bac00da90 comp rx=0 tx=0).stop 2024-09-16T01:54:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.592+0000 7f5bc0118640 1 -- 172.21.15.42:0/2141783934 shutdown_connections 2024-09-16T01:54:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.592+0000 7f5bc0118640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5ba406c2e0 0x7f5ba406e7a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.592+0000 7f5bc0118640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5bb8162060 0x7f5bb81591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.592+0000 7f5bc0118640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bb8161c80 0x7f5bb81f8880 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.592+0000 7f5bc0118640 1 --2- 172.21.15.42:0/2141783934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5bb80b64b0 0x7f5bb8159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.592+0000 7f5bc0118640 1 -- 172.21.15.42:0/2141783934 >> 172.21.15.42:0/2141783934 conn(0x7f5bb80d44f0 msgr2=0x7f5bb80b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.592+0000 7f5bc0118640 1 -- 172.21.15.42:0/2141783934 shutdown_connections 2024-09-16T01:54:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.592+0000 7f5bc0118640 1 -- 172.21.15.42:0/2141783934 wait complete. 2024-09-16T01:54:41.605 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:54:41.605 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:54:41.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.706+0000 7f58d78e4640 1 Processor -- start 2024-09-16T01:54:41.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.706+0000 7f58d78e4640 1 -- start start 2024-09-16T01:54:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d78e4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f58d015e5f0 0x7f58d00d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d78e4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f58d00d30f0 0x7f58d00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d78e4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00b64c0 0x7f58d00cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d78e4640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f58d006d530 con 0x7f58d015e5f0 2024-09-16T01:54:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d78e4640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f58d00d3690 con 0x7f58d00d30f0 2024-09-16T01:54:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d78e4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f58d00d3970 con 0x7f58d00b64c0 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d5680640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f58d015e5f0 0x7f58d00d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d5680640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f58d015e5f0 0x7f58d00d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53104/0 (socket says 172.21.15.42:53104) 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d5680640 1 -- 172.21.15.42:0/1540642928 learned_addr learned my addr 172.21.15.42:0/1540642928 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d5e81640 1 --2- 172.21.15.42:0/1540642928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00b64c0 0x7f58d00cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d4e7f640 1 --2- 172.21.15.42:0/1540642928 >> v2:172.21.15.107:3300/0 conn(0x7f58d00d30f0 0x7f58d00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d5680640 1 -- 172.21.15.42:0/1540642928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00b64c0 msgr2=0x7f58d00cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d5680640 1 --2- 172.21.15.42:0/1540642928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00b64c0 0x7f58d00cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d5680640 1 -- 172.21.15.42:0/1540642928 >> v2:172.21.15.107:3300/0 conn(0x7f58d00d30f0 msgr2=0x7f58d00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d5680640 1 --2- 172.21.15.42:0/1540642928 >> v2:172.21.15.107:3300/0 conn(0x7f58d00d30f0 0x7f58d00b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d5680640 1 -- 172.21.15.42:0/1540642928 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d006cee0 con 0x7f58d015e5f0 2024-09-16T01:54:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d5e81640 1 --2- 172.21.15.42:0/1540642928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00b64c0 0x7f58d00cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:41.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.707+0000 7f58d4e7f640 1 --2- 172.21.15.42:0/1540642928 >> v2:172.21.15.107:3300/0 conn(0x7f58d00d30f0 0x7f58d00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.708+0000 7f58d5680640 1 --2- 172.21.15.42:0/1540642928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 0x7f58d00d4dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f58d008e520 tx=0x7f58cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8321aaac2213abc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.708+0000 7f58c7fff640 1 -- 172.21.15.42:0/1540642928 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc037070 con 0x7f58d015e5f0 2024-09-16T01:54:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.708+0000 7f58c7fff640 1 -- 172.21.15.42:0/1540642928 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc032440 con 0x7f58d015e5f0 2024-09-16T01:54:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.708+0000 7f58c7fff640 1 -- 172.21.15.42:0/1540642928 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc032810 con 0x7f58d015e5f0 2024-09-16T01:54:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.709+0000 7f58d78e4640 1 -- 172.21.15.42:0/1540642928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 msgr2=0x7f58d00d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.709+0000 7f58d78e4640 1 --2- 172.21.15.42:0/1540642928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 0x7f58d00d4dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f58d008e520 tx=0x7f58cc02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.709+0000 7f58d78e4640 1 -- 172.21.15.42:0/1540642928 shutdown_connections 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.709+0000 7f58d78e4640 1 --2- 172.21.15.42:0/1540642928 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00b64c0 0x7f58d00cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.709+0000 7f58d78e4640 1 --2- 172.21.15.42:0/1540642928 >> v2:172.21.15.107:3300/0 conn(0x7f58d00d30f0 0x7f58d00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.709+0000 7f58d78e4640 1 --2- 172.21.15.42:0/1540642928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 0x7f58d00d4dd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.709+0000 7f58d78e4640 1 -- 172.21.15.42:0/1540642928 >> 172.21.15.42:0/1540642928 conn(0x7f58d008bfc0 msgr2=0x7f58d00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.709+0000 7f58d78e4640 1 -- 172.21.15.42:0/1540642928 shutdown_connections 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.709+0000 7f58d78e4640 1 -- 172.21.15.42:0/1540642928 wait complete. 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.710+0000 7f58d78e4640 1 Processor -- start 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.710+0000 7f58d78e4640 1 -- start start 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d78e4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00b64c0 0x7f58d015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d78e4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00d30f0 0x7f58d00ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d78e4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 0x7f58d00cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d78e4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f58d00d5310 con 0x7f58d015e5f0 2024-09-16T01:54:41.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d78e4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f58d015e9d0 con 0x7f58d00b64c0 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d78e4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f58d00cf540 con 0x7f58d00d30f0 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5e81640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 0x7f58d00cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5e81640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 0x7f58d00cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53116/0 (socket says 172.21.15.42:53116) 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5e81640 1 -- 172.21.15.42:0/1047389481 learned_addr learned my addr 172.21.15.42:0/1047389481 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d4e7f640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00d30f0 0x7f58d00ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5680640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00b64c0 0x7f58d015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5e81640 1 -- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00d30f0 msgr2=0x7f58d00ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5e81640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00d30f0 0x7f58d00ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5e81640 1 -- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00b64c0 msgr2=0x7f58d015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5e81640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00b64c0 0x7f58d015d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5e81640 1 -- 172.21.15.42:0/1047389481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d00ca680 con 0x7f58d015e5f0 2024-09-16T01:54:41.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d4e7f640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00d30f0 0x7f58d00ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5680640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00b64c0 0x7f58d015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d5e81640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 0x7f58d00cbe10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58c8007ef0 tx=0x7f58c800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58c5ffb640 1 -- 172.21.15.42:0/1047389481 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c801a070 con 0x7f58d015e5f0 2024-09-16T01:54:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58c5ffb640 1 -- 172.21.15.42:0/1047389481 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c8003b90 con 0x7f58d015e5f0 2024-09-16T01:54:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58c5ffb640 1 -- 172.21.15.42:0/1047389481 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8004030 con 0x7f58d015e5f0 2024-09-16T01:54:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.711+0000 7f58d78e4640 1 -- 172.21.15.42:0/1047389481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d00ca960 con 0x7f58d015e5f0 2024-09-16T01:54:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.712+0000 7f58d78e4640 1 -- 172.21.15.42:0/1047389481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d00caf20 con 0x7f58d015e5f0 2024-09-16T01:54:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.713+0000 7f58d78e4640 1 -- 172.21.15.42:0/1047389481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d00b5f80 con 0x7f58d015e5f0 2024-09-16T01:54:41.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.713+0000 7f58c5ffb640 1 -- 172.21.15.42:0/1047389481 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f58c801d070 con 0x7f58d015e5f0 2024-09-16T01:54:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.713+0000 7f58c5ffb640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58b406c2b0 0x7f58b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.714+0000 7f58c5ffb640 1 -- 172.21.15.42:0/1047389481 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f58c808b990 con 0x7f58d015e5f0 2024-09-16T01:54:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.714+0000 7f58d5680640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58b406c2b0 0x7f58b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.714+0000 7f58d5680640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58b406c2b0 0x7f58b406e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f58cc034000 tx=0x7f58cc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:41.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.718+0000 7f58c5ffb640 1 -- 172.21.15.42:0/1047389481 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58c8010070 con 0x7f58d015e5f0 2024-09-16T01:54:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.893+0000 7f58d78e4640 1 -- 172.21.15.42:0/1047389481 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58d00ca430 con 0x7f58b406c2b0 2024-09-16T01:54:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.902+0000 7f58c5ffb640 1 -- 172.21.15.42:0/1047389481 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f58d00ca430 con 0x7f58b406c2b0 2024-09-16T01:54:41.908 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:41.910 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:54:41.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 -- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58b406c2b0 msgr2=0x7f58b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58b406c2b0 0x7f58b406e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f58cc034000 tx=0x7f58cc02e000 comp rx=0 tx=0).stop 2024-09-16T01:54:41.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 -- 172.21.15.42:0/1047389481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 msgr2=0x7f58d00cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:41.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 0x7f58d00cbe10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58c8007ef0 tx=0x7f58c800d4a0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 -- 172.21.15.42:0/1047389481 shutdown_connections 2024-09-16T01:54:41.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58b406c2b0 0x7f58b406e770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d015e5f0 0x7f58d00cbe10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58d00d30f0 0x7f58d00ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 --2- 172.21.15.42:0/1047389481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00b64c0 0x7f58d015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:41.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 -- 172.21.15.42:0/1047389481 >> 172.21.15.42:0/1047389481 conn(0x7f58d008bfc0 msgr2=0x7f58d00b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:41.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 -- 172.21.15.42:0/1047389481 shutdown_connections 2024-09-16T01:54:41.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:41.906+0000 7f58d78e4640 1 -- 172.21.15.42:0/1047389481 wait complete. 2024-09-16T01:54:41.919 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-16T01:54:40.253667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236100,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738620,"statfs":{"total":773094113280,"available":772852346880,"internally_reserved":0,"allocated":3317760,"data_stored":2009724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003123"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145216+0000","last_change":"2024-09-16T01:54:20.860255+0000","last_active":"2024-09-16T01:54:28.145216+0000","last_peered":"2024-09-16T01:54:28.145216+0000","last_clean":"2024-09-16T01:54:28.145216+0000","last_became_active":"2024-09-16T01:54:20.859944+0000","last_became_peered":"2024-09-16T01:54:20.859944+0000","last_unstale":"2024-09-16T01:54:28.145216+0000","last_undegraded":"2024-09-16T01:54:28.145216+0000","last_fullsized":"2024-09-16T01:54:28.145216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:39.081955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899508+0000","last_change":"2024-09-16T01:54:21.859551+0000","last_active":"2024-09-16T01:54:26.899508+0000","last_peered":"2024-09-16T01:54:26.899508+0000","last_clean":"2024-09-16T01:54:26.899508+0000","last_became_active":"2024-09-16T01:54:21.858047+0000","last_became_peered":"2024-09-16T01:54:21.858047+0000","last_unstale":"2024-09-16T01:54:26.899508+0000","last_undegraded":"2024-09-16T01:54:26.899508+0000","last_fullsized":"2024-09-16T01:54:26.899508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:29.948383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898563+0000","last_change":"2024-09-16T01:54:25.964125+0000","last_active":"2024-09-16T01:54:26.898563+0000","last_peered":"2024-09-16T01:54:26.898563+0000","last_clean":"2024-09-16T01:54:26.898563+0000","last_became_active":"2024-09-16T01:54:25.963738+0000","last_became_peered":"2024-09-16T01:54:25.963738+0000","last_unstale":"2024-09-16T01:54:26.898563+0000","last_undegraded":"2024-09-16T01:54:26.898563+0000","last_fullsized":"2024-09-16T01:54:26.898563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:06.129448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899601+0000","last_change":"2024-09-16T01:54:20.861025+0000","last_active":"2024-09-16T01:54:26.899601+0000","last_peered":"2024-09-16T01:54:26.899601+0000","last_clean":"2024-09-16T01:54:26.899601+0000","last_became_active":"2024-09-16T01:54:20.858817+0000","last_became_peered":"2024-09-16T01:54:20.858817+0000","last_unstale":"2024-09-16T01:54:26.899601+0000","last_undegraded":"2024-09-16T01:54:26.899601+0000","last_fullsized":"2024-09-16T01:54:26.899601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144849+0000","last_change":"2024-09-16T01:54:21.867670+0000","last_active":"2024-09-16T01:54:28.144849+0000","last_peered":"2024-09-16T01:54:28.144849+0000","last_clean":"2024-09-16T01:54:28.144849+0000","last_became_active":"2024-09-16T01:54:21.866666+0000","last_became_peered":"2024-09-16T01:54:21.866666+0000","last_unstale":"2024-09-16T01:54:28.144849+0000","last_undegraded":"2024-09-16T01:54:28.144849+0000","last_fullsized":"2024-09-16T01:54:28.144849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899530+0000","last_change":"2024-09-16T01:54:25.877304+0000","last_active":"2024-09-16T01:54:26.899530+0000","last_peered":"2024-09-16T01:54:26.899530+0000","last_clean":"2024-09-16T01:54:26.899530+0000","last_became_active":"2024-09-16T01:54:25.876643+0000","last_became_peered":"2024-09-16T01:54:25.876643+0000","last_unstale":"2024-09-16T01:54:26.899530+0000","last_undegraded":"2024-09-16T01:54:26.899530+0000","last_fullsized":"2024-09-16T01:54:26.899530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:15.866095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145670+0000","last_change":"2024-09-16T01:54:20.860557+0000","last_active":"2024-09-16T01:54:28.145670+0000","last_peered":"2024-09-16T01:54:28.145670+0000","last_clean":"2024-09-16T01:54:28.145670+0000","last_became_active":"2024-09-16T01:54:20.860254+0000","last_became_peered":"2024-09-16T01:54:20.860254+0000","last_unstale":"2024-09-16T01:54:28.145670+0000","last_undegraded":"2024-09-16T01:54:28.145670+0000","last_fullsized":"2024-09-16T01:54:28.145670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:16.893601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678222+0000","last_change":"2024-09-16T01:54:21.860466+0000","last_active":"2024-09-16T01:54:27.678222+0000","last_peered":"2024-09-16T01:54:27.678222+0000","last_clean":"2024-09-16T01:54:27.678222+0000","last_became_active":"2024-09-16T01:54:21.860191+0000","last_became_peered":"2024-09-16T01:54:21.860191+0000","last_unstale":"2024-09-16T01:54:27.678222+0000","last_undegraded":"2024-09-16T01:54:27.678222+0000","last_fullsized":"2024-09-16T01:54:27.678222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:47.165464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899752+0000","last_change":"2024-09-16T01:54:25.877667+0000","last_active":"2024-09-16T01:54:26.899752+0000","last_peered":"2024-09-16T01:54:26.899752+0000","last_clean":"2024-09-16T01:54:26.899752+0000","last_became_active":"2024-09-16T01:54:25.876568+0000","last_became_peered":"2024-09-16T01:54:25.876568+0000","last_unstale":"2024-09-16T01:54:26.899752+0000","last_undegraded":"2024-09-16T01:54:26.899752+0000","last_fullsized":"2024-09-16T01:54:26.899752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:33.969016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145351+0000","last_change":"2024-09-16T01:54:20.862062+0000","last_active":"2024-09-16T01:54:28.145351+0000","last_peered":"2024-09-16T01:54:28.145351+0000","last_clean":"2024-09-16T01:54:28.145351+0000","last_became_active":"2024-09-16T01:54:20.861764+0000","last_became_peered":"2024-09-16T01:54:20.861764+0000","last_unstale":"2024-09-16T01:54:28.145351+0000","last_undegraded":"2024-09-16T01:54:28.145351+0000","last_fullsized":"2024-09-16T01:54:28.145351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:02.378815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678304+0000","last_change":"2024-09-16T01:54:21.857448+0000","last_active":"2024-09-16T01:54:27.678304+0000","last_peered":"2024-09-16T01:54:27.678304+0000","last_clean":"2024-09-16T01:54:27.678304+0000","last_became_active":"2024-09-16T01:54:21.857131+0000","last_became_peered":"2024-09-16T01:54:21.857131+0000","last_unstale":"2024-09-16T01:54:27.678304+0000","last_undegraded":"2024-09-16T01:54:27.678304+0000","last_fullsized":"2024-09-16T01:54:27.678304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:46.608693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899648+0000","last_change":"2024-09-16T01:54:25.873795+0000","last_active":"2024-09-16T01:54:26.899648+0000","last_peered":"2024-09-16T01:54:26.899648+0000","last_clean":"2024-09-16T01:54:26.899648+0000","last_became_active":"2024-09-16T01:54:25.873379+0000","last_became_peered":"2024-09-16T01:54:25.873379+0000","last_unstale":"2024-09-16T01:54:26.899648+0000","last_undegraded":"2024-09-16T01:54:26.899648+0000","last_fullsized":"2024-09-16T01:54:26.899648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:43.663709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144634+0000","last_change":"2024-09-16T01:54:21.858785+0000","last_active":"2024-09-16T01:54:28.144634+0000","last_peered":"2024-09-16T01:54:28.144634+0000","last_clean":"2024-09-16T01:54:28.144634+0000","last_became_active":"2024-09-16T01:54:21.858450+0000","last_became_peered":"2024-09-16T01:54:21.858450+0000","last_unstale":"2024-09-16T01:54:28.144634+0000","last_undegraded":"2024-09-16T01:54:28.144634+0000","last_fullsized":"2024-09-16T01:54:28.144634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145654+0000","last_change":"2024-09-16T01:54:20.859619+0000","last_active":"2024-09-16T01:54:28.145654+0000","last_peered":"2024-09-16T01:54:28.145654+0000","last_clean":"2024-09-16T01:54:28.145654+0000","last_became_active":"2024-09-16T01:54:20.859348+0000","last_became_peered":"2024-09-16T01:54:20.859348+0000","last_unstale":"2024-09-16T01:54:28.145654+0000","last_undegraded":"2024-09-16T01:54:28.145654+0000","last_fullsized":"2024-09-16T01:54:28.145654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:32.717638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899990+0000","last_change":"2024-09-16T01:54:25.876988+0000","last_active":"2024-09-16T01:54:26.899990+0000","last_peered":"2024-09-16T01:54:26.899990+0000","last_clean":"2024-09-16T01:54:26.899990+0000","last_became_active":"2024-09-16T01:54:25.876405+0000","last_became_peered":"2024-09-16T01:54:25.876405+0000","last_unstale":"2024-09-16T01:54:26.899990+0000","last_undegraded":"2024-09-16T01:54:26.899990+0000","last_fullsized":"2024-09-16T01:54:26.899990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:51.186097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898948+0000","last_change":"2024-09-16T01:54:21.866597+0000","last_active":"2024-09-16T01:54:26.898948+0000","last_peered":"2024-09-16T01:54:26.898948+0000","last_clean":"2024-09-16T01:54:26.898948+0000","last_became_active":"2024-09-16T01:54:21.866303+0000","last_became_peered":"2024-09-16T01:54:21.866303+0000","last_unstale":"2024-09-16T01:54:26.898948+0000","last_undegraded":"2024-09-16T01:54:26.898948+0000","last_fullsized":"2024-09-16T01:54:26.898948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:57.597318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644331+0000","last_change":"2024-09-16T01:54:20.851271+0000","last_active":"2024-09-16T01:54:27.644331+0000","last_peered":"2024-09-16T01:54:27.644331+0000","last_clean":"2024-09-16T01:54:27.644331+0000","last_became_active":"2024-09-16T01:54:20.850597+0000","last_became_peered":"2024-09-16T01:54:20.850597+0000","last_unstale":"2024-09-16T01:54:27.644331+0000","last_undegraded":"2024-09-16T01:54:27.644331+0000","last_fullsized":"2024-09-16T01:54:27.644331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900473+0000","last_change":"2024-09-16T01:54:25.876997+0000","last_active":"2024-09-16T01:54:26.900473+0000","last_peered":"2024-09-16T01:54:26.900473+0000","last_clean":"2024-09-16T01:54:26.900473+0000","last_became_active":"2024-09-16T01:54:25.876501+0000","last_became_peered":"2024-09-16T01:54:25.876501+0000","last_unstale":"2024-09-16T01:54:26.900473+0000","last_undegraded":"2024-09-16T01:54:26.900473+0000","last_fullsized":"2024-09-16T01:54:26.900473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899001+0000","last_change":"2024-09-16T01:54:21.852096+0000","last_active":"2024-09-16T01:54:26.899001+0000","last_peered":"2024-09-16T01:54:26.899001+0000","last_clean":"2024-09-16T01:54:26.899001+0000","last_became_active":"2024-09-16T01:54:21.848364+0000","last_became_peered":"2024-09-16T01:54:21.848364+0000","last_unstale":"2024-09-16T01:54:26.899001+0000","last_undegraded":"2024-09-16T01:54:26.899001+0000","last_fullsized":"2024-09-16T01:54:26.899001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643861+0000","last_change":"2024-09-16T01:54:20.852050+0000","last_active":"2024-09-16T01:54:27.643861+0000","last_peered":"2024-09-16T01:54:27.643861+0000","last_clean":"2024-09-16T01:54:27.643861+0000","last_became_active":"2024-09-16T01:54:20.851725+0000","last_became_peered":"2024-09-16T01:54:20.851725+0000","last_unstale":"2024-09-16T01:54:27.643861+0000","last_undegraded":"2024-09-16T01:54:27.643861+0000","last_fullsized":"2024-09-16T01:54:27.643861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644337+0000","last_change":"2024-09-16T01:54:25.962379+0000","last_active":"2024-09-16T01:54:27.644337+0000","last_peered":"2024-09-16T01:54:27.644337+0000","last_clean":"2024-09-16T01:54:27.644337+0000","last_became_active":"2024-09-16T01:54:25.961815+0000","last_became_peered":"2024-09-16T01:54:25.961815+0000","last_unstale":"2024-09-16T01:54:27.644337+0000","last_undegraded":"2024-09-16T01:54:27.644337+0000","last_fullsized":"2024-09-16T01:54:27.644337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:58.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900426+0000","last_change":"2024-09-16T01:54:21.846558+0000","last_active":"2024-09-16T01:54:26.900426+0000","last_peered":"2024-09-16T01:54:26.900426+0000","last_clean":"2024-09-16T01:54:26.900426+0000","last_became_active":"2024-09-16T01:54:21.846226+0000","last_became_peered":"2024-09-16T01:54:21.846226+0000","last_unstale":"2024-09-16T01:54:26.900426+0000","last_undegraded":"2024-09-16T01:54:26.900426+0000","last_fullsized":"2024-09-16T01:54:26.900426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:22.658145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144908+0000","last_change":"2024-09-16T01:54:20.857121+0000","last_active":"2024-09-16T01:54:28.144908+0000","last_peered":"2024-09-16T01:54:28.144908+0000","last_clean":"2024-09-16T01:54:28.144908+0000","last_became_active":"2024-09-16T01:54:20.856852+0000","last_became_peered":"2024-09-16T01:54:20.856852+0000","last_unstale":"2024-09-16T01:54:28.144908+0000","last_undegraded":"2024-09-16T01:54:28.144908+0000","last_fullsized":"2024-09-16T01:54:28.144908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:40.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899928+0000","last_change":"2024-09-16T01:54:25.883440+0000","last_active":"2024-09-16T01:54:26.899928+0000","last_peered":"2024-09-16T01:54:26.899928+0000","last_clean":"2024-09-16T01:54:26.899928+0000","last_became_active":"2024-09-16T01:54:25.883010+0000","last_became_peered":"2024-09-16T01:54:25.883010+0000","last_unstale":"2024-09-16T01:54:26.899928+0000","last_undegraded":"2024-09-16T01:54:26.899928+0000","last_fullsized":"2024-09-16T01:54:26.899928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:00:01.617950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145309+0000","last_change":"2024-09-16T01:54:21.851620+0000","last_active":"2024-09-16T01:54:28.145309+0000","last_peered":"2024-09-16T01:54:28.145309+0000","last_clean":"2024-09-16T01:54:28.145309+0000","last_became_active":"2024-09-16T01:54:21.851295+0000","last_became_peered":"2024-09-16T01:54:21.851295+0000","last_unstale":"2024-09-16T01:54:28.145309+0000","last_undegraded":"2024-09-16T01:54:28.145309+0000","last_fullsized":"2024-09-16T01:54:28.145309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.146152+0000","last_change":"2024-09-16T01:54:20.852819+0000","last_active":"2024-09-16T01:54:28.146152+0000","last_peered":"2024-09-16T01:54:28.146152+0000","last_clean":"2024-09-16T01:54:28.146152+0000","last_became_active":"2024-09-16T01:54:20.852524+0000","last_became_peered":"2024-09-16T01:54:20.852524+0000","last_unstale":"2024-09-16T01:54:28.146152+0000","last_undegraded":"2024-09-16T01:54:28.146152+0000","last_fullsized":"2024-09-16T01:54:28.146152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899618+0000","last_change":"2024-09-16T01:54:25.964272+0000","last_active":"2024-09-16T01:54:26.899618+0000","last_peered":"2024-09-16T01:54:26.899618+0000","last_clean":"2024-09-16T01:54:26.899618+0000","last_became_active":"2024-09-16T01:54:25.963859+0000","last_became_peered":"2024-09-16T01:54:25.963859+0000","last_unstale":"2024-09-16T01:54:26.899618+0000","last_undegraded":"2024-09-16T01:54:26.899618+0000","last_fullsized":"2024-09-16T01:54:26.899618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:46.344559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899722+0000","last_change":"2024-09-16T01:54:21.857608+0000","last_active":"2024-09-16T01:54:26.899722+0000","last_peered":"2024-09-16T01:54:26.899722+0000","last_clean":"2024-09-16T01:54:26.899722+0000","last_became_active":"2024-09-16T01:54:21.857318+0000","last_became_peered":"2024-09-16T01:54:21.857318+0000","last_unstale":"2024-09-16T01:54:26.899722+0000","last_undegraded":"2024-09-16T01:54:26.899722+0000","last_fullsized":"2024-09-16T01:54:26.899722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644409+0000","last_change":"2024-09-16T01:54:20.852273+0000","last_active":"2024-09-16T01:54:27.644409+0000","last_peered":"2024-09-16T01:54:27.644409+0000","last_clean":"2024-09-16T01:54:27.644409+0000","last_became_active":"2024-09-16T01:54:20.850797+0000","last_became_peered":"2024-09-16T01:54:20.850797+0000","last_unstale":"2024-09-16T01:54:27.644409+0000","last_undegraded":"2024-09-16T01:54:27.644409+0000","last_fullsized":"2024-09-16T01:54:27.644409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898502+0000","last_change":"2024-09-16T01:54:25.962387+0000","last_active":"2024-09-16T01:54:26.898502+0000","last_peered":"2024-09-16T01:54:26.898502+0000","last_clean":"2024-09-16T01:54:26.898502+0000","last_became_active":"2024-09-16T01:54:25.961663+0000","last_became_peered":"2024-09-16T01:54:25.961663+0000","last_unstale":"2024-09-16T01:54:26.898502+0000","last_undegraded":"2024-09-16T01:54:26.898502+0000","last_fullsized":"2024-09-16T01:54:26.898502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:47:57.197478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644408+0000","last_change":"2024-09-16T01:54:21.847291+0000","last_active":"2024-09-16T01:54:27.644408+0000","last_peered":"2024-09-16T01:54:27.644408+0000","last_clean":"2024-09-16T01:54:27.644408+0000","last_became_active":"2024-09-16T01:54:21.847040+0000","last_became_peered":"2024-09-16T01:54:21.847040+0000","last_unstale":"2024-09-16T01:54:27.644408+0000","last_undegraded":"2024-09-16T01:54:27.644408+0000","last_fullsized":"2024-09-16T01:54:27.644408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145796+0000","last_change":"2024-09-16T01:54:20.858004+0000","last_active":"2024-09-16T01:54:28.145796+0000","last_peered":"2024-09-16T01:54:28.145796+0000","last_clean":"2024-09-16T01:54:28.145796+0000","last_became_active":"2024-09-16T01:54:20.857658+0000","last_became_peered":"2024-09-16T01:54:20.857658+0000","last_unstale":"2024-09-16T01:54:28.145796+0000","last_undegraded":"2024-09-16T01:54:28.145796+0000","last_fullsized":"2024-09-16T01:54:28.145796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:30.831030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144709+0000","last_change":"2024-09-16T01:54:25.962169+0000","last_active":"2024-09-16T01:54:28.144709+0000","last_peered":"2024-09-16T01:54:28.144709+0000","last_clean":"2024-09-16T01:54:28.144709+0000","last_became_active":"2024-09-16T01:54:25.961782+0000","last_became_peered":"2024-09-16T01:54:25.961782+0000","last_unstale":"2024-09-16T01:54:28.144709+0000","last_undegraded":"2024-09-16T01:54:28.144709+0000","last_fullsized":"2024-09-16T01:54:28.144709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:33.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678479+0000","last_change":"2024-09-16T01:54:21.867456+0000","last_active":"2024-09-16T01:54:27.678479+0000","last_peered":"2024-09-16T01:54:27.678479+0000","last_clean":"2024-09-16T01:54:27.678479+0000","last_became_active":"2024-09-16T01:54:21.867216+0000","last_became_peered":"2024-09-16T01:54:21.867216+0000","last_unstale":"2024-09-16T01:54:27.678479+0000","last_undegraded":"2024-09-16T01:54:27.678479+0000","last_fullsized":"2024-09-16T01:54:27.678479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:35.318988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644449+0000","last_change":"2024-09-16T01:54:20.859065+0000","last_active":"2024-09-16T01:54:27.644449+0000","last_peered":"2024-09-16T01:54:27.644449+0000","last_clean":"2024-09-16T01:54:27.644449+0000","last_became_active":"2024-09-16T01:54:20.858786+0000","last_became_peered":"2024-09-16T01:54:20.858786+0000","last_unstale":"2024-09-16T01:54:27.644449+0000","last_undegraded":"2024-09-16T01:54:27.644449+0000","last_fullsized":"2024-09-16T01:54:27.644449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643956+0000","last_change":"2024-09-16T01:54:25.879436+0000","last_active":"2024-09-16T01:54:27.643956+0000","last_peered":"2024-09-16T01:54:27.643956+0000","last_clean":"2024-09-16T01:54:27.643956+0000","last_became_active":"2024-09-16T01:54:25.878984+0000","last_became_peered":"2024-09-16T01:54:25.878984+0000","last_unstale":"2024-09-16T01:54:27.643956+0000","last_undegraded":"2024-09-16T01:54:27.643956+0000","last_fullsized":"2024-09-16T01:54:27.643956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900343+0000","last_change":"2024-09-16T01:54:21.860170+0000","last_active":"2024-09-16T01:54:26.900343+0000","last_peered":"2024-09-16T01:54:26.900343+0000","last_clean":"2024-09-16T01:54:26.900343+0000","last_became_active":"2024-09-16T01:54:21.859874+0000","last_became_peered":"2024-09-16T01:54:21.859874+0000","last_unstale":"2024-09-16T01:54:26.900343+0000","last_undegraded":"2024-09-16T01:54:26.900343+0000","last_fullsized":"2024-09-16T01:54:26.900343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:59.832590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678402+0000","last_change":"2024-09-16T01:54:20.857370+0000","last_active":"2024-09-16T01:54:27.678402+0000","last_peered":"2024-09-16T01:54:27.678402+0000","last_clean":"2024-09-16T01:54:27.678402+0000","last_became_active":"2024-09-16T01:54:20.856000+0000","last_became_peered":"2024-09-16T01:54:20.856000+0000","last_unstale":"2024-09-16T01:54:27.678402+0000","last_undegraded":"2024-09-16T01:54:27.678402+0000","last_fullsized":"2024-09-16T01:54:27.678402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644309+0000","last_change":"2024-09-16T01:54:25.880804+0000","last_active":"2024-09-16T01:54:27.644309+0000","last_peered":"2024-09-16T01:54:27.644309+0000","last_clean":"2024-09-16T01:54:27.644309+0000","last_became_active":"2024-09-16T01:54:25.880417+0000","last_became_peered":"2024-09-16T01:54:25.880417+0000","last_unstale":"2024-09-16T01:54:27.644309+0000","last_undegraded":"2024-09-16T01:54:27.644309+0000","last_fullsized":"2024-09-16T01:54:27.644309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:33.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643890+0000","last_change":"2024-09-16T01:54:21.845793+0000","last_active":"2024-09-16T01:54:27.643890+0000","last_peered":"2024-09-16T01:54:27.643890+0000","last_clean":"2024-09-16T01:54:27.643890+0000","last_became_active":"2024-09-16T01:54:21.845499+0000","last_became_peered":"2024-09-16T01:54:21.845499+0000","last_unstale":"2024-09-16T01:54:27.643890+0000","last_undegraded":"2024-09-16T01:54:27.643890+0000","last_fullsized":"2024-09-16T01:54:27.643890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144310+0000","last_change":"2024-09-16T01:54:20.858565+0000","last_active":"2024-09-16T01:54:28.144310+0000","last_peered":"2024-09-16T01:54:28.144310+0000","last_clean":"2024-09-16T01:54:28.144310+0000","last_became_active":"2024-09-16T01:54:20.858190+0000","last_became_peered":"2024-09-16T01:54:20.858190+0000","last_unstale":"2024-09-16T01:54:28.144310+0000","last_undegraded":"2024-09-16T01:54:28.144310+0000","last_fullsized":"2024-09-16T01:54:28.144310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:08.777600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644440+0000","last_change":"2024-09-16T01:54:25.880758+0000","last_active":"2024-09-16T01:54:27.644440+0000","last_peered":"2024-09-16T01:54:27.644440+0000","last_clean":"2024-09-16T01:54:27.644440+0000","last_became_active":"2024-09-16T01:54:25.879929+0000","last_became_peered":"2024-09-16T01:54:25.879929+0000","last_unstale":"2024-09-16T01:54:27.644440+0000","last_undegraded":"2024-09-16T01:54:27.644440+0000","last_fullsized":"2024-09-16T01:54:27.644440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:40:09.544682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144567+0000","last_change":"2024-09-16T01:54:21.859563+0000","last_active":"2024-09-16T01:54:28.144567+0000","last_peered":"2024-09-16T01:54:28.144567+0000","last_clean":"2024-09-16T01:54:28.144567+0000","last_became_active":"2024-09-16T01:54:21.859284+0000","last_became_peered":"2024-09-16T01:54:21.859284+0000","last_unstale":"2024-09-16T01:54:28.144567+0000","last_undegraded":"2024-09-16T01:54:28.144567+0000","last_fullsized":"2024-09-16T01:54:28.144567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:28.740307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145101+0000","last_change":"2024-09-16T01:54:20.860054+0000","last_active":"2024-09-16T01:54:28.145101+0000","last_peered":"2024-09-16T01:54:28.145101+0000","last_clean":"2024-09-16T01:54:28.145101+0000","last_became_active":"2024-09-16T01:54:20.859714+0000","last_became_peered":"2024-09-16T01:54:20.859714+0000","last_unstale":"2024-09-16T01:54:28.145101+0000","last_undegraded":"2024-09-16T01:54:28.145101+0000","last_fullsized":"2024-09-16T01:54:28.145101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:25.346654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145185+0000","last_change":"2024-09-16T01:54:25.963523+0000","last_active":"2024-09-16T01:54:28.145185+0000","last_peered":"2024-09-16T01:54:28.145185+0000","last_clean":"2024-09-16T01:54:28.145185+0000","last_became_active":"2024-09-16T01:54:25.963160+0000","last_became_peered":"2024-09-16T01:54:25.963160+0000","last_unstale":"2024-09-16T01:54:28.145185+0000","last_undegraded":"2024-09-16T01:54:28.145185+0000","last_fullsized":"2024-09-16T01:54:28.145185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:12.650374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898701+0000","last_change":"2024-09-16T01:54:21.859137+0000","last_active":"2024-09-16T01:54:26.898701+0000","last_peered":"2024-09-16T01:54:26.898701+0000","last_clean":"2024-09-16T01:54:26.898701+0000","last_became_active":"2024-09-16T01:54:21.858467+0000","last_became_peered":"2024-09-16T01:54:21.858467+0000","last_unstale":"2024-09-16T01:54:26.898701+0000","last_undegraded":"2024-09-16T01:54:26.898701+0000","last_fullsized":"2024-09-16T01:54:26.898701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678105+0000","last_change":"2024-09-16T01:54:20.855557+0000","last_active":"2024-09-16T01:54:27.678105+0000","last_peered":"2024-09-16T01:54:27.678105+0000","last_clean":"2024-09-16T01:54:27.678105+0000","last_became_active":"2024-09-16T01:54:20.855024+0000","last_became_peered":"2024-09-16T01:54:20.855024+0000","last_unstale":"2024-09-16T01:54:27.678105+0000","last_undegraded":"2024-09-16T01:54:27.678105+0000","last_fullsized":"2024-09-16T01:54:27.678105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145216+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:54:28.145216+0000","last_peered":"2024-09-16T01:54:28.145216+0000","last_clean":"2024-09-16T01:54:28.145216+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:54:28.145216+0000","last_undegraded":"2024-09-16T01:54:28.145216+0000","last_fullsized":"2024-09-16T01:54:28.145216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145100+0000","last_change":"2024-09-16T01:54:25.963720+0000","last_active":"2024-09-16T01:54:28.145100+0000","last_peered":"2024-09-16T01:54:28.145100+0000","last_clean":"2024-09-16T01:54:28.145100+0000","last_became_active":"2024-09-16T01:54:25.963290+0000","last_became_peered":"2024-09-16T01:54:25.963290+0000","last_unstale":"2024-09-16T01:54:28.145100+0000","last_undegraded":"2024-09-16T01:54:28.145100+0000","last_fullsized":"2024-09-16T01:54:28.145100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145565+0000","last_change":"2024-09-16T01:54:21.863989+0000","last_active":"2024-09-16T01:54:28.145565+0000","last_peered":"2024-09-16T01:54:28.145565+0000","last_clean":"2024-09-16T01:54:28.145565+0000","last_became_active":"2024-09-16T01:54:21.863683+0000","last_became_peered":"2024-09-16T01:54:21.863683+0000","last_unstale":"2024-09-16T01:54:28.145565+0000","last_undegraded":"2024-09-16T01:54:28.145565+0000","last_fullsized":"2024-09-16T01:54:28.145565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:31.678241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144985+0000","last_change":"2024-09-16T01:54:20.856924+0000","last_active":"2024-09-16T01:54:28.144985+0000","last_peered":"2024-09-16T01:54:28.144985+0000","last_clean":"2024-09-16T01:54:28.144985+0000","last_became_active":"2024-09-16T01:54:20.856528+0000","last_became_peered":"2024-09-16T01:54:20.856528+0000","last_unstale":"2024-09-16T01:54:28.144985+0000","last_undegraded":"2024-09-16T01:54:28.144985+0000","last_fullsized":"2024-09-16T01:54:28.144985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:47.012037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144803+0000","last_change":"2024-09-16T01:54:25.962300+0000","last_active":"2024-09-16T01:54:28.144803+0000","last_peered":"2024-09-16T01:54:28.144803+0000","last_clean":"2024-09-16T01:54:28.144803+0000","last_became_active":"2024-09-16T01:54:25.961846+0000","last_became_peered":"2024-09-16T01:54:25.961846+0000","last_unstale":"2024-09-16T01:54:28.144803+0000","last_undegraded":"2024-09-16T01:54:28.144803+0000","last_fullsized":"2024-09-16T01:54:28.144803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.629326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678252+0000","last_change":"2024-09-16T01:54:21.867183+0000","last_active":"2024-09-16T01:54:27.678252+0000","last_peered":"2024-09-16T01:54:27.678252+0000","last_clean":"2024-09-16T01:54:27.678252+0000","last_became_active":"2024-09-16T01:54:21.866359+0000","last_became_peered":"2024-09-16T01:54:21.866359+0000","last_unstale":"2024-09-16T01:54:27.678252+0000","last_undegraded":"2024-09-16T01:54:27.678252+0000","last_fullsized":"2024-09-16T01:54:27.678252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:10.597570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644565+0000","last_change":"2024-09-16T01:54:20.848769+0000","last_active":"2024-09-16T01:54:27.644565+0000","last_peered":"2024-09-16T01:54:27.644565+0000","last_clean":"2024-09-16T01:54:27.644565+0000","last_became_active":"2024-09-16T01:54:20.846526+0000","last_became_peered":"2024-09-16T01:54:20.846526+0000","last_unstale":"2024-09-16T01:54:27.644565+0000","last_undegraded":"2024-09-16T01:54:27.644565+0000","last_fullsized":"2024-09-16T01:54:27.644565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145456+0000","last_change":"2024-09-16T01:54:25.874322+0000","last_active":"2024-09-16T01:54:28.145456+0000","last_peered":"2024-09-16T01:54:28.145456+0000","last_clean":"2024-09-16T01:54:28.145456+0000","last_became_active":"2024-09-16T01:54:25.873916+0000","last_became_peered":"2024-09-16T01:54:25.873916+0000","last_unstale":"2024-09-16T01:54:28.145456+0000","last_undegraded":"2024-09-16T01:54:28.145456+0000","last_fullsized":"2024-09-16T01:54:28.145456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:58.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145950+0000","last_change":"2024-09-16T01:54:21.870995+0000","last_active":"2024-09-16T01:54:28.145950+0000","last_peered":"2024-09-16T01:54:28.145950+0000","last_clean":"2024-09-16T01:54:28.145950+0000","last_became_active":"2024-09-16T01:54:21.870452+0000","last_became_peered":"2024-09-16T01:54:21.870452+0000","last_unstale":"2024-09-16T01:54:28.145950+0000","last_undegraded":"2024-09-16T01:54:28.145950+0000","last_fullsized":"2024-09-16T01:54:28.145950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:04.838662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145304+0000","last_change":"2024-09-16T01:54:20.857994+0000","last_active":"2024-09-16T01:54:28.145304+0000","last_peered":"2024-09-16T01:54:28.145304+0000","last_clean":"2024-09-16T01:54:28.145304+0000","last_became_active":"2024-09-16T01:54:20.857622+0000","last_became_peered":"2024-09-16T01:54:20.857622+0000","last_unstale":"2024-09-16T01:54:28.145304+0000","last_undegraded":"2024-09-16T01:54:28.145304+0000","last_fullsized":"2024-09-16T01:54:28.145304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:45.730567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677827+0000","last_change":"2024-09-16T01:54:25.964331+0000","last_active":"2024-09-16T01:54:27.677827+0000","last_peered":"2024-09-16T01:54:27.677827+0000","last_clean":"2024-09-16T01:54:27.677827+0000","last_became_active":"2024-09-16T01:54:25.963969+0000","last_became_peered":"2024-09-16T01:54:25.963969+0000","last_unstale":"2024-09-16T01:54:27.677827+0000","last_undegraded":"2024-09-16T01:54:27.677827+0000","last_fullsized":"2024-09-16T01:54:27.677827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:06.129448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145804+0000","last_change":"2024-09-16T01:54:21.870195+0000","last_active":"2024-09-16T01:54:28.145804+0000","last_peered":"2024-09-16T01:54:28.145804+0000","last_clean":"2024-09-16T01:54:28.145804+0000","last_became_active":"2024-09-16T01:54:21.869739+0000","last_became_peered":"2024-09-16T01:54:21.869739+0000","last_unstale":"2024-09-16T01:54:28.145804+0000","last_undegraded":"2024-09-16T01:54:28.145804+0000","last_fullsized":"2024-09-16T01:54:28.145804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:16.366906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900025+0000","last_change":"2024-09-16T01:54:20.859086+0000","last_active":"2024-09-16T01:54:26.900025+0000","last_peered":"2024-09-16T01:54:26.900025+0000","last_clean":"2024-09-16T01:54:26.900025+0000","last_became_active":"2024-09-16T01:54:20.858783+0000","last_became_peered":"2024-09-16T01:54:20.858783+0000","last_unstale":"2024-09-16T01:54:26.900025+0000","last_undegraded":"2024-09-16T01:54:26.900025+0000","last_fullsized":"2024-09-16T01:54:26.900025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:39.081955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900245+0000","last_change":"2024-09-16T01:54:25.877090+0000","last_active":"2024-09-16T01:54:26.900245+0000","last_peered":"2024-09-16T01:54:26.900245+0000","last_clean":"2024-09-16T01:54:26.900245+0000","last_became_active":"2024-09-16T01:54:25.876626+0000","last_became_peered":"2024-09-16T01:54:25.876626+0000","last_unstale":"2024-09-16T01:54:26.900245+0000","last_undegraded":"2024-09-16T01:54:26.900245+0000","last_fullsized":"2024-09-16T01:54:26.900245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145343+0000","last_change":"2024-09-16T01:54:21.870018+0000","last_active":"2024-09-16T01:54:28.145343+0000","last_peered":"2024-09-16T01:54:28.145343+0000","last_clean":"2024-09-16T01:54:28.145343+0000","last_became_active":"2024-09-16T01:54:21.869334+0000","last_became_peered":"2024-09-16T01:54:21.869334+0000","last_unstale":"2024-09-16T01:54:28.145343+0000","last_undegraded":"2024-09-16T01:54:28.145343+0000","last_fullsized":"2024-09-16T01:54:28.145343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:18:36.899153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144191+0000","last_change":"2024-09-16T01:54:20.850043+0000","last_active":"2024-09-16T01:54:28.144191+0000","last_peered":"2024-09-16T01:54:28.144191+0000","last_clean":"2024-09-16T01:54:28.144191+0000","last_became_active":"2024-09-16T01:54:20.849690+0000","last_became_peered":"2024-09-16T01:54:20.849690+0000","last_unstale":"2024-09-16T01:54:28.144191+0000","last_undegraded":"2024-09-16T01:54:28.144191+0000","last_fullsized":"2024-09-16T01:54:28.144191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:20.932038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145156+0000","last_change":"2024-09-16T01:54:25.876135+0000","last_active":"2024-09-16T01:54:28.145156+0000","last_peered":"2024-09-16T01:54:28.145156+0000","last_clean":"2024-09-16T01:54:28.145156+0000","last_became_active":"2024-09-16T01:54:25.875631+0000","last_became_peered":"2024-09-16T01:54:25.875631+0000","last_unstale":"2024-09-16T01:54:28.145156+0000","last_undegraded":"2024-09-16T01:54:28.145156+0000","last_fullsized":"2024-09-16T01:54:28.145156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144759+0000","last_change":"2024-09-16T01:54:21.865673+0000","last_active":"2024-09-16T01:54:28.144759+0000","last_peered":"2024-09-16T01:54:28.144759+0000","last_clean":"2024-09-16T01:54:28.144759+0000","last_became_active":"2024-09-16T01:54:21.865342+0000","last_became_peered":"2024-09-16T01:54:21.865342+0000","last_unstale":"2024-09-16T01:54:28.144759+0000","last_undegraded":"2024-09-16T01:54:28.144759+0000","last_fullsized":"2024-09-16T01:54:28.144759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144766+0000","last_change":"2024-09-16T01:54:20.846994+0000","last_active":"2024-09-16T01:54:28.144766+0000","last_peered":"2024-09-16T01:54:28.144766+0000","last_clean":"2024-09-16T01:54:28.144766+0000","last_became_active":"2024-09-16T01:54:20.846665+0000","last_became_peered":"2024-09-16T01:54:20.846665+0000","last_unstale":"2024-09-16T01:54:28.144766+0000","last_undegraded":"2024-09-16T01:54:28.144766+0000","last_fullsized":"2024-09-16T01:54:28.144766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899670+0000","last_change":"2024-09-16T01:54:25.966412+0000","last_active":"2024-09-16T01:54:26.899670+0000","last_peered":"2024-09-16T01:54:26.899670+0000","last_clean":"2024-09-16T01:54:26.899670+0000","last_became_active":"2024-09-16T01:54:25.965845+0000","last_became_peered":"2024-09-16T01:54:25.965845+0000","last_unstale":"2024-09-16T01:54:26.899670+0000","last_undegraded":"2024-09-16T01:54:26.899670+0000","last_fullsized":"2024-09-16T01:54:26.899670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:35.279620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145627+0000","last_change":"2024-09-16T01:54:21.871992+0000","last_active":"2024-09-16T01:54:28.145627+0000","last_peered":"2024-09-16T01:54:28.145627+0000","last_clean":"2024-09-16T01:54:28.145627+0000","last_became_active":"2024-09-16T01:54:21.871674+0000","last_became_peered":"2024-09-16T01:54:21.871674+0000","last_unstale":"2024-09-16T01:54:28.145627+0000","last_undegraded":"2024-09-16T01:54:28.145627+0000","last_fullsized":"2024-09-16T01:54:28.145627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:27.694450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678279+0000","last_change":"2024-09-16T01:54:20.858600+0000","last_active":"2024-09-16T01:54:27.678279+0000","last_peered":"2024-09-16T01:54:27.678279+0000","last_clean":"2024-09-16T01:54:27.678279+0000","last_became_active":"2024-09-16T01:54:20.858244+0000","last_became_peered":"2024-09-16T01:54:20.858244+0000","last_unstale":"2024-09-16T01:54:27.678279+0000","last_undegraded":"2024-09-16T01:54:27.678279+0000","last_fullsized":"2024-09-16T01:54:27.678279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899103+0000","last_change":"2024-09-16T01:54:25.962396+0000","last_active":"2024-09-16T01:54:26.899103+0000","last_peered":"2024-09-16T01:54:26.899103+0000","last_clean":"2024-09-16T01:54:26.899103+0000","last_became_active":"2024-09-16T01:54:25.961648+0000","last_became_peered":"2024-09-16T01:54:25.961648+0000","last_unstale":"2024-09-16T01:54:26.899103+0000","last_undegraded":"2024-09-16T01:54:26.899103+0000","last_fullsized":"2024-09-16T01:54:26.899103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:45.131656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144942+0000","last_change":"2024-09-16T01:54:21.864888+0000","last_active":"2024-09-16T01:54:28.144942+0000","last_peered":"2024-09-16T01:54:28.144942+0000","last_clean":"2024-09-16T01:54:28.144942+0000","last_became_active":"2024-09-16T01:54:21.864577+0000","last_became_peered":"2024-09-16T01:54:21.864577+0000","last_unstale":"2024-09-16T01:54:28.144942+0000","last_undegraded":"2024-09-16T01:54:28.144942+0000","last_fullsized":"2024-09-16T01:54:28.144942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145550+0000","last_change":"2024-09-16T01:54:20.856921+0000","last_active":"2024-09-16T01:54:28.145550+0000","last_peered":"2024-09-16T01:54:28.145550+0000","last_clean":"2024-09-16T01:54:28.145550+0000","last_became_active":"2024-09-16T01:54:20.856618+0000","last_became_peered":"2024-09-16T01:54:20.856618+0000","last_unstale":"2024-09-16T01:54:28.145550+0000","last_undegraded":"2024-09-16T01:54:28.145550+0000","last_fullsized":"2024-09-16T01:54:28.145550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678404+0000","last_change":"2024-09-16T01:54:25.962306+0000","last_active":"2024-09-16T01:54:27.678404+0000","last_peered":"2024-09-16T01:54:27.678404+0000","last_clean":"2024-09-16T01:54:27.678404+0000","last_became_active":"2024-09-16T01:54:25.961904+0000","last_became_peered":"2024-09-16T01:54:25.961904+0000","last_unstale":"2024-09-16T01:54:27.678404+0000","last_undegraded":"2024-09-16T01:54:27.678404+0000","last_fullsized":"2024-09-16T01:54:27.678404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:21.665659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145442+0000","last_change":"2024-09-16T01:54:21.868099+0000","last_active":"2024-09-16T01:54:28.145442+0000","last_peered":"2024-09-16T01:54:28.145442+0000","last_clean":"2024-09-16T01:54:28.145442+0000","last_became_active":"2024-09-16T01:54:21.866809+0000","last_became_peered":"2024-09-16T01:54:21.866809+0000","last_unstale":"2024-09-16T01:54:28.145442+0000","last_undegraded":"2024-09-16T01:54:28.145442+0000","last_fullsized":"2024-09-16T01:54:28.145442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:54.265355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:31.368525+0000","last_change":"2024-09-16T01:54:20.858623+0000","last_active":"2024-09-16T01:54:31.368525+0000","last_peered":"2024-09-16T01:54:31.368525+0000","last_clean":"2024-09-16T01:54:31.368525+0000","last_became_active":"2024-09-16T01:54:20.858247+0000","last_became_peered":"2024-09-16T01:54:20.858247+0000","last_unstale":"2024-09-16T01:54:31.368525+0000","last_undegraded":"2024-09-16T01:54:31.368525+0000","last_fullsized":"2024-09-16T01:54:31.368525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644208+0000","last_change":"2024-09-16T01:54:25.877219+0000","last_active":"2024-09-16T01:54:27.644208+0000","last_peered":"2024-09-16T01:54:27.644208+0000","last_clean":"2024-09-16T01:54:27.644208+0000","last_became_active":"2024-09-16T01:54:25.876551+0000","last_became_peered":"2024-09-16T01:54:25.876551+0000","last_unstale":"2024-09-16T01:54:27.644208+0000","last_undegraded":"2024-09-16T01:54:27.644208+0000","last_fullsized":"2024-09-16T01:54:27.644208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:12.650374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900540+0000","last_change":"2024-09-16T01:54:21.869260+0000","last_active":"2024-09-16T01:54:26.900540+0000","last_peered":"2024-09-16T01:54:26.900540+0000","last_clean":"2024-09-16T01:54:26.900540+0000","last_became_active":"2024-09-16T01:54:21.868827+0000","last_became_peered":"2024-09-16T01:54:21.868827+0000","last_unstale":"2024-09-16T01:54:26.900540+0000","last_undegraded":"2024-09-16T01:54:26.900540+0000","last_fullsized":"2024-09-16T01:54:26.900540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:13.856305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644517+0000","last_change":"2024-09-16T01:54:20.857069+0000","last_active":"2024-09-16T01:54:27.644517+0000","last_peered":"2024-09-16T01:54:27.644517+0000","last_clean":"2024-09-16T01:54:27.644517+0000","last_became_active":"2024-09-16T01:54:20.856716+0000","last_became_peered":"2024-09-16T01:54:20.856716+0000","last_unstale":"2024-09-16T01:54:27.644517+0000","last_undegraded":"2024-09-16T01:54:27.644517+0000","last_fullsized":"2024-09-16T01:54:27.644517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900263+0000","last_change":"2024-09-16T01:54:25.877903+0000","last_active":"2024-09-16T01:54:26.900263+0000","last_peered":"2024-09-16T01:54:26.900263+0000","last_clean":"2024-09-16T01:54:26.900263+0000","last_became_active":"2024-09-16T01:54:25.877044+0000","last_became_peered":"2024-09-16T01:54:25.877044+0000","last_unstale":"2024-09-16T01:54:26.900263+0000","last_undegraded":"2024-09-16T01:54:26.900263+0000","last_fullsized":"2024-09-16T01:54:26.900263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.629326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145039+0000","last_change":"2024-09-16T01:54:21.867905+0000","last_active":"2024-09-16T01:54:28.145039+0000","last_peered":"2024-09-16T01:54:28.145039+0000","last_clean":"2024-09-16T01:54:28.145039+0000","last_became_active":"2024-09-16T01:54:21.867528+0000","last_became_peered":"2024-09-16T01:54:21.867528+0000","last_unstale":"2024-09-16T01:54:28.145039+0000","last_undegraded":"2024-09-16T01:54:28.145039+0000","last_fullsized":"2024-09-16T01:54:28.145039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678486+0000","last_change":"2024-09-16T01:54:20.857608+0000","last_active":"2024-09-16T01:54:27.678486+0000","last_peered":"2024-09-16T01:54:27.678486+0000","last_clean":"2024-09-16T01:54:27.678486+0000","last_became_active":"2024-09-16T01:54:20.857274+0000","last_became_peered":"2024-09-16T01:54:20.857274+0000","last_unstale":"2024-09-16T01:54:27.678486+0000","last_undegraded":"2024-09-16T01:54:27.678486+0000","last_fullsized":"2024-09-16T01:54:27.678486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898742+0000","last_change":"2024-09-16T01:54:25.882374+0000","last_active":"2024-09-16T01:54:26.898742+0000","last_peered":"2024-09-16T01:54:26.898742+0000","last_clean":"2024-09-16T01:54:26.898742+0000","last_became_active":"2024-09-16T01:54:25.881866+0000","last_became_peered":"2024-09-16T01:54:25.881866+0000","last_unstale":"2024-09-16T01:54:26.898742+0000","last_undegraded":"2024-09-16T01:54:26.898742+0000","last_fullsized":"2024-09-16T01:54:26.898742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:57.763504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678472+0000","last_change":"2024-09-16T01:54:21.867006+0000","last_active":"2024-09-16T01:54:27.678472+0000","last_peered":"2024-09-16T01:54:27.678472+0000","last_clean":"2024-09-16T01:54:27.678472+0000","last_became_active":"2024-09-16T01:54:21.866494+0000","last_became_peered":"2024-09-16T01:54:21.866494+0000","last_unstale":"2024-09-16T01:54:27.678472+0000","last_undegraded":"2024-09-16T01:54:27.678472+0000","last_fullsized":"2024-09-16T01:54:27.678472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:08.629741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145496+0000","last_change":"2024-09-16T01:54:20.856791+0000","last_active":"2024-09-16T01:54:28.145496+0000","last_peered":"2024-09-16T01:54:28.145496+0000","last_clean":"2024-09-16T01:54:28.145496+0000","last_became_active":"2024-09-16T01:54:20.856438+0000","last_became_peered":"2024-09-16T01:54:20.856438+0000","last_unstale":"2024-09-16T01:54:28.145496+0000","last_undegraded":"2024-09-16T01:54:28.145496+0000","last_fullsized":"2024-09-16T01:54:28.145496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898630+0000","last_change":"2024-09-16T01:54:25.965028+0000","last_active":"2024-09-16T01:54:26.898630+0000","last_peered":"2024-09-16T01:54:26.898630+0000","last_clean":"2024-09-16T01:54:26.898630+0000","last_became_active":"2024-09-16T01:54:25.964627+0000","last_became_peered":"2024-09-16T01:54:25.964627+0000","last_unstale":"2024-09-16T01:54:26.898630+0000","last_undegraded":"2024-09-16T01:54:26.898630+0000","last_fullsized":"2024-09-16T01:54:26.898630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:21.665659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144989+0000","last_change":"2024-09-16T01:54:25.964421+0000","last_active":"2024-09-16T01:54:28.144989+0000","last_peered":"2024-09-16T01:54:28.144989+0000","last_clean":"2024-09-16T01:54:28.144989+0000","last_became_active":"2024-09-16T01:54:25.964043+0000","last_became_peered":"2024-09-16T01:54:25.964043+0000","last_unstale":"2024-09-16T01:54:28.144989+0000","last_undegraded":"2024-09-16T01:54:28.144989+0000","last_fullsized":"2024-09-16T01:54:28.144989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643734+0000","last_change":"2024-09-16T01:54:21.854748+0000","last_active":"2024-09-16T01:54:27.643734+0000","last_peered":"2024-09-16T01:54:27.643734+0000","last_clean":"2024-09-16T01:54:27.643734+0000","last_became_active":"2024-09-16T01:54:21.854442+0000","last_became_peered":"2024-09-16T01:54:21.854442+0000","last_unstale":"2024-09-16T01:54:27.643734+0000","last_undegraded":"2024-09-16T01:54:27.643734+0000","last_fullsized":"2024-09-16T01:54:27.643734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678022+0000","last_change":"2024-09-16T01:54:20.857120+0000","last_active":"2024-09-16T01:54:27.678022+0000","last_peered":"2024-09-16T01:54:27.678022+0000","last_clean":"2024-09-16T01:54:27.678022+0000","last_became_active":"2024-09-16T01:54:20.855928+0000","last_became_peered":"2024-09-16T01:54:20.855928+0000","last_unstale":"2024-09-16T01:54:27.678022+0000","last_undegraded":"2024-09-16T01:54:27.678022+0000","last_fullsized":"2024-09-16T01:54:27.678022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145929+0000","last_change":"2024-09-16T01:54:25.881758+0000","last_active":"2024-09-16T01:54:28.145929+0000","last_peered":"2024-09-16T01:54:28.145929+0000","last_clean":"2024-09-16T01:54:28.145929+0000","last_became_active":"2024-09-16T01:54:25.881332+0000","last_became_peered":"2024-09-16T01:54:25.881332+0000","last_unstale":"2024-09-16T01:54:28.145929+0000","last_undegraded":"2024-09-16T01:54:28.145929+0000","last_fullsized":"2024-09-16T01:54:28.145929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898882+0000","last_change":"2024-09-16T01:54:21.862116+0000","last_active":"2024-09-16T01:54:26.898882+0000","last_peered":"2024-09-16T01:54:26.898882+0000","last_clean":"2024-09-16T01:54:26.898882+0000","last_became_active":"2024-09-16T01:54:21.861751+0000","last_became_peered":"2024-09-16T01:54:21.861751+0000","last_unstale":"2024-09-16T01:54:26.898882+0000","last_undegraded":"2024-09-16T01:54:26.898882+0000","last_fullsized":"2024-09-16T01:54:26.898882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898921+0000","last_change":"2024-09-16T01:54:20.851739+0000","last_active":"2024-09-16T01:54:26.898921+0000","last_peered":"2024-09-16T01:54:26.898921+0000","last_clean":"2024-09-16T01:54:26.898921+0000","last_became_active":"2024-09-16T01:54:20.851438+0000","last_became_peered":"2024-09-16T01:54:20.851438+0000","last_unstale":"2024-09-16T01:54:26.898921+0000","last_undegraded":"2024-09-16T01:54:26.898921+0000","last_fullsized":"2024-09-16T01:54:26.898921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:34:38.620678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145055+0000","last_change":"2024-09-16T01:54:20.850823+0000","last_active":"2024-09-16T01:54:28.145055+0000","last_peered":"2024-09-16T01:54:28.145055+0000","last_clean":"2024-09-16T01:54:28.145055+0000","last_became_active":"2024-09-16T01:54:20.850498+0000","last_became_peered":"2024-09-16T01:54:20.850498+0000","last_unstale":"2024-09-16T01:54:28.145055+0000","last_undegraded":"2024-09-16T01:54:28.145055+0000","last_fullsized":"2024-09-16T01:54:28.145055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145506+0000","last_change":"2024-09-16T01:54:21.864867+0000","last_active":"2024-09-16T01:54:28.145506+0000","last_peered":"2024-09-16T01:54:28.145506+0000","last_clean":"2024-09-16T01:54:28.145506+0000","last_became_active":"2024-09-16T01:54:21.863988+0000","last_became_peered":"2024-09-16T01:54:21.863988+0000","last_unstale":"2024-09-16T01:54:28.145506+0000","last_undegraded":"2024-09-16T01:54:28.145506+0000","last_fullsized":"2024-09-16T01:54:28.145506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144751+0000","last_change":"2024-09-16T01:54:25.883288+0000","last_active":"2024-09-16T01:54:28.144751+0000","last_peered":"2024-09-16T01:54:28.144751+0000","last_clean":"2024-09-16T01:54:28.144751+0000","last_became_active":"2024-09-16T01:54:25.882928+0000","last_became_peered":"2024-09-16T01:54:25.882928+0000","last_unstale":"2024-09-16T01:54:28.144751+0000","last_undegraded":"2024-09-16T01:54:28.144751+0000","last_fullsized":"2024-09-16T01:54:28.144751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:04.515824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899096+0000","last_change":"2024-09-16T01:54:20.852534+0000","last_active":"2024-09-16T01:54:26.899096+0000","last_peered":"2024-09-16T01:54:26.899096+0000","last_clean":"2024-09-16T01:54:26.899096+0000","last_became_active":"2024-09-16T01:54:20.852219+0000","last_became_peered":"2024-09-16T01:54:20.852219+0000","last_unstale":"2024-09-16T01:54:26.899096+0000","last_undegraded":"2024-09-16T01:54:26.899096+0000","last_fullsized":"2024-09-16T01:54:26.899096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899937+0000","last_change":"2024-09-16T01:54:21.850135+0000","last_active":"2024-09-16T01:54:26.899937+0000","last_peered":"2024-09-16T01:54:26.899937+0000","last_clean":"2024-09-16T01:54:26.899937+0000","last_became_active":"2024-09-16T01:54:21.849806+0000","last_became_peered":"2024-09-16T01:54:21.849806+0000","last_unstale":"2024-09-16T01:54:26.899937+0000","last_undegraded":"2024-09-16T01:54:26.899937+0000","last_fullsized":"2024-09-16T01:54:26.899937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:21.396408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899361+0000","last_change":"2024-09-16T01:54:25.881823+0000","last_active":"2024-09-16T01:54:26.899361+0000","last_peered":"2024-09-16T01:54:26.899361+0000","last_clean":"2024-09-16T01:54:26.899361+0000","last_became_active":"2024-09-16T01:54:25.881327+0000","last_became_peered":"2024-09-16T01:54:25.881327+0000","last_unstale":"2024-09-16T01:54:26.899361+0000","last_undegraded":"2024-09-16T01:54:26.899361+0000","last_fullsized":"2024-09-16T01:54:26.899361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:23.493442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144596+0000","last_change":"2024-09-16T01:54:21.865704+0000","last_active":"2024-09-16T01:54:28.144596+0000","last_peered":"2024-09-16T01:54:28.144596+0000","last_clean":"2024-09-16T01:54:28.144596+0000","last_became_active":"2024-09-16T01:54:21.865364+0000","last_became_peered":"2024-09-16T01:54:21.865364+0000","last_unstale":"2024-09-16T01:54:28.144596+0000","last_undegraded":"2024-09-16T01:54:28.144596+0000","last_fullsized":"2024-09-16T01:54:28.144596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144292+0000","last_change":"2024-09-16T01:54:21.856984+0000","last_active":"2024-09-16T01:54:28.144292+0000","last_peered":"2024-09-16T01:54:28.144292+0000","last_clean":"2024-09-16T01:54:28.144292+0000","last_became_active":"2024-09-16T01:54:21.856689+0000","last_became_peered":"2024-09-16T01:54:21.856689+0000","last_unstale":"2024-09-16T01:54:28.144292+0000","last_undegraded":"2024-09-16T01:54:28.144292+0000","last_fullsized":"2024-09-16T01:54:28.144292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:31.836291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678206+0000","last_change":"2024-09-16T01:54:21.857661+0000","last_active":"2024-09-16T01:54:27.678206+0000","last_peered":"2024-09-16T01:54:27.678206+0000","last_clean":"2024-09-16T01:54:27.678206+0000","last_became_active":"2024-09-16T01:54:21.857393+0000","last_became_peered":"2024-09-16T01:54:21.857393+0000","last_unstale":"2024-09-16T01:54:27.678206+0000","last_undegraded":"2024-09-16T01:54:27.678206+0000","last_fullsized":"2024-09-16T01:54:27.678206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:57.597318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145421+0000","last_change":"2024-09-16T01:54:21.864966+0000","last_active":"2024-09-16T01:54:28.145421+0000","last_peered":"2024-09-16T01:54:28.145421+0000","last_clean":"2024-09-16T01:54:28.145421+0000","last_became_active":"2024-09-16T01:54:21.864561+0000","last_became_peered":"2024-09-16T01:54:21.864561+0000","last_unstale":"2024-09-16T01:54:28.145421+0000","last_undegraded":"2024-09-16T01:54:28.145421+0000","last_fullsized":"2024-09-16T01:54:28.145421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899348+0000","last_change":"2024-09-16T01:54:21.870271+0000","last_active":"2024-09-16T01:54:26.899348+0000","last_peered":"2024-09-16T01:54:26.899348+0000","last_clean":"2024-09-16T01:54:26.899348+0000","last_became_active":"2024-09-16T01:54:21.869900+0000","last_became_peered":"2024-09-16T01:54:21.869900+0000","last_unstale":"2024-09-16T01:54:26.899348+0000","last_undegraded":"2024-09-16T01:54:26.899348+0000","last_fullsized":"2024-09-16T01:54:26.899348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644063+0000","last_change":"2024-09-16T01:54:21.855065+0000","last_active":"2024-09-16T01:54:27.644063+0000","last_peered":"2024-09-16T01:54:27.644063+0000","last_clean":"2024-09-16T01:54:27.644063+0000","last_became_active":"2024-09-16T01:54:21.854785+0000","last_became_peered":"2024-09-16T01:54:21.854785+0000","last_unstale":"2024-09-16T01:54:27.644063+0000","last_undegraded":"2024-09-16T01:54:27.644063+0000","last_fullsized":"2024-09-16T01:54:27.644063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.146008+0000","last_change":"2024-09-16T01:54:21.856250+0000","last_active":"2024-09-16T01:54:28.146008+0000","last_peered":"2024-09-16T01:54:28.146008+0000","last_clean":"2024-09-16T01:54:28.146008+0000","last_became_active":"2024-09-16T01:54:21.855867+0000","last_became_peered":"2024-09-16T01:54:21.855867+0000","last_unstale":"2024-09-16T01:54:28.146008+0000","last_undegraded":"2024-09-16T01:54:28.146008+0000","last_fullsized":"2024-09-16T01:54:28.146008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899585+0000","last_change":"2024-09-16T01:54:21.869651+0000","last_active":"2024-09-16T01:54:26.899585+0000","last_peered":"2024-09-16T01:54:26.899585+0000","last_clean":"2024-09-16T01:54:26.899585+0000","last_became_active":"2024-09-16T01:54:21.869363+0000","last_became_peered":"2024-09-16T01:54:21.869363+0000","last_unstale":"2024-09-16T01:54:26.899585+0000","last_undegraded":"2024-09-16T01:54:26.899585+0000","last_fullsized":"2024-09-16T01:54:26.899585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677969+0000","last_change":"2024-09-16T01:54:21.857499+0000","last_active":"2024-09-16T01:54:27.677969+0000","last_peered":"2024-09-16T01:54:27.677969+0000","last_clean":"2024-09-16T01:54:27.677969+0000","last_became_active":"2024-09-16T01:54:21.857215+0000","last_became_peered":"2024-09-16T01:54:21.857215+0000","last_unstale":"2024-09-16T01:54:27.677969+0000","last_undegraded":"2024-09-16T01:54:27.677969+0000","last_fullsized":"2024-09-16T01:54:27.677969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898805+0000","last_change":"2024-09-16T01:54:21.853265+0000","last_active":"2024-09-16T01:54:26.898805+0000","last_peered":"2024-09-16T01:54:26.898805+0000","last_clean":"2024-09-16T01:54:26.898805+0000","last_became_active":"2024-09-16T01:54:21.852863+0000","last_became_peered":"2024-09-16T01:54:21.852863+0000","last_unstale":"2024-09-16T01:54:26.898805+0000","last_undegraded":"2024-09-16T01:54:26.898805+0000","last_fullsized":"2024-09-16T01:54:26.898805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678154+0000","last_change":"2024-09-16T01:54:21.856726+0000","last_active":"2024-09-16T01:54:27.678154+0000","last_peered":"2024-09-16T01:54:27.678154+0000","last_clean":"2024-09-16T01:54:27.678154+0000","last_became_active":"2024-09-16T01:54:21.856432+0000","last_became_peered":"2024-09-16T01:54:21.856432+0000","last_unstale":"2024-09-16T01:54:27.678154+0000","last_undegraded":"2024-09-16T01:54:27.678154+0000","last_fullsized":"2024-09-16T01:54:27.678154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:29.948383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145040+0000","last_change":"2024-09-16T01:54:21.867340+0000","last_active":"2024-09-16T01:54:28.145040+0000","last_peered":"2024-09-16T01:54:28.145040+0000","last_clean":"2024-09-16T01:54:28.145040+0000","last_became_active":"2024-09-16T01:54:21.866029+0000","last_became_peered":"2024-09-16T01:54:21.866029+0000","last_unstale":"2024-09-16T01:54:28.145040+0000","last_undegraded":"2024-09-16T01:54:28.145040+0000","last_fullsized":"2024-09-16T01:54:28.145040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:33.360622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145155+0000","last_change":"2024-09-16T01:54:21.861066+0000","last_active":"2024-09-16T01:54:28.145155+0000","last_peered":"2024-09-16T01:54:28.145155+0000","last_clean":"2024-09-16T01:54:28.145155+0000","last_became_active":"2024-09-16T01:54:21.860305+0000","last_became_peered":"2024-09-16T01:54:21.860305+0000","last_unstale":"2024-09-16T01:54:28.145155+0000","last_undegraded":"2024-09-16T01:54:28.145155+0000","last_fullsized":"2024-09-16T01:54:28.145155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145799+0000","last_change":"2024-09-16T01:54:21.863878+0000","last_active":"2024-09-16T01:54:28.145799+0000","last_peered":"2024-09-16T01:54:28.145799+0000","last_clean":"2024-09-16T01:54:28.145799+0000","last_became_active":"2024-09-16T01:54:21.863277+0000","last_became_peered":"2024-09-16T01:54:21.863277+0000","last_unstale":"2024-09-16T01:54:28.145799+0000","last_undegraded":"2024-09-16T01:54:28.145799+0000","last_fullsized":"2024-09-16T01:54:28.145799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:38.741991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145254+0000","last_change":"2024-09-16T01:54:21.852758+0000","last_active":"2024-09-16T01:54:28.145254+0000","last_peered":"2024-09-16T01:54:28.145254+0000","last_clean":"2024-09-16T01:54:28.145254+0000","last_became_active":"2024-09-16T01:54:21.852429+0000","last_became_peered":"2024-09-16T01:54:21.852429+0000","last_unstale":"2024-09-16T01:54:28.145254+0000","last_undegraded":"2024-09-16T01:54:28.145254+0000","last_fullsized":"2024-09-16T01:54:28.145254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:33.722900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678582+0000","last_change":"2024-09-16T01:54:21.871495+0000","last_active":"2024-09-16T01:54:27.678582+0000","last_peered":"2024-09-16T01:54:27.678582+0000","last_clean":"2024-09-16T01:54:27.678582+0000","last_became_active":"2024-09-16T01:54:21.871213+0000","last_became_peered":"2024-09-16T01:54:21.871213+0000","last_unstale":"2024-09-16T01:54:27.678582+0000","last_undegraded":"2024-09-16T01:54:27.678582+0000","last_fullsized":"2024-09-16T01:54:27.678582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:29.854384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677857+0000","last_change":"2024-09-16T01:54:21.863733+0000","last_active":"2024-09-16T01:54:27.677857+0000","last_peered":"2024-09-16T01:54:27.677857+0000","last_clean":"2024-09-16T01:54:27.677857+0000","last_became_active":"2024-09-16T01:54:21.863426+0000","last_became_peered":"2024-09-16T01:54:21.863426+0000","last_unstale":"2024-09-16T01:54:27.677857+0000","last_undegraded":"2024-09-16T01:54:27.677857+0000","last_fullsized":"2024-09-16T01:54:27.677857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643815+0000","last_change":"2024-09-16T01:54:21.845049+0000","last_active":"2024-09-16T01:54:27.643815+0000","last_peered":"2024-09-16T01:54:27.643815+0000","last_clean":"2024-09-16T01:54:27.643815+0000","last_became_active":"2024-09-16T01:54:21.844746+0000","last_became_peered":"2024-09-16T01:54:21.844746+0000","last_unstale":"2024-09-16T01:54:27.643815+0000","last_undegraded":"2024-09-16T01:54:27.643815+0000","last_fullsized":"2024-09-16T01:54:27.643815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144803+0000","last_change":"2024-09-16T01:54:21.863916+0000","last_active":"2024-09-16T01:54:28.144803+0000","last_peered":"2024-09-16T01:54:28.144803+0000","last_clean":"2024-09-16T01:54:28.144803+0000","last_became_active":"2024-09-16T01:54:21.858949+0000","last_became_peered":"2024-09-16T01:54:21.858949+0000","last_unstale":"2024-09-16T01:54:28.144803+0000","last_undegraded":"2024-09-16T01:54:28.144803+0000","last_fullsized":"2024-09-16T01:54:28.144803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:06.850801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898941+0000","last_change":"2024-09-16T01:54:21.856929+0000","last_active":"2024-09-16T01:54:26.898941+0000","last_peered":"2024-09-16T01:54:26.898941+0000","last_clean":"2024-09-16T01:54:26.898941+0000","last_became_active":"2024-09-16T01:54:21.856610+0000","last_became_peered":"2024-09-16T01:54:21.856610+0000","last_unstale":"2024-09-16T01:54:26.898941+0000","last_undegraded":"2024-09-16T01:54:26.898941+0000","last_fullsized":"2024-09-16T01:54:26.898941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900438+0000","last_change":"2024-09-16T01:54:21.853558+0000","last_active":"2024-09-16T01:54:26.900438+0000","last_peered":"2024-09-16T01:54:26.900438+0000","last_clean":"2024-09-16T01:54:26.900438+0000","last_became_active":"2024-09-16T01:54:21.853234+0000","last_became_peered":"2024-09-16T01:54:21.853234+0000","last_unstale":"2024-09-16T01:54:26.900438+0000","last_undegraded":"2024-09-16T01:54:26.900438+0000","last_fullsized":"2024-09-16T01:54:26.900438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:58.346519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145294+0000","last_change":"2024-09-16T01:54:21.864089+0000","last_active":"2024-09-16T01:54:28.145294+0000","last_peered":"2024-09-16T01:54:28.145294+0000","last_clean":"2024-09-16T01:54:28.145294+0000","last_became_active":"2024-09-16T01:54:21.863778+0000","last_became_peered":"2024-09-16T01:54:21.863778+0000","last_unstale":"2024-09-16T01:54:28.145294+0000","last_undegraded":"2024-09-16T01:54:28.145294+0000","last_fullsized":"2024-09-16T01:54:28.145294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145937+0000","last_change":"2024-09-16T01:54:21.860265+0000","last_active":"2024-09-16T01:54:28.145937+0000","last_peered":"2024-09-16T01:54:28.145937+0000","last_clean":"2024-09-16T01:54:28.145937+0000","last_became_active":"2024-09-16T01:54:21.859906+0000","last_became_peered":"2024-09-16T01:54:21.859906+0000","last_unstale":"2024-09-16T01:54:28.145937+0000","last_undegraded":"2024-09-16T01:54:28.145937+0000","last_fullsized":"2024-09-16T01:54:28.145937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145883+0000","last_change":"2024-09-16T01:54:21.867977+0000","last_active":"2024-09-16T01:54:28.145883+0000","last_peered":"2024-09-16T01:54:28.145883+0000","last_clean":"2024-09-16T01:54:28.145883+0000","last_became_active":"2024-09-16T01:54:21.867663+0000","last_became_peered":"2024-09-16T01:54:21.867663+0000","last_unstale":"2024-09-16T01:54:28.145883+0000","last_undegraded":"2024-09-16T01:54:28.145883+0000","last_fullsized":"2024-09-16T01:54:28.145883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:17.473803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898589+0000","last_change":"2024-09-16T01:54:21.858992+0000","last_active":"2024-09-16T01:54:26.898589+0000","last_peered":"2024-09-16T01:54:26.898589+0000","last_clean":"2024-09-16T01:54:26.898589+0000","last_became_active":"2024-09-16T01:54:21.858478+0000","last_became_peered":"2024-09-16T01:54:21.858478+0000","last_unstale":"2024-09-16T01:54:26.898589+0000","last_undegraded":"2024-09-16T01:54:26.898589+0000","last_fullsized":"2024-09-16T01:54:26.898589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145247+0000","last_change":"2024-09-16T01:54:21.866468+0000","last_active":"2024-09-16T01:54:28.145247+0000","last_peered":"2024-09-16T01:54:28.145247+0000","last_clean":"2024-09-16T01:54:28.145247+0000","last_became_active":"2024-09-16T01:54:21.866127+0000","last_became_peered":"2024-09-16T01:54:21.866127+0000","last_unstale":"2024-09-16T01:54:28.145247+0000","last_undegraded":"2024-09-16T01:54:28.145247+0000","last_fullsized":"2024-09-16T01:54:28.145247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:15.758941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678085+0000","last_change":"2024-09-16T01:54:21.863734+0000","last_active":"2024-09-16T01:54:27.678085+0000","last_peered":"2024-09-16T01:54:27.678085+0000","last_clean":"2024-09-16T01:54:27.678085+0000","last_became_active":"2024-09-16T01:54:21.863440+0000","last_became_peered":"2024-09-16T01:54:21.863440+0000","last_unstale":"2024-09-16T01:54:27.678085+0000","last_undegraded":"2024-09-16T01:54:27.678085+0000","last_fullsized":"2024-09-16T01:54:27.678085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145475+0000","last_change":"2024-09-16T01:54:21.862517+0000","last_active":"2024-09-16T01:54:28.145475+0000","last_peered":"2024-09-16T01:54:28.145475+0000","last_clean":"2024-09-16T01:54:28.145475+0000","last_became_active":"2024-09-16T01:54:21.862211+0000","last_became_peered":"2024-09-16T01:54:21.862211+0000","last_unstale":"2024-09-16T01:54:28.145475+0000","last_undegraded":"2024-09-16T01:54:28.145475+0000","last_fullsized":"2024-09-16T01:54:28.145475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:12:08.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678116+0000","last_change":"2024-09-16T01:54:21.866825+0000","last_active":"2024-09-16T01:54:27.678116+0000","last_peered":"2024-09-16T01:54:27.678116+0000","last_clean":"2024-09-16T01:54:27.678116+0000","last_became_active":"2024-09-16T01:54:21.866552+0000","last_became_peered":"2024-09-16T01:54:21.866552+0000","last_unstale":"2024-09-16T01:54:27.678116+0000","last_undegraded":"2024-09-16T01:54:27.678116+0000","last_fullsized":"2024-09-16T01:54:27.678116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144763+0000","last_change":"2024-09-16T01:54:21.864915+0000","last_active":"2024-09-16T01:54:28.144763+0000","last_peered":"2024-09-16T01:54:28.144763+0000","last_clean":"2024-09-16T01:54:28.144763+0000","last_became_active":"2024-09-16T01:54:21.864522+0000","last_became_peered":"2024-09-16T01:54:21.864522+0000","last_unstale":"2024-09-16T01:54:28.144763+0000","last_undegraded":"2024-09-16T01:54:28.144763+0000","last_fullsized":"2024-09-16T01:54:28.144763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644314+0000","last_change":"2024-09-16T01:54:21.863988+0000","last_active":"2024-09-16T01:54:27.644314+0000","last_peered":"2024-09-16T01:54:27.644314+0000","last_clean":"2024-09-16T01:54:27.644314+0000","last_became_active":"2024-09-16T01:54:21.863692+0000","last_became_peered":"2024-09-16T01:54:21.863692+0000","last_unstale":"2024-09-16T01:54:27.644314+0000","last_undegraded":"2024-09-16T01:54:27.644314+0000","last_fullsized":"2024-09-16T01:54:27.644314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145865+0000","last_change":"2024-09-16T01:54:21.862642+0000","last_active":"2024-09-16T01:54:28.145865+0000","last_peered":"2024-09-16T01:54:28.145865+0000","last_clean":"2024-09-16T01:54:28.145865+0000","last_became_active":"2024-09-16T01:54:21.862364+0000","last_became_peered":"2024-09-16T01:54:21.862364+0000","last_unstale":"2024-09-16T01:54:28.145865+0000","last_undegraded":"2024-09-16T01:54:28.145865+0000","last_fullsized":"2024-09-16T01:54:28.145865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:37.651766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":106307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":102623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":693469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":102463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:54:41.925 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:54:42.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.060+0000 7f5693d4b640 1 Processor -- start 2024-09-16T01:54:42.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.060+0000 7f5693d4b640 1 -- start start 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f5693d4b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f568c0d30f0 0x7f568c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f5693d4b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f568c0b64c0 0x7f568c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f5693d4b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f568c0d3690 con 0x7f568c15e5f0 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f5693d4b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f568c06d530 con 0x7f568c0b64c0 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f5693d4b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f568c0d3970 con 0x7f568c0d30f0 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f56922e8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f568c0b64c0 0x7f568c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f5691ae7640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f568c15e5f0 0x7f568c0d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45360/0 (socket says 172.21.15.42:45360) 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f5691ae7640 1 -- 172.21.15.42:0/2450504554 learned_addr learned my addr 172.21.15.42:0/2450504554 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f56912e6640 1 --2- 172.21.15.42:0/2450504554 >> v2:172.21.15.107:3300/0 conn(0x7f568c0d30f0 0x7f568c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f56922e8640 1 -- 172.21.15.42:0/2450504554 >> v2:172.21.15.107:3300/0 conn(0x7f568c0d30f0 msgr2=0x7f568c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:42.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f56922e8640 1 --2- 172.21.15.42:0/2450504554 >> v2:172.21.15.107:3300/0 conn(0x7f568c0d30f0 0x7f568c0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f56922e8640 1 -- 172.21.15.42:0/2450504554 >> v1:172.21.15.42:6789/0 conn(0x7f568c15e5f0 legacy=0x7f568c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.061+0000 7f56922e8640 1 -- 172.21.15.42:0/2450504554 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c06cee0 con 0x7f568c0b64c0 2024-09-16T01:54:42.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.062+0000 7f56922e8640 1 --2- 172.21.15.42:0/2450504554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0b64c0 0x7f568c06d9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f568c08e520 tx=0x7f568402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8607959ea36714 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:42.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.062+0000 7f5690ae5640 1 -- 172.21.15.42:0/2450504554 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684037070 con 0x7f568c0b64c0 2024-09-16T01:54:42.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.062+0000 7f5690ae5640 1 -- 172.21.15.42:0/2450504554 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5684032440 con 0x7f568c0b64c0 2024-09-16T01:54:42.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.062+0000 7f5690ae5640 1 -- 172.21.15.42:0/2450504554 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684032810 con 0x7f568c0b64c0 2024-09-16T01:54:42.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.063+0000 7f5693d4b640 1 -- 172.21.15.42:0/2450504554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0b64c0 msgr2=0x7f568c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.063+0000 7f5693d4b640 1 --2- 172.21.15.42:0/2450504554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0b64c0 0x7f568c06d9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f568c08e520 tx=0x7f568402a1a0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.063+0000 7f5693d4b640 1 -- 172.21.15.42:0/2450504554 shutdown_connections 2024-09-16T01:54:42.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.063+0000 7f5693d4b640 1 --2- 172.21.15.42:0/2450504554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0b64c0 0x7f568c06d9c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.063+0000 7f5693d4b640 1 --2- 172.21.15.42:0/2450504554 >> v2:172.21.15.107:3300/0 conn(0x7f568c0d30f0 0x7f568c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.063+0000 7f5693d4b640 1 -- 172.21.15.42:0/2450504554 >> 172.21.15.42:0/2450504554 conn(0x7f568c08bfc0 msgr2=0x7f568c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:42.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.063+0000 7f5693d4b640 1 -- 172.21.15.42:0/2450504554 shutdown_connections 2024-09-16T01:54:42.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.063+0000 7f5693d4b640 1 -- 172.21.15.42:0/2450504554 wait complete. 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.064+0000 7f5693d4b640 1 Processor -- start 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.064+0000 7f5693d4b640 1 -- start start 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f5693d4b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f568c0b64c0 0x7f568c15d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f5693d4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0d30f0 0x7f568c0cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f5693d4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f568c15e5f0 0x7f568c14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f5693d4b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f568c06df00 con 0x7f568c0d30f0 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f5693d4b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f568c15e9d0 con 0x7f568c15e5f0 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f5693d4b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f568c06e080 con 0x7f568c0b64c0 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f56912e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0d30f0 0x7f568c0cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f56912e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0d30f0 0x7f568c0cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53130/0 (socket says 172.21.15.42:53130) 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f56912e6640 1 -- 172.21.15.42:0/3803513934 learned_addr learned my addr 172.21.15.42:0/3803513934 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:42.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f5691ae7640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f568c0b64c0 0x7f568c15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f56922e8640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f568c15e5f0 0x7f568c14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f56912e6640 1 -- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f568c0b64c0 msgr2=0x7f568c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f56912e6640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f568c0b64c0 0x7f568c15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f56912e6640 1 -- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f568c15e5f0 msgr2=0x7f568c14b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f56912e6640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f568c15e5f0 0x7f568c14b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f56912e6640 1 -- 172.21.15.42:0/3803513934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c149840 con 0x7f568c0d30f0 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.065+0000 7f56912e6640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0d30f0 0x7f568c0cacf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f567c00d800 tx=0x7f567c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.066+0000 7f56827fc640 1 -- 172.21.15.42:0/3803513934 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c00b6c0 con 0x7f568c0d30f0 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.066+0000 7f56827fc640 1 -- 172.21.15.42:0/3803513934 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c019070 con 0x7f568c0d30f0 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.066+0000 7f56827fc640 1 -- 172.21.15.42:0/3803513934 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c00ba80 con 0x7f568c0d30f0 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.066+0000 7f5693d4b640 1 -- 172.21.15.42:0/3803513934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568c0c8430 con 0x7f568c0d30f0 2024-09-16T01:54:42.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.066+0000 7f5693d4b640 1 -- 172.21.15.42:0/3803513934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f568c149ae0 con 0x7f568c0d30f0 2024-09-16T01:54:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.067+0000 7f5693d4b640 1 -- 172.21.15.42:0/3803513934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f568c06d9c0 con 0x7f568c0d30f0 2024-09-16T01:54:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.067+0000 7f56827fc640 1 -- 172.21.15.42:0/3803513934 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f567c00bc20 con 0x7f568c0d30f0 2024-09-16T01:54:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.068+0000 7f56827fc640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f567006c2b0 0x7f567006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.068+0000 7f56827fc640 1 -- 172.21.15.42:0/3803513934 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f567c08ba60 con 0x7f568c0d30f0 2024-09-16T01:54:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.068+0000 7f5691ae7640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f567006c2b0 0x7f567006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.069+0000 7f5691ae7640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f567006c2b0 0x7f567006e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56880012e0 tx=0x7f5688001990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:42.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.072+0000 7f56827fc640 1 -- 172.21.15.42:0/3803513934 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f567c0598d0 con 0x7f568c0d30f0 2024-09-16T01:54:42.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.244+0000 7f5693d4b640 1 -- 172.21.15.42:0/3803513934 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f568c0b6cf0 con 0x7f567006c2b0 2024-09-16T01:54:42.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.252+0000 7f56827fc640 1 -- 172.21.15.42:0/3803513934 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f568c0b6cf0 con 0x7f567006c2b0 2024-09-16T01:54:42.258 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:42.260 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:54:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 -- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f567006c2b0 msgr2=0x7f567006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f567006c2b0 0x7f567006e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56880012e0 tx=0x7f5688001990 comp rx=0 tx=0).stop 2024-09-16T01:54:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 -- 172.21.15.42:0/3803513934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0d30f0 msgr2=0x7f568c0cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0d30f0 0x7f568c0cacf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f567c00d800 tx=0x7f567c00dcc0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 -- 172.21.15.42:0/3803513934 shutdown_connections 2024-09-16T01:54:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f567006c2b0 0x7f567006e770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f568c15e5f0 0x7f568c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0d30f0 0x7f568c0cacf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 --2- 172.21.15.42:0/3803513934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f568c0b64c0 0x7f568c15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 -- 172.21.15.42:0/3803513934 >> 172.21.15.42:0/3803513934 conn(0x7f568c08bfc0 msgr2=0x7f568c0b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 -- 172.21.15.42:0/3803513934 shutdown_connections 2024-09-16T01:54:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.255+0000 7f5693d4b640 1 -- 172.21.15.42:0/3803513934 wait complete. 2024-09-16T01:54:42.268 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-16T01:54:40.253667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236100,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738620,"statfs":{"total":773094113280,"available":772852346880,"internally_reserved":0,"allocated":3317760,"data_stored":2009724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003123"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145216+0000","last_change":"2024-09-16T01:54:20.860255+0000","last_active":"2024-09-16T01:54:28.145216+0000","last_peered":"2024-09-16T01:54:28.145216+0000","last_clean":"2024-09-16T01:54:28.145216+0000","last_became_active":"2024-09-16T01:54:20.859944+0000","last_became_peered":"2024-09-16T01:54:20.859944+0000","last_unstale":"2024-09-16T01:54:28.145216+0000","last_undegraded":"2024-09-16T01:54:28.145216+0000","last_fullsized":"2024-09-16T01:54:28.145216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:39.081955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899508+0000","last_change":"2024-09-16T01:54:21.859551+0000","last_active":"2024-09-16T01:54:26.899508+0000","last_peered":"2024-09-16T01:54:26.899508+0000","last_clean":"2024-09-16T01:54:26.899508+0000","last_became_active":"2024-09-16T01:54:21.858047+0000","last_became_peered":"2024-09-16T01:54:21.858047+0000","last_unstale":"2024-09-16T01:54:26.899508+0000","last_undegraded":"2024-09-16T01:54:26.899508+0000","last_fullsized":"2024-09-16T01:54:26.899508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:29.948383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898563+0000","last_change":"2024-09-16T01:54:25.964125+0000","last_active":"2024-09-16T01:54:26.898563+0000","last_peered":"2024-09-16T01:54:26.898563+0000","last_clean":"2024-09-16T01:54:26.898563+0000","last_became_active":"2024-09-16T01:54:25.963738+0000","last_became_peered":"2024-09-16T01:54:25.963738+0000","last_unstale":"2024-09-16T01:54:26.898563+0000","last_undegraded":"2024-09-16T01:54:26.898563+0000","last_fullsized":"2024-09-16T01:54:26.898563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:06.129448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899601+0000","last_change":"2024-09-16T01:54:20.861025+0000","last_active":"2024-09-16T01:54:26.899601+0000","last_peered":"2024-09-16T01:54:26.899601+0000","last_clean":"2024-09-16T01:54:26.899601+0000","last_became_active":"2024-09-16T01:54:20.858817+0000","last_became_peered":"2024-09-16T01:54:20.858817+0000","last_unstale":"2024-09-16T01:54:26.899601+0000","last_undegraded":"2024-09-16T01:54:26.899601+0000","last_fullsized":"2024-09-16T01:54:26.899601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144849+0000","last_change":"2024-09-16T01:54:21.867670+0000","last_active":"2024-09-16T01:54:28.144849+0000","last_peered":"2024-09-16T01:54:28.144849+0000","last_clean":"2024-09-16T01:54:28.144849+0000","last_became_active":"2024-09-16T01:54:21.866666+0000","last_became_peered":"2024-09-16T01:54:21.866666+0000","last_unstale":"2024-09-16T01:54:28.144849+0000","last_undegraded":"2024-09-16T01:54:28.144849+0000","last_fullsized":"2024-09-16T01:54:28.144849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899530+0000","last_change":"2024-09-16T01:54:25.877304+0000","last_active":"2024-09-16T01:54:26.899530+0000","last_peered":"2024-09-16T01:54:26.899530+0000","last_clean":"2024-09-16T01:54:26.899530+0000","last_became_active":"2024-09-16T01:54:25.876643+0000","last_became_peered":"2024-09-16T01:54:25.876643+0000","last_unstale":"2024-09-16T01:54:26.899530+0000","last_undegraded":"2024-09-16T01:54:26.899530+0000","last_fullsized":"2024-09-16T01:54:26.899530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:15.866095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145670+0000","last_change":"2024-09-16T01:54:20.860557+0000","last_active":"2024-09-16T01:54:28.145670+0000","last_peered":"2024-09-16T01:54:28.145670+0000","last_clean":"2024-09-16T01:54:28.145670+0000","last_became_active":"2024-09-16T01:54:20.860254+0000","last_became_peered":"2024-09-16T01:54:20.860254+0000","last_unstale":"2024-09-16T01:54:28.145670+0000","last_undegraded":"2024-09-16T01:54:28.145670+0000","last_fullsized":"2024-09-16T01:54:28.145670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:16.893601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678222+0000","last_change":"2024-09-16T01:54:21.860466+0000","last_active":"2024-09-16T01:54:27.678222+0000","last_peered":"2024-09-16T01:54:27.678222+0000","last_clean":"2024-09-16T01:54:27.678222+0000","last_became_active":"2024-09-16T01:54:21.860191+0000","last_became_peered":"2024-09-16T01:54:21.860191+0000","last_unstale":"2024-09-16T01:54:27.678222+0000","last_undegraded":"2024-09-16T01:54:27.678222+0000","last_fullsized":"2024-09-16T01:54:27.678222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:47.165464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899752+0000","last_change":"2024-09-16T01:54:25.877667+0000","last_active":"2024-09-16T01:54:26.899752+0000","last_peered":"2024-09-16T01:54:26.899752+0000","last_clean":"2024-09-16T01:54:26.899752+0000","last_became_active":"2024-09-16T01:54:25.876568+0000","last_became_peered":"2024-09-16T01:54:25.876568+0000","last_unstale":"2024-09-16T01:54:26.899752+0000","last_undegraded":"2024-09-16T01:54:26.899752+0000","last_fullsized":"2024-09-16T01:54:26.899752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:33.969016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145351+0000","last_change":"2024-09-16T01:54:20.862062+0000","last_active":"2024-09-16T01:54:28.145351+0000","last_peered":"2024-09-16T01:54:28.145351+0000","last_clean":"2024-09-16T01:54:28.145351+0000","last_became_active":"2024-09-16T01:54:20.861764+0000","last_became_peered":"2024-09-16T01:54:20.861764+0000","last_unstale":"2024-09-16T01:54:28.145351+0000","last_undegraded":"2024-09-16T01:54:28.145351+0000","last_fullsized":"2024-09-16T01:54:28.145351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:02.378815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678304+0000","last_change":"2024-09-16T01:54:21.857448+0000","last_active":"2024-09-16T01:54:27.678304+0000","last_peered":"2024-09-16T01:54:27.678304+0000","last_clean":"2024-09-16T01:54:27.678304+0000","last_became_active":"2024-09-16T01:54:21.857131+0000","last_became_peered":"2024-09-16T01:54:21.857131+0000","last_unstale":"2024-09-16T01:54:27.678304+0000","last_undegraded":"2024-09-16T01:54:27.678304+0000","last_fullsized":"2024-09-16T01:54:27.678304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:46.608693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899648+0000","last_change":"2024-09-16T01:54:25.873795+0000","last_active":"2024-09-16T01:54:26.899648+0000","last_peered":"2024-09-16T01:54:26.899648+0000","last_clean":"2024-09-16T01:54:26.899648+0000","last_became_active":"2024-09-16T01:54:25.873379+0000","last_became_peered":"2024-09-16T01:54:25.873379+0000","last_unstale":"2024-09-16T01:54:26.899648+0000","last_undegraded":"2024-09-16T01:54:26.899648+0000","last_fullsized":"2024-09-16T01:54:26.899648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:43.663709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144634+0000","last_change":"2024-09-16T01:54:21.858785+0000","last_active":"2024-09-16T01:54:28.144634+0000","last_peered":"2024-09-16T01:54:28.144634+0000","last_clean":"2024-09-16T01:54:28.144634+0000","last_became_active":"2024-09-16T01:54:21.858450+0000","last_became_peered":"2024-09-16T01:54:21.858450+0000","last_unstale":"2024-09-16T01:54:28.144634+0000","last_undegraded":"2024-09-16T01:54:28.144634+0000","last_fullsized":"2024-09-16T01:54:28.144634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145654+0000","last_change":"2024-09-16T01:54:20.859619+0000","last_active":"2024-09-16T01:54:28.145654+0000","last_peered":"2024-09-16T01:54:28.145654+0000","last_clean":"2024-09-16T01:54:28.145654+0000","last_became_active":"2024-09-16T01:54:20.859348+0000","last_became_peered":"2024-09-16T01:54:20.859348+0000","last_unstale":"2024-09-16T01:54:28.145654+0000","last_undegraded":"2024-09-16T01:54:28.145654+0000","last_fullsized":"2024-09-16T01:54:28.145654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:32.717638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899990+0000","last_change":"2024-09-16T01:54:25.876988+0000","last_active":"2024-09-16T01:54:26.899990+0000","last_peered":"2024-09-16T01:54:26.899990+0000","last_clean":"2024-09-16T01:54:26.899990+0000","last_became_active":"2024-09-16T01:54:25.876405+0000","last_became_peered":"2024-09-16T01:54:25.876405+0000","last_unstale":"2024-09-16T01:54:26.899990+0000","last_undegraded":"2024-09-16T01:54:26.899990+0000","last_fullsized":"2024-09-16T01:54:26.899990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:51.186097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898948+0000","last_change":"2024-09-16T01:54:21.866597+0000","last_active":"2024-09-16T01:54:26.898948+0000","last_peered":"2024-09-16T01:54:26.898948+0000","last_clean":"2024-09-16T01:54:26.898948+0000","last_became_active":"2024-09-16T01:54:21.866303+0000","last_became_peered":"2024-09-16T01:54:21.866303+0000","last_unstale":"2024-09-16T01:54:26.898948+0000","last_undegraded":"2024-09-16T01:54:26.898948+0000","last_fullsized":"2024-09-16T01:54:26.898948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:57.597318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644331+0000","last_change":"2024-09-16T01:54:20.851271+0000","last_active":"2024-09-16T01:54:27.644331+0000","last_peered":"2024-09-16T01:54:27.644331+0000","last_clean":"2024-09-16T01:54:27.644331+0000","last_became_active":"2024-09-16T01:54:20.850597+0000","last_became_peered":"2024-09-16T01:54:20.850597+0000","last_unstale":"2024-09-16T01:54:27.644331+0000","last_undegraded":"2024-09-16T01:54:27.644331+0000","last_fullsized":"2024-09-16T01:54:27.644331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900473+0000","last_change":"2024-09-16T01:54:25.876997+0000","last_active":"2024-09-16T01:54:26.900473+0000","last_peered":"2024-09-16T01:54:26.900473+0000","last_clean":"2024-09-16T01:54:26.900473+0000","last_became_active":"2024-09-16T01:54:25.876501+0000","last_became_peered":"2024-09-16T01:54:25.876501+0000","last_unstale":"2024-09-16T01:54:26.900473+0000","last_undegraded":"2024-09-16T01:54:26.900473+0000","last_fullsized":"2024-09-16T01:54:26.900473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899001+0000","last_change":"2024-09-16T01:54:21.852096+0000","last_active":"2024-09-16T01:54:26.899001+0000","last_peered":"2024-09-16T01:54:26.899001+0000","last_clean":"2024-09-16T01:54:26.899001+0000","last_became_active":"2024-09-16T01:54:21.848364+0000","last_became_peered":"2024-09-16T01:54:21.848364+0000","last_unstale":"2024-09-16T01:54:26.899001+0000","last_undegraded":"2024-09-16T01:54:26.899001+0000","last_fullsized":"2024-09-16T01:54:26.899001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643861+0000","last_change":"2024-09-16T01:54:20.852050+0000","last_active":"2024-09-16T01:54:27.643861+0000","last_peered":"2024-09-16T01:54:27.643861+0000","last_clean":"2024-09-16T01:54:27.643861+0000","last_became_active":"2024-09-16T01:54:20.851725+0000","last_became_peered":"2024-09-16T01:54:20.851725+0000","last_unstale":"2024-09-16T01:54:27.643861+0000","last_undegraded":"2024-09-16T01:54:27.643861+0000","last_fullsized":"2024-09-16T01:54:27.643861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644337+0000","last_change":"2024-09-16T01:54:25.962379+0000","last_active":"2024-09-16T01:54:27.644337+0000","last_peered":"2024-09-16T01:54:27.644337+0000","last_clean":"2024-09-16T01:54:27.644337+0000","last_became_active":"2024-09-16T01:54:25.961815+0000","last_became_peered":"2024-09-16T01:54:25.961815+0000","last_unstale":"2024-09-16T01:54:27.644337+0000","last_undegraded":"2024-09-16T01:54:27.644337+0000","last_fullsized":"2024-09-16T01:54:27.644337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:58.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900426+0000","last_change":"2024-09-16T01:54:21.846558+0000","last_active":"2024-09-16T01:54:26.900426+0000","last_peered":"2024-09-16T01:54:26.900426+0000","last_clean":"2024-09-16T01:54:26.900426+0000","last_became_active":"2024-09-16T01:54:21.846226+0000","last_became_peered":"2024-09-16T01:54:21.846226+0000","last_unstale":"2024-09-16T01:54:26.900426+0000","last_undegraded":"2024-09-16T01:54:26.900426+0000","last_fullsized":"2024-09-16T01:54:26.900426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:22.658145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144908+0000","last_change":"2024-09-16T01:54:20.857121+0000","last_active":"2024-09-16T01:54:28.144908+0000","last_peered":"2024-09-16T01:54:28.144908+0000","last_clean":"2024-09-16T01:54:28.144908+0000","last_became_active":"2024-09-16T01:54:20.856852+0000","last_became_peered":"2024-09-16T01:54:20.856852+0000","last_unstale":"2024-09-16T01:54:28.144908+0000","last_undegraded":"2024-09-16T01:54:28.144908+0000","last_fullsized":"2024-09-16T01:54:28.144908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:40.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899928+0000","last_change":"2024-09-16T01:54:25.883440+0000","last_active":"2024-09-16T01:54:26.899928+0000","last_peered":"2024-09-16T01:54:26.899928+0000","last_clean":"2024-09-16T01:54:26.899928+0000","last_became_active":"2024-09-16T01:54:25.883010+0000","last_became_peered":"2024-09-16T01:54:25.883010+0000","last_unstale":"2024-09-16T01:54:26.899928+0000","last_undegraded":"2024-09-16T01:54:26.899928+0000","last_fullsized":"2024-09-16T01:54:26.899928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:00:01.617950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145309+0000","last_change":"2024-09-16T01:54:21.851620+0000","last_active":"2024-09-16T01:54:28.145309+0000","last_peered":"2024-09-16T01:54:28.145309+0000","last_clean":"2024-09-16T01:54:28.145309+0000","last_became_active":"2024-09-16T01:54:21.851295+0000","last_became_peered":"2024-09-16T01:54:21.851295+0000","last_unstale":"2024-09-16T01:54:28.145309+0000","last_undegraded":"2024-09-16T01:54:28.145309+0000","last_fullsized":"2024-09-16T01:54:28.145309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.146152+0000","last_change":"2024-09-16T01:54:20.852819+0000","last_active":"2024-09-16T01:54:28.146152+0000","last_peered":"2024-09-16T01:54:28.146152+0000","last_clean":"2024-09-16T01:54:28.146152+0000","last_became_active":"2024-09-16T01:54:20.852524+0000","last_became_peered":"2024-09-16T01:54:20.852524+0000","last_unstale":"2024-09-16T01:54:28.146152+0000","last_undegraded":"2024-09-16T01:54:28.146152+0000","last_fullsized":"2024-09-16T01:54:28.146152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899618+0000","last_change":"2024-09-16T01:54:25.964272+0000","last_active":"2024-09-16T01:54:26.899618+0000","last_peered":"2024-09-16T01:54:26.899618+0000","last_clean":"2024-09-16T01:54:26.899618+0000","last_became_active":"2024-09-16T01:54:25.963859+0000","last_became_peered":"2024-09-16T01:54:25.963859+0000","last_unstale":"2024-09-16T01:54:26.899618+0000","last_undegraded":"2024-09-16T01:54:26.899618+0000","last_fullsized":"2024-09-16T01:54:26.899618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:46.344559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899722+0000","last_change":"2024-09-16T01:54:21.857608+0000","last_active":"2024-09-16T01:54:26.899722+0000","last_peered":"2024-09-16T01:54:26.899722+0000","last_clean":"2024-09-16T01:54:26.899722+0000","last_became_active":"2024-09-16T01:54:21.857318+0000","last_became_peered":"2024-09-16T01:54:21.857318+0000","last_unstale":"2024-09-16T01:54:26.899722+0000","last_undegraded":"2024-09-16T01:54:26.899722+0000","last_fullsized":"2024-09-16T01:54:26.899722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644409+0000","last_change":"2024-09-16T01:54:20.852273+0000","last_active":"2024-09-16T01:54:27.644409+0000","last_peered":"2024-09-16T01:54:27.644409+0000","last_clean":"2024-09-16T01:54:27.644409+0000","last_became_active":"2024-09-16T01:54:20.850797+0000","last_became_peered":"2024-09-16T01:54:20.850797+0000","last_unstale":"2024-09-16T01:54:27.644409+0000","last_undegraded":"2024-09-16T01:54:27.644409+0000","last_fullsized":"2024-09-16T01:54:27.644409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898502+0000","last_change":"2024-09-16T01:54:25.962387+0000","last_active":"2024-09-16T01:54:26.898502+0000","last_peered":"2024-09-16T01:54:26.898502+0000","last_clean":"2024-09-16T01:54:26.898502+0000","last_became_active":"2024-09-16T01:54:25.961663+0000","last_became_peered":"2024-09-16T01:54:25.961663+0000","last_unstale":"2024-09-16T01:54:26.898502+0000","last_undegraded":"2024-09-16T01:54:26.898502+0000","last_fullsized":"2024-09-16T01:54:26.898502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:47:57.197478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644408+0000","last_change":"2024-09-16T01:54:21.847291+0000","last_active":"2024-09-16T01:54:27.644408+0000","last_peered":"2024-09-16T01:54:27.644408+0000","last_clean":"2024-09-16T01:54:27.644408+0000","last_became_active":"2024-09-16T01:54:21.847040+0000","last_became_peered":"2024-09-16T01:54:21.847040+0000","last_unstale":"2024-09-16T01:54:27.644408+0000","last_undegraded":"2024-09-16T01:54:27.644408+0000","last_fullsized":"2024-09-16T01:54:27.644408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145796+0000","last_change":"2024-09-16T01:54:20.858004+0000","last_active":"2024-09-16T01:54:28.145796+0000","last_peered":"2024-09-16T01:54:28.145796+0000","last_clean":"2024-09-16T01:54:28.145796+0000","last_became_active":"2024-09-16T01:54:20.857658+0000","last_became_peered":"2024-09-16T01:54:20.857658+0000","last_unstale":"2024-09-16T01:54:28.145796+0000","last_undegraded":"2024-09-16T01:54:28.145796+0000","last_fullsized":"2024-09-16T01:54:28.145796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:30.831030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144709+0000","last_change":"2024-09-16T01:54:25.962169+0000","last_active":"2024-09-16T01:54:28.144709+0000","last_peered":"2024-09-16T01:54:28.144709+0000","last_clean":"2024-09-16T01:54:28.144709+0000","last_became_active":"2024-09-16T01:54:25.961782+0000","last_became_peered":"2024-09-16T01:54:25.961782+0000","last_unstale":"2024-09-16T01:54:28.144709+0000","last_undegraded":"2024-09-16T01:54:28.144709+0000","last_fullsized":"2024-09-16T01:54:28.144709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:33.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678479+0000","last_change":"2024-09-16T01:54:21.867456+0000","last_active":"2024-09-16T01:54:27.678479+0000","last_peered":"2024-09-16T01:54:27.678479+0000","last_clean":"2024-09-16T01:54:27.678479+0000","last_became_active":"2024-09-16T01:54:21.867216+0000","last_became_peered":"2024-09-16T01:54:21.867216+0000","last_unstale":"2024-09-16T01:54:27.678479+0000","last_undegraded":"2024-09-16T01:54:27.678479+0000","last_fullsized":"2024-09-16T01:54:27.678479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:35.318988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644449+0000","last_change":"2024-09-16T01:54:20.859065+0000","last_active":"2024-09-16T01:54:27.644449+0000","last_peered":"2024-09-16T01:54:27.644449+0000","last_clean":"2024-09-16T01:54:27.644449+0000","last_became_active":"2024-09-16T01:54:20.858786+0000","last_became_peered":"2024-09-16T01:54:20.858786+0000","last_unstale":"2024-09-16T01:54:27.644449+0000","last_undegraded":"2024-09-16T01:54:27.644449+0000","last_fullsized":"2024-09-16T01:54:27.644449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643956+0000","last_change":"2024-09-16T01:54:25.879436+0000","last_active":"2024-09-16T01:54:27.643956+0000","last_peered":"2024-09-16T01:54:27.643956+0000","last_clean":"2024-09-16T01:54:27.643956+0000","last_became_active":"2024-09-16T01:54:25.878984+0000","last_became_peered":"2024-09-16T01:54:25.878984+0000","last_unstale":"2024-09-16T01:54:27.643956+0000","last_undegraded":"2024-09-16T01:54:27.643956+0000","last_fullsized":"2024-09-16T01:54:27.643956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900343+0000","last_change":"2024-09-16T01:54:21.860170+0000","last_active":"2024-09-16T01:54:26.900343+0000","last_peered":"2024-09-16T01:54:26.900343+0000","last_clean":"2024-09-16T01:54:26.900343+0000","last_became_active":"2024-09-16T01:54:21.859874+0000","last_became_peered":"2024-09-16T01:54:21.859874+0000","last_unstale":"2024-09-16T01:54:26.900343+0000","last_undegraded":"2024-09-16T01:54:26.900343+0000","last_fullsized":"2024-09-16T01:54:26.900343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:59.832590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678402+0000","last_change":"2024-09-16T01:54:20.857370+0000","last_active":"2024-09-16T01:54:27.678402+0000","last_peered":"2024-09-16T01:54:27.678402+0000","last_clean":"2024-09-16T01:54:27.678402+0000","last_became_active":"2024-09-16T01:54:20.856000+0000","last_became_peered":"2024-09-16T01:54:20.856000+0000","last_unstale":"2024-09-16T01:54:27.678402+0000","last_undegraded":"2024-09-16T01:54:27.678402+0000","last_fullsized":"2024-09-16T01:54:27.678402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644309+0000","last_change":"2024-09-16T01:54:25.880804+0000","last_active":"2024-09-16T01:54:27.644309+0000","last_peered":"2024-09-16T01:54:27.644309+0000","last_clean":"2024-09-16T01:54:27.644309+0000","last_became_active":"2024-09-16T01:54:25.880417+0000","last_became_peered":"2024-09-16T01:54:25.880417+0000","last_unstale":"2024-09-16T01:54:27.644309+0000","last_undegraded":"2024-09-16T01:54:27.644309+0000","last_fullsized":"2024-09-16T01:54:27.644309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:33.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643890+0000","last_change":"2024-09-16T01:54:21.845793+0000","last_active":"2024-09-16T01:54:27.643890+0000","last_peered":"2024-09-16T01:54:27.643890+0000","last_clean":"2024-09-16T01:54:27.643890+0000","last_became_active":"2024-09-16T01:54:21.845499+0000","last_became_peered":"2024-09-16T01:54:21.845499+0000","last_unstale":"2024-09-16T01:54:27.643890+0000","last_undegraded":"2024-09-16T01:54:27.643890+0000","last_fullsized":"2024-09-16T01:54:27.643890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144310+0000","last_change":"2024-09-16T01:54:20.858565+0000","last_active":"2024-09-16T01:54:28.144310+0000","last_peered":"2024-09-16T01:54:28.144310+0000","last_clean":"2024-09-16T01:54:28.144310+0000","last_became_active":"2024-09-16T01:54:20.858190+0000","last_became_peered":"2024-09-16T01:54:20.858190+0000","last_unstale":"2024-09-16T01:54:28.144310+0000","last_undegraded":"2024-09-16T01:54:28.144310+0000","last_fullsized":"2024-09-16T01:54:28.144310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:08.777600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644440+0000","last_change":"2024-09-16T01:54:25.880758+0000","last_active":"2024-09-16T01:54:27.644440+0000","last_peered":"2024-09-16T01:54:27.644440+0000","last_clean":"2024-09-16T01:54:27.644440+0000","last_became_active":"2024-09-16T01:54:25.879929+0000","last_became_peered":"2024-09-16T01:54:25.879929+0000","last_unstale":"2024-09-16T01:54:27.644440+0000","last_undegraded":"2024-09-16T01:54:27.644440+0000","last_fullsized":"2024-09-16T01:54:27.644440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:40:09.544682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144567+0000","last_change":"2024-09-16T01:54:21.859563+0000","last_active":"2024-09-16T01:54:28.144567+0000","last_peered":"2024-09-16T01:54:28.144567+0000","last_clean":"2024-09-16T01:54:28.144567+0000","last_became_active":"2024-09-16T01:54:21.859284+0000","last_became_peered":"2024-09-16T01:54:21.859284+0000","last_unstale":"2024-09-16T01:54:28.144567+0000","last_undegraded":"2024-09-16T01:54:28.144567+0000","last_fullsized":"2024-09-16T01:54:28.144567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:28.740307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145101+0000","last_change":"2024-09-16T01:54:20.860054+0000","last_active":"2024-09-16T01:54:28.145101+0000","last_peered":"2024-09-16T01:54:28.145101+0000","last_clean":"2024-09-16T01:54:28.145101+0000","last_became_active":"2024-09-16T01:54:20.859714+0000","last_became_peered":"2024-09-16T01:54:20.859714+0000","last_unstale":"2024-09-16T01:54:28.145101+0000","last_undegraded":"2024-09-16T01:54:28.145101+0000","last_fullsized":"2024-09-16T01:54:28.145101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:25.346654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145185+0000","last_change":"2024-09-16T01:54:25.963523+0000","last_active":"2024-09-16T01:54:28.145185+0000","last_peered":"2024-09-16T01:54:28.145185+0000","last_clean":"2024-09-16T01:54:28.145185+0000","last_became_active":"2024-09-16T01:54:25.963160+0000","last_became_peered":"2024-09-16T01:54:25.963160+0000","last_unstale":"2024-09-16T01:54:28.145185+0000","last_undegraded":"2024-09-16T01:54:28.145185+0000","last_fullsized":"2024-09-16T01:54:28.145185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:12.650374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898701+0000","last_change":"2024-09-16T01:54:21.859137+0000","last_active":"2024-09-16T01:54:26.898701+0000","last_peered":"2024-09-16T01:54:26.898701+0000","last_clean":"2024-09-16T01:54:26.898701+0000","last_became_active":"2024-09-16T01:54:21.858467+0000","last_became_peered":"2024-09-16T01:54:21.858467+0000","last_unstale":"2024-09-16T01:54:26.898701+0000","last_undegraded":"2024-09-16T01:54:26.898701+0000","last_fullsized":"2024-09-16T01:54:26.898701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678105+0000","last_change":"2024-09-16T01:54:20.855557+0000","last_active":"2024-09-16T01:54:27.678105+0000","last_peered":"2024-09-16T01:54:27.678105+0000","last_clean":"2024-09-16T01:54:27.678105+0000","last_became_active":"2024-09-16T01:54:20.855024+0000","last_became_peered":"2024-09-16T01:54:20.855024+0000","last_unstale":"2024-09-16T01:54:27.678105+0000","last_undegraded":"2024-09-16T01:54:27.678105+0000","last_fullsized":"2024-09-16T01:54:27.678105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145216+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:54:28.145216+0000","last_peered":"2024-09-16T01:54:28.145216+0000","last_clean":"2024-09-16T01:54:28.145216+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:54:28.145216+0000","last_undegraded":"2024-09-16T01:54:28.145216+0000","last_fullsized":"2024-09-16T01:54:28.145216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145100+0000","last_change":"2024-09-16T01:54:25.963720+0000","last_active":"2024-09-16T01:54:28.145100+0000","last_peered":"2024-09-16T01:54:28.145100+0000","last_clean":"2024-09-16T01:54:28.145100+0000","last_became_active":"2024-09-16T01:54:25.963290+0000","last_became_peered":"2024-09-16T01:54:25.963290+0000","last_unstale":"2024-09-16T01:54:28.145100+0000","last_undegraded":"2024-09-16T01:54:28.145100+0000","last_fullsized":"2024-09-16T01:54:28.145100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145565+0000","last_change":"2024-09-16T01:54:21.863989+0000","last_active":"2024-09-16T01:54:28.145565+0000","last_peered":"2024-09-16T01:54:28.145565+0000","last_clean":"2024-09-16T01:54:28.145565+0000","last_became_active":"2024-09-16T01:54:21.863683+0000","last_became_peered":"2024-09-16T01:54:21.863683+0000","last_unstale":"2024-09-16T01:54:28.145565+0000","last_undegraded":"2024-09-16T01:54:28.145565+0000","last_fullsized":"2024-09-16T01:54:28.145565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:31.678241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144985+0000","last_change":"2024-09-16T01:54:20.856924+0000","last_active":"2024-09-16T01:54:28.144985+0000","last_peered":"2024-09-16T01:54:28.144985+0000","last_clean":"2024-09-16T01:54:28.144985+0000","last_became_active":"2024-09-16T01:54:20.856528+0000","last_became_peered":"2024-09-16T01:54:20.856528+0000","last_unstale":"2024-09-16T01:54:28.144985+0000","last_undegraded":"2024-09-16T01:54:28.144985+0000","last_fullsized":"2024-09-16T01:54:28.144985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:47.012037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144803+0000","last_change":"2024-09-16T01:54:25.962300+0000","last_active":"2024-09-16T01:54:28.144803+0000","last_peered":"2024-09-16T01:54:28.144803+0000","last_clean":"2024-09-16T01:54:28.144803+0000","last_became_active":"2024-09-16T01:54:25.961846+0000","last_became_peered":"2024-09-16T01:54:25.961846+0000","last_unstale":"2024-09-16T01:54:28.144803+0000","last_undegraded":"2024-09-16T01:54:28.144803+0000","last_fullsized":"2024-09-16T01:54:28.144803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.629326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678252+0000","last_change":"2024-09-16T01:54:21.867183+0000","last_active":"2024-09-16T01:54:27.678252+0000","last_peered":"2024-09-16T01:54:27.678252+0000","last_clean":"2024-09-16T01:54:27.678252+0000","last_became_active":"2024-09-16T01:54:21.866359+0000","last_became_peered":"2024-09-16T01:54:21.866359+0000","last_unstale":"2024-09-16T01:54:27.678252+0000","last_undegraded":"2024-09-16T01:54:27.678252+0000","last_fullsized":"2024-09-16T01:54:27.678252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:10.597570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644565+0000","last_change":"2024-09-16T01:54:20.848769+0000","last_active":"2024-09-16T01:54:27.644565+0000","last_peered":"2024-09-16T01:54:27.644565+0000","last_clean":"2024-09-16T01:54:27.644565+0000","last_became_active":"2024-09-16T01:54:20.846526+0000","last_became_peered":"2024-09-16T01:54:20.846526+0000","last_unstale":"2024-09-16T01:54:27.644565+0000","last_undegraded":"2024-09-16T01:54:27.644565+0000","last_fullsized":"2024-09-16T01:54:27.644565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145456+0000","last_change":"2024-09-16T01:54:25.874322+0000","last_active":"2024-09-16T01:54:28.145456+0000","last_peered":"2024-09-16T01:54:28.145456+0000","last_clean":"2024-09-16T01:54:28.145456+0000","last_became_active":"2024-09-16T01:54:25.873916+0000","last_became_peered":"2024-09-16T01:54:25.873916+0000","last_unstale":"2024-09-16T01:54:28.145456+0000","last_undegraded":"2024-09-16T01:54:28.145456+0000","last_fullsized":"2024-09-16T01:54:28.145456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:58.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145950+0000","last_change":"2024-09-16T01:54:21.870995+0000","last_active":"2024-09-16T01:54:28.145950+0000","last_peered":"2024-09-16T01:54:28.145950+0000","last_clean":"2024-09-16T01:54:28.145950+0000","last_became_active":"2024-09-16T01:54:21.870452+0000","last_became_peered":"2024-09-16T01:54:21.870452+0000","last_unstale":"2024-09-16T01:54:28.145950+0000","last_undegraded":"2024-09-16T01:54:28.145950+0000","last_fullsized":"2024-09-16T01:54:28.145950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:04.838662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145304+0000","last_change":"2024-09-16T01:54:20.857994+0000","last_active":"2024-09-16T01:54:28.145304+0000","last_peered":"2024-09-16T01:54:28.145304+0000","last_clean":"2024-09-16T01:54:28.145304+0000","last_became_active":"2024-09-16T01:54:20.857622+0000","last_became_peered":"2024-09-16T01:54:20.857622+0000","last_unstale":"2024-09-16T01:54:28.145304+0000","last_undegraded":"2024-09-16T01:54:28.145304+0000","last_fullsized":"2024-09-16T01:54:28.145304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:45.730567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677827+0000","last_change":"2024-09-16T01:54:25.964331+0000","last_active":"2024-09-16T01:54:27.677827+0000","last_peered":"2024-09-16T01:54:27.677827+0000","last_clean":"2024-09-16T01:54:27.677827+0000","last_became_active":"2024-09-16T01:54:25.963969+0000","last_became_peered":"2024-09-16T01:54:25.963969+0000","last_unstale":"2024-09-16T01:54:27.677827+0000","last_undegraded":"2024-09-16T01:54:27.677827+0000","last_fullsized":"2024-09-16T01:54:27.677827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:06.129448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145804+0000","last_change":"2024-09-16T01:54:21.870195+0000","last_active":"2024-09-16T01:54:28.145804+0000","last_peered":"2024-09-16T01:54:28.145804+0000","last_clean":"2024-09-16T01:54:28.145804+0000","last_became_active":"2024-09-16T01:54:21.869739+0000","last_became_peered":"2024-09-16T01:54:21.869739+0000","last_unstale":"2024-09-16T01:54:28.145804+0000","last_undegraded":"2024-09-16T01:54:28.145804+0000","last_fullsized":"2024-09-16T01:54:28.145804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:16.366906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900025+0000","last_change":"2024-09-16T01:54:20.859086+0000","last_active":"2024-09-16T01:54:26.900025+0000","last_peered":"2024-09-16T01:54:26.900025+0000","last_clean":"2024-09-16T01:54:26.900025+0000","last_became_active":"2024-09-16T01:54:20.858783+0000","last_became_peered":"2024-09-16T01:54:20.858783+0000","last_unstale":"2024-09-16T01:54:26.900025+0000","last_undegraded":"2024-09-16T01:54:26.900025+0000","last_fullsized":"2024-09-16T01:54:26.900025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:39.081955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900245+0000","last_change":"2024-09-16T01:54:25.877090+0000","last_active":"2024-09-16T01:54:26.900245+0000","last_peered":"2024-09-16T01:54:26.900245+0000","last_clean":"2024-09-16T01:54:26.900245+0000","last_became_active":"2024-09-16T01:54:25.876626+0000","last_became_peered":"2024-09-16T01:54:25.876626+0000","last_unstale":"2024-09-16T01:54:26.900245+0000","last_undegraded":"2024-09-16T01:54:26.900245+0000","last_fullsized":"2024-09-16T01:54:26.900245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145343+0000","last_change":"2024-09-16T01:54:21.870018+0000","last_active":"2024-09-16T01:54:28.145343+0000","last_peered":"2024-09-16T01:54:28.145343+0000","last_clean":"2024-09-16T01:54:28.145343+0000","last_became_active":"2024-09-16T01:54:21.869334+0000","last_became_peered":"2024-09-16T01:54:21.869334+0000","last_unstale":"2024-09-16T01:54:28.145343+0000","last_undegraded":"2024-09-16T01:54:28.145343+0000","last_fullsized":"2024-09-16T01:54:28.145343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:18:36.899153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144191+0000","last_change":"2024-09-16T01:54:20.850043+0000","last_active":"2024-09-16T01:54:28.144191+0000","last_peered":"2024-09-16T01:54:28.144191+0000","last_clean":"2024-09-16T01:54:28.144191+0000","last_became_active":"2024-09-16T01:54:20.849690+0000","last_became_peered":"2024-09-16T01:54:20.849690+0000","last_unstale":"2024-09-16T01:54:28.144191+0000","last_undegraded":"2024-09-16T01:54:28.144191+0000","last_fullsized":"2024-09-16T01:54:28.144191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:20.932038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145156+0000","last_change":"2024-09-16T01:54:25.876135+0000","last_active":"2024-09-16T01:54:28.145156+0000","last_peered":"2024-09-16T01:54:28.145156+0000","last_clean":"2024-09-16T01:54:28.145156+0000","last_became_active":"2024-09-16T01:54:25.875631+0000","last_became_peered":"2024-09-16T01:54:25.875631+0000","last_unstale":"2024-09-16T01:54:28.145156+0000","last_undegraded":"2024-09-16T01:54:28.145156+0000","last_fullsized":"2024-09-16T01:54:28.145156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144759+0000","last_change":"2024-09-16T01:54:21.865673+0000","last_active":"2024-09-16T01:54:28.144759+0000","last_peered":"2024-09-16T01:54:28.144759+0000","last_clean":"2024-09-16T01:54:28.144759+0000","last_became_active":"2024-09-16T01:54:21.865342+0000","last_became_peered":"2024-09-16T01:54:21.865342+0000","last_unstale":"2024-09-16T01:54:28.144759+0000","last_undegraded":"2024-09-16T01:54:28.144759+0000","last_fullsized":"2024-09-16T01:54:28.144759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144766+0000","last_change":"2024-09-16T01:54:20.846994+0000","last_active":"2024-09-16T01:54:28.144766+0000","last_peered":"2024-09-16T01:54:28.144766+0000","last_clean":"2024-09-16T01:54:28.144766+0000","last_became_active":"2024-09-16T01:54:20.846665+0000","last_became_peered":"2024-09-16T01:54:20.846665+0000","last_unstale":"2024-09-16T01:54:28.144766+0000","last_undegraded":"2024-09-16T01:54:28.144766+0000","last_fullsized":"2024-09-16T01:54:28.144766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899670+0000","last_change":"2024-09-16T01:54:25.966412+0000","last_active":"2024-09-16T01:54:26.899670+0000","last_peered":"2024-09-16T01:54:26.899670+0000","last_clean":"2024-09-16T01:54:26.899670+0000","last_became_active":"2024-09-16T01:54:25.965845+0000","last_became_peered":"2024-09-16T01:54:25.965845+0000","last_unstale":"2024-09-16T01:54:26.899670+0000","last_undegraded":"2024-09-16T01:54:26.899670+0000","last_fullsized":"2024-09-16T01:54:26.899670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:35.279620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145627+0000","last_change":"2024-09-16T01:54:21.871992+0000","last_active":"2024-09-16T01:54:28.145627+0000","last_peered":"2024-09-16T01:54:28.145627+0000","last_clean":"2024-09-16T01:54:28.145627+0000","last_became_active":"2024-09-16T01:54:21.871674+0000","last_became_peered":"2024-09-16T01:54:21.871674+0000","last_unstale":"2024-09-16T01:54:28.145627+0000","last_undegraded":"2024-09-16T01:54:28.145627+0000","last_fullsized":"2024-09-16T01:54:28.145627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:27.694450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678279+0000","last_change":"2024-09-16T01:54:20.858600+0000","last_active":"2024-09-16T01:54:27.678279+0000","last_peered":"2024-09-16T01:54:27.678279+0000","last_clean":"2024-09-16T01:54:27.678279+0000","last_became_active":"2024-09-16T01:54:20.858244+0000","last_became_peered":"2024-09-16T01:54:20.858244+0000","last_unstale":"2024-09-16T01:54:27.678279+0000","last_undegraded":"2024-09-16T01:54:27.678279+0000","last_fullsized":"2024-09-16T01:54:27.678279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899103+0000","last_change":"2024-09-16T01:54:25.962396+0000","last_active":"2024-09-16T01:54:26.899103+0000","last_peered":"2024-09-16T01:54:26.899103+0000","last_clean":"2024-09-16T01:54:26.899103+0000","last_became_active":"2024-09-16T01:54:25.961648+0000","last_became_peered":"2024-09-16T01:54:25.961648+0000","last_unstale":"2024-09-16T01:54:26.899103+0000","last_undegraded":"2024-09-16T01:54:26.899103+0000","last_fullsized":"2024-09-16T01:54:26.899103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:45.131656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144942+0000","last_change":"2024-09-16T01:54:21.864888+0000","last_active":"2024-09-16T01:54:28.144942+0000","last_peered":"2024-09-16T01:54:28.144942+0000","last_clean":"2024-09-16T01:54:28.144942+0000","last_became_active":"2024-09-16T01:54:21.864577+0000","last_became_peered":"2024-09-16T01:54:21.864577+0000","last_unstale":"2024-09-16T01:54:28.144942+0000","last_undegraded":"2024-09-16T01:54:28.144942+0000","last_fullsized":"2024-09-16T01:54:28.144942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145550+0000","last_change":"2024-09-16T01:54:20.856921+0000","last_active":"2024-09-16T01:54:28.145550+0000","last_peered":"2024-09-16T01:54:28.145550+0000","last_clean":"2024-09-16T01:54:28.145550+0000","last_became_active":"2024-09-16T01:54:20.856618+0000","last_became_peered":"2024-09-16T01:54:20.856618+0000","last_unstale":"2024-09-16T01:54:28.145550+0000","last_undegraded":"2024-09-16T01:54:28.145550+0000","last_fullsized":"2024-09-16T01:54:28.145550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678404+0000","last_change":"2024-09-16T01:54:25.962306+0000","last_active":"2024-09-16T01:54:27.678404+0000","last_peered":"2024-09-16T01:54:27.678404+0000","last_clean":"2024-09-16T01:54:27.678404+0000","last_became_active":"2024-09-16T01:54:25.961904+0000","last_became_peered":"2024-09-16T01:54:25.961904+0000","last_unstale":"2024-09-16T01:54:27.678404+0000","last_undegraded":"2024-09-16T01:54:27.678404+0000","last_fullsized":"2024-09-16T01:54:27.678404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:21.665659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145442+0000","last_change":"2024-09-16T01:54:21.868099+0000","last_active":"2024-09-16T01:54:28.145442+0000","last_peered":"2024-09-16T01:54:28.145442+0000","last_clean":"2024-09-16T01:54:28.145442+0000","last_became_active":"2024-09-16T01:54:21.866809+0000","last_became_peered":"2024-09-16T01:54:21.866809+0000","last_unstale":"2024-09-16T01:54:28.145442+0000","last_undegraded":"2024-09-16T01:54:28.145442+0000","last_fullsized":"2024-09-16T01:54:28.145442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:54.265355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:31.368525+0000","last_change":"2024-09-16T01:54:20.858623+0000","last_active":"2024-09-16T01:54:31.368525+0000","last_peered":"2024-09-16T01:54:31.368525+0000","last_clean":"2024-09-16T01:54:31.368525+0000","last_became_active":"2024-09-16T01:54:20.858247+0000","last_became_peered":"2024-09-16T01:54:20.858247+0000","last_unstale":"2024-09-16T01:54:31.368525+0000","last_undegraded":"2024-09-16T01:54:31.368525+0000","last_fullsized":"2024-09-16T01:54:31.368525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644208+0000","last_change":"2024-09-16T01:54:25.877219+0000","last_active":"2024-09-16T01:54:27.644208+0000","last_peered":"2024-09-16T01:54:27.644208+0000","last_clean":"2024-09-16T01:54:27.644208+0000","last_became_active":"2024-09-16T01:54:25.876551+0000","last_became_peered":"2024-09-16T01:54:25.876551+0000","last_unstale":"2024-09-16T01:54:27.644208+0000","last_undegraded":"2024-09-16T01:54:27.644208+0000","last_fullsized":"2024-09-16T01:54:27.644208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:12.650374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900540+0000","last_change":"2024-09-16T01:54:21.869260+0000","last_active":"2024-09-16T01:54:26.900540+0000","last_peered":"2024-09-16T01:54:26.900540+0000","last_clean":"2024-09-16T01:54:26.900540+0000","last_became_active":"2024-09-16T01:54:21.868827+0000","last_became_peered":"2024-09-16T01:54:21.868827+0000","last_unstale":"2024-09-16T01:54:26.900540+0000","last_undegraded":"2024-09-16T01:54:26.900540+0000","last_fullsized":"2024-09-16T01:54:26.900540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:13.856305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644517+0000","last_change":"2024-09-16T01:54:20.857069+0000","last_active":"2024-09-16T01:54:27.644517+0000","last_peered":"2024-09-16T01:54:27.644517+0000","last_clean":"2024-09-16T01:54:27.644517+0000","last_became_active":"2024-09-16T01:54:20.856716+0000","last_became_peered":"2024-09-16T01:54:20.856716+0000","last_unstale":"2024-09-16T01:54:27.644517+0000","last_undegraded":"2024-09-16T01:54:27.644517+0000","last_fullsized":"2024-09-16T01:54:27.644517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900263+0000","last_change":"2024-09-16T01:54:25.877903+0000","last_active":"2024-09-16T01:54:26.900263+0000","last_peered":"2024-09-16T01:54:26.900263+0000","last_clean":"2024-09-16T01:54:26.900263+0000","last_became_active":"2024-09-16T01:54:25.877044+0000","last_became_peered":"2024-09-16T01:54:25.877044+0000","last_unstale":"2024-09-16T01:54:26.900263+0000","last_undegraded":"2024-09-16T01:54:26.900263+0000","last_fullsized":"2024-09-16T01:54:26.900263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.629326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145039+0000","last_change":"2024-09-16T01:54:21.867905+0000","last_active":"2024-09-16T01:54:28.145039+0000","last_peered":"2024-09-16T01:54:28.145039+0000","last_clean":"2024-09-16T01:54:28.145039+0000","last_became_active":"2024-09-16T01:54:21.867528+0000","last_became_peered":"2024-09-16T01:54:21.867528+0000","last_unstale":"2024-09-16T01:54:28.145039+0000","last_undegraded":"2024-09-16T01:54:28.145039+0000","last_fullsized":"2024-09-16T01:54:28.145039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678486+0000","last_change":"2024-09-16T01:54:20.857608+0000","last_active":"2024-09-16T01:54:27.678486+0000","last_peered":"2024-09-16T01:54:27.678486+0000","last_clean":"2024-09-16T01:54:27.678486+0000","last_became_active":"2024-09-16T01:54:20.857274+0000","last_became_peered":"2024-09-16T01:54:20.857274+0000","last_unstale":"2024-09-16T01:54:27.678486+0000","last_undegraded":"2024-09-16T01:54:27.678486+0000","last_fullsized":"2024-09-16T01:54:27.678486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898742+0000","last_change":"2024-09-16T01:54:25.882374+0000","last_active":"2024-09-16T01:54:26.898742+0000","last_peered":"2024-09-16T01:54:26.898742+0000","last_clean":"2024-09-16T01:54:26.898742+0000","last_became_active":"2024-09-16T01:54:25.881866+0000","last_became_peered":"2024-09-16T01:54:25.881866+0000","last_unstale":"2024-09-16T01:54:26.898742+0000","last_undegraded":"2024-09-16T01:54:26.898742+0000","last_fullsized":"2024-09-16T01:54:26.898742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:57.763504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678472+0000","last_change":"2024-09-16T01:54:21.867006+0000","last_active":"2024-09-16T01:54:27.678472+0000","last_peered":"2024-09-16T01:54:27.678472+0000","last_clean":"2024-09-16T01:54:27.678472+0000","last_became_active":"2024-09-16T01:54:21.866494+0000","last_became_peered":"2024-09-16T01:54:21.866494+0000","last_unstale":"2024-09-16T01:54:27.678472+0000","last_undegraded":"2024-09-16T01:54:27.678472+0000","last_fullsized":"2024-09-16T01:54:27.678472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:08.629741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145496+0000","last_change":"2024-09-16T01:54:20.856791+0000","last_active":"2024-09-16T01:54:28.145496+0000","last_peered":"2024-09-16T01:54:28.145496+0000","last_clean":"2024-09-16T01:54:28.145496+0000","last_became_active":"2024-09-16T01:54:20.856438+0000","last_became_peered":"2024-09-16T01:54:20.856438+0000","last_unstale":"2024-09-16T01:54:28.145496+0000","last_undegraded":"2024-09-16T01:54:28.145496+0000","last_fullsized":"2024-09-16T01:54:28.145496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898630+0000","last_change":"2024-09-16T01:54:25.965028+0000","last_active":"2024-09-16T01:54:26.898630+0000","last_peered":"2024-09-16T01:54:26.898630+0000","last_clean":"2024-09-16T01:54:26.898630+0000","last_became_active":"2024-09-16T01:54:25.964627+0000","last_became_peered":"2024-09-16T01:54:25.964627+0000","last_unstale":"2024-09-16T01:54:26.898630+0000","last_undegraded":"2024-09-16T01:54:26.898630+0000","last_fullsized":"2024-09-16T01:54:26.898630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:21.665659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144989+0000","last_change":"2024-09-16T01:54:25.964421+0000","last_active":"2024-09-16T01:54:28.144989+0000","last_peered":"2024-09-16T01:54:28.144989+0000","last_clean":"2024-09-16T01:54:28.144989+0000","last_became_active":"2024-09-16T01:54:25.964043+0000","last_became_peered":"2024-09-16T01:54:25.964043+0000","last_unstale":"2024-09-16T01:54:28.144989+0000","last_undegraded":"2024-09-16T01:54:28.144989+0000","last_fullsized":"2024-09-16T01:54:28.144989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643734+0000","last_change":"2024-09-16T01:54:21.854748+0000","last_active":"2024-09-16T01:54:27.643734+0000","last_peered":"2024-09-16T01:54:27.643734+0000","last_clean":"2024-09-16T01:54:27.643734+0000","last_became_active":"2024-09-16T01:54:21.854442+0000","last_became_peered":"2024-09-16T01:54:21.854442+0000","last_unstale":"2024-09-16T01:54:27.643734+0000","last_undegraded":"2024-09-16T01:54:27.643734+0000","last_fullsized":"2024-09-16T01:54:27.643734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678022+0000","last_change":"2024-09-16T01:54:20.857120+0000","last_active":"2024-09-16T01:54:27.678022+0000","last_peered":"2024-09-16T01:54:27.678022+0000","last_clean":"2024-09-16T01:54:27.678022+0000","last_became_active":"2024-09-16T01:54:20.855928+0000","last_became_peered":"2024-09-16T01:54:20.855928+0000","last_unstale":"2024-09-16T01:54:27.678022+0000","last_undegraded":"2024-09-16T01:54:27.678022+0000","last_fullsized":"2024-09-16T01:54:27.678022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145929+0000","last_change":"2024-09-16T01:54:25.881758+0000","last_active":"2024-09-16T01:54:28.145929+0000","last_peered":"2024-09-16T01:54:28.145929+0000","last_clean":"2024-09-16T01:54:28.145929+0000","last_became_active":"2024-09-16T01:54:25.881332+0000","last_became_peered":"2024-09-16T01:54:25.881332+0000","last_unstale":"2024-09-16T01:54:28.145929+0000","last_undegraded":"2024-09-16T01:54:28.145929+0000","last_fullsized":"2024-09-16T01:54:28.145929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898882+0000","last_change":"2024-09-16T01:54:21.862116+0000","last_active":"2024-09-16T01:54:26.898882+0000","last_peered":"2024-09-16T01:54:26.898882+0000","last_clean":"2024-09-16T01:54:26.898882+0000","last_became_active":"2024-09-16T01:54:21.861751+0000","last_became_peered":"2024-09-16T01:54:21.861751+0000","last_unstale":"2024-09-16T01:54:26.898882+0000","last_undegraded":"2024-09-16T01:54:26.898882+0000","last_fullsized":"2024-09-16T01:54:26.898882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898921+0000","last_change":"2024-09-16T01:54:20.851739+0000","last_active":"2024-09-16T01:54:26.898921+0000","last_peered":"2024-09-16T01:54:26.898921+0000","last_clean":"2024-09-16T01:54:26.898921+0000","last_became_active":"2024-09-16T01:54:20.851438+0000","last_became_peered":"2024-09-16T01:54:20.851438+0000","last_unstale":"2024-09-16T01:54:26.898921+0000","last_undegraded":"2024-09-16T01:54:26.898921+0000","last_fullsized":"2024-09-16T01:54:26.898921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:34:38.620678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145055+0000","last_change":"2024-09-16T01:54:20.850823+0000","last_active":"2024-09-16T01:54:28.145055+0000","last_peered":"2024-09-16T01:54:28.145055+0000","last_clean":"2024-09-16T01:54:28.145055+0000","last_became_active":"2024-09-16T01:54:20.850498+0000","last_became_peered":"2024-09-16T01:54:20.850498+0000","last_unstale":"2024-09-16T01:54:28.145055+0000","last_undegraded":"2024-09-16T01:54:28.145055+0000","last_fullsized":"2024-09-16T01:54:28.145055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145506+0000","last_change":"2024-09-16T01:54:21.864867+0000","last_active":"2024-09-16T01:54:28.145506+0000","last_peered":"2024-09-16T01:54:28.145506+0000","last_clean":"2024-09-16T01:54:28.145506+0000","last_became_active":"2024-09-16T01:54:21.863988+0000","last_became_peered":"2024-09-16T01:54:21.863988+0000","last_unstale":"2024-09-16T01:54:28.145506+0000","last_undegraded":"2024-09-16T01:54:28.145506+0000","last_fullsized":"2024-09-16T01:54:28.145506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144751+0000","last_change":"2024-09-16T01:54:25.883288+0000","last_active":"2024-09-16T01:54:28.144751+0000","last_peered":"2024-09-16T01:54:28.144751+0000","last_clean":"2024-09-16T01:54:28.144751+0000","last_became_active":"2024-09-16T01:54:25.882928+0000","last_became_peered":"2024-09-16T01:54:25.882928+0000","last_unstale":"2024-09-16T01:54:28.144751+0000","last_undegraded":"2024-09-16T01:54:28.144751+0000","last_fullsized":"2024-09-16T01:54:28.144751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:04.515824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899096+0000","last_change":"2024-09-16T01:54:20.852534+0000","last_active":"2024-09-16T01:54:26.899096+0000","last_peered":"2024-09-16T01:54:26.899096+0000","last_clean":"2024-09-16T01:54:26.899096+0000","last_became_active":"2024-09-16T01:54:20.852219+0000","last_became_peered":"2024-09-16T01:54:20.852219+0000","last_unstale":"2024-09-16T01:54:26.899096+0000","last_undegraded":"2024-09-16T01:54:26.899096+0000","last_fullsized":"2024-09-16T01:54:26.899096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899937+0000","last_change":"2024-09-16T01:54:21.850135+0000","last_active":"2024-09-16T01:54:26.899937+0000","last_peered":"2024-09-16T01:54:26.899937+0000","last_clean":"2024-09-16T01:54:26.899937+0000","last_became_active":"2024-09-16T01:54:21.849806+0000","last_became_peered":"2024-09-16T01:54:21.849806+0000","last_unstale":"2024-09-16T01:54:26.899937+0000","last_undegraded":"2024-09-16T01:54:26.899937+0000","last_fullsized":"2024-09-16T01:54:26.899937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:21.396408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899361+0000","last_change":"2024-09-16T01:54:25.881823+0000","last_active":"2024-09-16T01:54:26.899361+0000","last_peered":"2024-09-16T01:54:26.899361+0000","last_clean":"2024-09-16T01:54:26.899361+0000","last_became_active":"2024-09-16T01:54:25.881327+0000","last_became_peered":"2024-09-16T01:54:25.881327+0000","last_unstale":"2024-09-16T01:54:26.899361+0000","last_undegraded":"2024-09-16T01:54:26.899361+0000","last_fullsized":"2024-09-16T01:54:26.899361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:23.493442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144596+0000","last_change":"2024-09-16T01:54:21.865704+0000","last_active":"2024-09-16T01:54:28.144596+0000","last_peered":"2024-09-16T01:54:28.144596+0000","last_clean":"2024-09-16T01:54:28.144596+0000","last_became_active":"2024-09-16T01:54:21.865364+0000","last_became_peered":"2024-09-16T01:54:21.865364+0000","last_unstale":"2024-09-16T01:54:28.144596+0000","last_undegraded":"2024-09-16T01:54:28.144596+0000","last_fullsized":"2024-09-16T01:54:28.144596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144292+0000","last_change":"2024-09-16T01:54:21.856984+0000","last_active":"2024-09-16T01:54:28.144292+0000","last_peered":"2024-09-16T01:54:28.144292+0000","last_clean":"2024-09-16T01:54:28.144292+0000","last_became_active":"2024-09-16T01:54:21.856689+0000","last_became_peered":"2024-09-16T01:54:21.856689+0000","last_unstale":"2024-09-16T01:54:28.144292+0000","last_undegraded":"2024-09-16T01:54:28.144292+0000","last_fullsized":"2024-09-16T01:54:28.144292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:31.836291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678206+0000","last_change":"2024-09-16T01:54:21.857661+0000","last_active":"2024-09-16T01:54:27.678206+0000","last_peered":"2024-09-16T01:54:27.678206+0000","last_clean":"2024-09-16T01:54:27.678206+0000","last_became_active":"2024-09-16T01:54:21.857393+0000","last_became_peered":"2024-09-16T01:54:21.857393+0000","last_unstale":"2024-09-16T01:54:27.678206+0000","last_undegraded":"2024-09-16T01:54:27.678206+0000","last_fullsized":"2024-09-16T01:54:27.678206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:57.597318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145421+0000","last_change":"2024-09-16T01:54:21.864966+0000","last_active":"2024-09-16T01:54:28.145421+0000","last_peered":"2024-09-16T01:54:28.145421+0000","last_clean":"2024-09-16T01:54:28.145421+0000","last_became_active":"2024-09-16T01:54:21.864561+0000","last_became_peered":"2024-09-16T01:54:21.864561+0000","last_unstale":"2024-09-16T01:54:28.145421+0000","last_undegraded":"2024-09-16T01:54:28.145421+0000","last_fullsized":"2024-09-16T01:54:28.145421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899348+0000","last_change":"2024-09-16T01:54:21.870271+0000","last_active":"2024-09-16T01:54:26.899348+0000","last_peered":"2024-09-16T01:54:26.899348+0000","last_clean":"2024-09-16T01:54:26.899348+0000","last_became_active":"2024-09-16T01:54:21.869900+0000","last_became_peered":"2024-09-16T01:54:21.869900+0000","last_unstale":"2024-09-16T01:54:26.899348+0000","last_undegraded":"2024-09-16T01:54:26.899348+0000","last_fullsized":"2024-09-16T01:54:26.899348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644063+0000","last_change":"2024-09-16T01:54:21.855065+0000","last_active":"2024-09-16T01:54:27.644063+0000","last_peered":"2024-09-16T01:54:27.644063+0000","last_clean":"2024-09-16T01:54:27.644063+0000","last_became_active":"2024-09-16T01:54:21.854785+0000","last_became_peered":"2024-09-16T01:54:21.854785+0000","last_unstale":"2024-09-16T01:54:27.644063+0000","last_undegraded":"2024-09-16T01:54:27.644063+0000","last_fullsized":"2024-09-16T01:54:27.644063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.146008+0000","last_change":"2024-09-16T01:54:21.856250+0000","last_active":"2024-09-16T01:54:28.146008+0000","last_peered":"2024-09-16T01:54:28.146008+0000","last_clean":"2024-09-16T01:54:28.146008+0000","last_became_active":"2024-09-16T01:54:21.855867+0000","last_became_peered":"2024-09-16T01:54:21.855867+0000","last_unstale":"2024-09-16T01:54:28.146008+0000","last_undegraded":"2024-09-16T01:54:28.146008+0000","last_fullsized":"2024-09-16T01:54:28.146008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899585+0000","last_change":"2024-09-16T01:54:21.869651+0000","last_active":"2024-09-16T01:54:26.899585+0000","last_peered":"2024-09-16T01:54:26.899585+0000","last_clean":"2024-09-16T01:54:26.899585+0000","last_became_active":"2024-09-16T01:54:21.869363+0000","last_became_peered":"2024-09-16T01:54:21.869363+0000","last_unstale":"2024-09-16T01:54:26.899585+0000","last_undegraded":"2024-09-16T01:54:26.899585+0000","last_fullsized":"2024-09-16T01:54:26.899585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677969+0000","last_change":"2024-09-16T01:54:21.857499+0000","last_active":"2024-09-16T01:54:27.677969+0000","last_peered":"2024-09-16T01:54:27.677969+0000","last_clean":"2024-09-16T01:54:27.677969+0000","last_became_active":"2024-09-16T01:54:21.857215+0000","last_became_peered":"2024-09-16T01:54:21.857215+0000","last_unstale":"2024-09-16T01:54:27.677969+0000","last_undegraded":"2024-09-16T01:54:27.677969+0000","last_fullsized":"2024-09-16T01:54:27.677969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898805+0000","last_change":"2024-09-16T01:54:21.853265+0000","last_active":"2024-09-16T01:54:26.898805+0000","last_peered":"2024-09-16T01:54:26.898805+0000","last_clean":"2024-09-16T01:54:26.898805+0000","last_became_active":"2024-09-16T01:54:21.852863+0000","last_became_peered":"2024-09-16T01:54:21.852863+0000","last_unstale":"2024-09-16T01:54:26.898805+0000","last_undegraded":"2024-09-16T01:54:26.898805+0000","last_fullsized":"2024-09-16T01:54:26.898805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678154+0000","last_change":"2024-09-16T01:54:21.856726+0000","last_active":"2024-09-16T01:54:27.678154+0000","last_peered":"2024-09-16T01:54:27.678154+0000","last_clean":"2024-09-16T01:54:27.678154+0000","last_became_active":"2024-09-16T01:54:21.856432+0000","last_became_peered":"2024-09-16T01:54:21.856432+0000","last_unstale":"2024-09-16T01:54:27.678154+0000","last_undegraded":"2024-09-16T01:54:27.678154+0000","last_fullsized":"2024-09-16T01:54:27.678154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:29.948383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145040+0000","last_change":"2024-09-16T01:54:21.867340+0000","last_active":"2024-09-16T01:54:28.145040+0000","last_peered":"2024-09-16T01:54:28.145040+0000","last_clean":"2024-09-16T01:54:28.145040+0000","last_became_active":"2024-09-16T01:54:21.866029+0000","last_became_peered":"2024-09-16T01:54:21.866029+0000","last_unstale":"2024-09-16T01:54:28.145040+0000","last_undegraded":"2024-09-16T01:54:28.145040+0000","last_fullsized":"2024-09-16T01:54:28.145040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:33.360622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145155+0000","last_change":"2024-09-16T01:54:21.861066+0000","last_active":"2024-09-16T01:54:28.145155+0000","last_peered":"2024-09-16T01:54:28.145155+0000","last_clean":"2024-09-16T01:54:28.145155+0000","last_became_active":"2024-09-16T01:54:21.860305+0000","last_became_peered":"2024-09-16T01:54:21.860305+0000","last_unstale":"2024-09-16T01:54:28.145155+0000","last_undegraded":"2024-09-16T01:54:28.145155+0000","last_fullsized":"2024-09-16T01:54:28.145155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145799+0000","last_change":"2024-09-16T01:54:21.863878+0000","last_active":"2024-09-16T01:54:28.145799+0000","last_peered":"2024-09-16T01:54:28.145799+0000","last_clean":"2024-09-16T01:54:28.145799+0000","last_became_active":"2024-09-16T01:54:21.863277+0000","last_became_peered":"2024-09-16T01:54:21.863277+0000","last_unstale":"2024-09-16T01:54:28.145799+0000","last_undegraded":"2024-09-16T01:54:28.145799+0000","last_fullsized":"2024-09-16T01:54:28.145799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:38.741991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145254+0000","last_change":"2024-09-16T01:54:21.852758+0000","last_active":"2024-09-16T01:54:28.145254+0000","last_peered":"2024-09-16T01:54:28.145254+0000","last_clean":"2024-09-16T01:54:28.145254+0000","last_became_active":"2024-09-16T01:54:21.852429+0000","last_became_peered":"2024-09-16T01:54:21.852429+0000","last_unstale":"2024-09-16T01:54:28.145254+0000","last_undegraded":"2024-09-16T01:54:28.145254+0000","last_fullsized":"2024-09-16T01:54:28.145254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:33.722900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678582+0000","last_change":"2024-09-16T01:54:21.871495+0000","last_active":"2024-09-16T01:54:27.678582+0000","last_peered":"2024-09-16T01:54:27.678582+0000","last_clean":"2024-09-16T01:54:27.678582+0000","last_became_active":"2024-09-16T01:54:21.871213+0000","last_became_peered":"2024-09-16T01:54:21.871213+0000","last_unstale":"2024-09-16T01:54:27.678582+0000","last_undegraded":"2024-09-16T01:54:27.678582+0000","last_fullsized":"2024-09-16T01:54:27.678582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:29.854384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677857+0000","last_change":"2024-09-16T01:54:21.863733+0000","last_active":"2024-09-16T01:54:27.677857+0000","last_peered":"2024-09-16T01:54:27.677857+0000","last_clean":"2024-09-16T01:54:27.677857+0000","last_became_active":"2024-09-16T01:54:21.863426+0000","last_became_peered":"2024-09-16T01:54:21.863426+0000","last_unstale":"2024-09-16T01:54:27.677857+0000","last_undegraded":"2024-09-16T01:54:27.677857+0000","last_fullsized":"2024-09-16T01:54:27.677857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643815+0000","last_change":"2024-09-16T01:54:21.845049+0000","last_active":"2024-09-16T01:54:27.643815+0000","last_peered":"2024-09-16T01:54:27.643815+0000","last_clean":"2024-09-16T01:54:27.643815+0000","last_became_active":"2024-09-16T01:54:21.844746+0000","last_became_peered":"2024-09-16T01:54:21.844746+0000","last_unstale":"2024-09-16T01:54:27.643815+0000","last_undegraded":"2024-09-16T01:54:27.643815+0000","last_fullsized":"2024-09-16T01:54:27.643815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144803+0000","last_change":"2024-09-16T01:54:21.863916+0000","last_active":"2024-09-16T01:54:28.144803+0000","last_peered":"2024-09-16T01:54:28.144803+0000","last_clean":"2024-09-16T01:54:28.144803+0000","last_became_active":"2024-09-16T01:54:21.858949+0000","last_became_peered":"2024-09-16T01:54:21.858949+0000","last_unstale":"2024-09-16T01:54:28.144803+0000","last_undegraded":"2024-09-16T01:54:28.144803+0000","last_fullsized":"2024-09-16T01:54:28.144803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:06.850801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898941+0000","last_change":"2024-09-16T01:54:21.856929+0000","last_active":"2024-09-16T01:54:26.898941+0000","last_peered":"2024-09-16T01:54:26.898941+0000","last_clean":"2024-09-16T01:54:26.898941+0000","last_became_active":"2024-09-16T01:54:21.856610+0000","last_became_peered":"2024-09-16T01:54:21.856610+0000","last_unstale":"2024-09-16T01:54:26.898941+0000","last_undegraded":"2024-09-16T01:54:26.898941+0000","last_fullsized":"2024-09-16T01:54:26.898941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900438+0000","last_change":"2024-09-16T01:54:21.853558+0000","last_active":"2024-09-16T01:54:26.900438+0000","last_peered":"2024-09-16T01:54:26.900438+0000","last_clean":"2024-09-16T01:54:26.900438+0000","last_became_active":"2024-09-16T01:54:21.853234+0000","last_became_peered":"2024-09-16T01:54:21.853234+0000","last_unstale":"2024-09-16T01:54:26.900438+0000","last_undegraded":"2024-09-16T01:54:26.900438+0000","last_fullsized":"2024-09-16T01:54:26.900438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:58.346519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145294+0000","last_change":"2024-09-16T01:54:21.864089+0000","last_active":"2024-09-16T01:54:28.145294+0000","last_peered":"2024-09-16T01:54:28.145294+0000","last_clean":"2024-09-16T01:54:28.145294+0000","last_became_active":"2024-09-16T01:54:21.863778+0000","last_became_peered":"2024-09-16T01:54:21.863778+0000","last_unstale":"2024-09-16T01:54:28.145294+0000","last_undegraded":"2024-09-16T01:54:28.145294+0000","last_fullsized":"2024-09-16T01:54:28.145294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145937+0000","last_change":"2024-09-16T01:54:21.860265+0000","last_active":"2024-09-16T01:54:28.145937+0000","last_peered":"2024-09-16T01:54:28.145937+0000","last_clean":"2024-09-16T01:54:28.145937+0000","last_became_active":"2024-09-16T01:54:21.859906+0000","last_became_peered":"2024-09-16T01:54:21.859906+0000","last_unstale":"2024-09-16T01:54:28.145937+0000","last_undegraded":"2024-09-16T01:54:28.145937+0000","last_fullsized":"2024-09-16T01:54:28.145937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145883+0000","last_change":"2024-09-16T01:54:21.867977+0000","last_active":"2024-09-16T01:54:28.145883+0000","last_peered":"2024-09-16T01:54:28.145883+0000","last_clean":"2024-09-16T01:54:28.145883+0000","last_became_active":"2024-09-16T01:54:21.867663+0000","last_became_peered":"2024-09-16T01:54:21.867663+0000","last_unstale":"2024-09-16T01:54:28.145883+0000","last_undegraded":"2024-09-16T01:54:28.145883+0000","last_fullsized":"2024-09-16T01:54:28.145883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:17.473803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898589+0000","last_change":"2024-09-16T01:54:21.858992+0000","last_active":"2024-09-16T01:54:26.898589+0000","last_peered":"2024-09-16T01:54:26.898589+0000","last_clean":"2024-09-16T01:54:26.898589+0000","last_became_active":"2024-09-16T01:54:21.858478+0000","last_became_peered":"2024-09-16T01:54:21.858478+0000","last_unstale":"2024-09-16T01:54:26.898589+0000","last_undegraded":"2024-09-16T01:54:26.898589+0000","last_fullsized":"2024-09-16T01:54:26.898589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145247+0000","last_change":"2024-09-16T01:54:21.866468+0000","last_active":"2024-09-16T01:54:28.145247+0000","last_peered":"2024-09-16T01:54:28.145247+0000","last_clean":"2024-09-16T01:54:28.145247+0000","last_became_active":"2024-09-16T01:54:21.866127+0000","last_became_peered":"2024-09-16T01:54:21.866127+0000","last_unstale":"2024-09-16T01:54:28.145247+0000","last_undegraded":"2024-09-16T01:54:28.145247+0000","last_fullsized":"2024-09-16T01:54:28.145247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:15.758941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678085+0000","last_change":"2024-09-16T01:54:21.863734+0000","last_active":"2024-09-16T01:54:27.678085+0000","last_peered":"2024-09-16T01:54:27.678085+0000","last_clean":"2024-09-16T01:54:27.678085+0000","last_became_active":"2024-09-16T01:54:21.863440+0000","last_became_peered":"2024-09-16T01:54:21.863440+0000","last_unstale":"2024-09-16T01:54:27.678085+0000","last_undegraded":"2024-09-16T01:54:27.678085+0000","last_fullsized":"2024-09-16T01:54:27.678085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145475+0000","last_change":"2024-09-16T01:54:21.862517+0000","last_active":"2024-09-16T01:54:28.145475+0000","last_peered":"2024-09-16T01:54:28.145475+0000","last_clean":"2024-09-16T01:54:28.145475+0000","last_became_active":"2024-09-16T01:54:21.862211+0000","last_became_peered":"2024-09-16T01:54:21.862211+0000","last_unstale":"2024-09-16T01:54:28.145475+0000","last_undegraded":"2024-09-16T01:54:28.145475+0000","last_fullsized":"2024-09-16T01:54:28.145475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:12:08.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678116+0000","last_change":"2024-09-16T01:54:21.866825+0000","last_active":"2024-09-16T01:54:27.678116+0000","last_peered":"2024-09-16T01:54:27.678116+0000","last_clean":"2024-09-16T01:54:27.678116+0000","last_became_active":"2024-09-16T01:54:21.866552+0000","last_became_peered":"2024-09-16T01:54:21.866552+0000","last_unstale":"2024-09-16T01:54:27.678116+0000","last_undegraded":"2024-09-16T01:54:27.678116+0000","last_fullsized":"2024-09-16T01:54:27.678116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144763+0000","last_change":"2024-09-16T01:54:21.864915+0000","last_active":"2024-09-16T01:54:28.144763+0000","last_peered":"2024-09-16T01:54:28.144763+0000","last_clean":"2024-09-16T01:54:28.144763+0000","last_became_active":"2024-09-16T01:54:21.864522+0000","last_became_peered":"2024-09-16T01:54:21.864522+0000","last_unstale":"2024-09-16T01:54:28.144763+0000","last_undegraded":"2024-09-16T01:54:28.144763+0000","last_fullsized":"2024-09-16T01:54:28.144763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644314+0000","last_change":"2024-09-16T01:54:21.863988+0000","last_active":"2024-09-16T01:54:27.644314+0000","last_peered":"2024-09-16T01:54:27.644314+0000","last_clean":"2024-09-16T01:54:27.644314+0000","last_became_active":"2024-09-16T01:54:21.863692+0000","last_became_peered":"2024-09-16T01:54:21.863692+0000","last_unstale":"2024-09-16T01:54:27.644314+0000","last_undegraded":"2024-09-16T01:54:27.644314+0000","last_fullsized":"2024-09-16T01:54:27.644314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145865+0000","last_change":"2024-09-16T01:54:21.862642+0000","last_active":"2024-09-16T01:54:28.145865+0000","last_peered":"2024-09-16T01:54:28.145865+0000","last_clean":"2024-09-16T01:54:28.145865+0000","last_became_active":"2024-09-16T01:54:21.862364+0000","last_became_peered":"2024-09-16T01:54:21.862364+0000","last_unstale":"2024-09-16T01:54:28.145865+0000","last_undegraded":"2024-09-16T01:54:28.145865+0000","last_fullsized":"2024-09-16T01:54:28.145865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:37.651766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":106307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":102623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":693469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":102463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:54:42.275 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:54:42.275 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T01:54:42.275 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T01:54:42.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T01:54:42.276 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T01:54:42.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.409+0000 7f428fa84640 1 Processor -- start 2024-09-16T01:54:42.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.409+0000 7f428fa84640 1 -- start start 2024-09-16T01:54:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.410+0000 7f428fa84640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4288162060 0x7f42880b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.410+0000 7f428fa84640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f42880b64b0 0x7f42880b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.410+0000 7f428fa84640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428806d9f0 con 0x7f4288161c80 2024-09-16T01:54:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.410+0000 7f428fa84640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f428806dcd0 con 0x7f4288162060 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.410+0000 7f428fa84640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f428806dfb0 con 0x7f42880b64b0 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.410+0000 7f428d01f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4288162060 0x7f42880b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.410+0000 7f428d01f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4288162060 0x7f42880b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53142/0 (socket says 172.21.15.42:53142) 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.410+0000 7f428d01f640 1 -- 172.21.15.42:0/2298296063 learned_addr learned my addr 172.21.15.42:0/2298296063 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.410+0000 7f428e021640 1 --2- 172.21.15.42:0/2298296063 >> v2:172.21.15.107:3300/0 conn(0x7f42880b64b0 0x7f42880b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.411+0000 7f428d01f640 1 -- 172.21.15.42:0/2298296063 >> v2:172.21.15.107:3300/0 conn(0x7f42880b64b0 msgr2=0x7f42880b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.411+0000 7f428d01f640 1 --2- 172.21.15.42:0/2298296063 >> v2:172.21.15.107:3300/0 conn(0x7f42880b64b0 0x7f42880b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.411+0000 7f428d01f640 1 -- 172.21.15.42:0/2298296063 >> v1:172.21.15.107:6789/0 conn(0x7f4288161c80 legacy=0x7f428806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.411+0000 7f428d01f640 1 -- 172.21.15.42:0/2298296063 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42880d01f0 con 0x7f4288162060 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.411+0000 7f428e021640 1 --2- 172.21.15.42:0/2298296063 >> v2:172.21.15.107:3300/0 conn(0x7f42880b64b0 0x7f42880b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.411+0000 7f428d01f640 1 --2- 172.21.15.42:0/2298296063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 0x7f42880b5f70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f428808d750 tx=0x7f427802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922947dadfb637c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:42.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.411+0000 7f428c81e640 1 -- 172.21.15.42:0/2298296063 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278037070 con 0x7f4288162060 2024-09-16T01:54:42.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.412+0000 7f428c81e640 1 -- 172.21.15.42:0/2298296063 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4278032440 con 0x7f4288162060 2024-09-16T01:54:42.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.412+0000 7f428c81e640 1 -- 172.21.15.42:0/2298296063 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278032810 con 0x7f4288162060 2024-09-16T01:54:42.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.412+0000 7f428fa84640 1 -- 172.21.15.42:0/2298296063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 msgr2=0x7f42880b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.412+0000 7f428fa84640 1 --2- 172.21.15.42:0/2298296063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 0x7f42880b5f70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f428808d750 tx=0x7f427802a270 comp rx=0 tx=0).stop 2024-09-16T01:54:42.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.412+0000 7f428fa84640 1 -- 172.21.15.42:0/2298296063 shutdown_connections 2024-09-16T01:54:42.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.412+0000 7f428fa84640 1 --2- 172.21.15.42:0/2298296063 >> v2:172.21.15.107:3300/0 conn(0x7f42880b64b0 0x7f42880b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.412+0000 7f428fa84640 1 --2- 172.21.15.42:0/2298296063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 0x7f42880b5f70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.412+0000 7f428fa84640 1 -- 172.21.15.42:0/2298296063 >> 172.21.15.42:0/2298296063 conn(0x7f42880d44f0 msgr2=0x7f42880d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:42.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.412+0000 7f428fa84640 1 -- 172.21.15.42:0/2298296063 shutdown_connections 2024-09-16T01:54:42.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.412+0000 7f428fa84640 1 -- 172.21.15.42:0/2298296063 wait complete. 2024-09-16T01:54:42.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.413+0000 7f428fa84640 1 Processor -- start 2024-09-16T01:54:42.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.413+0000 7f428fa84640 1 -- start start 2024-09-16T01:54:42.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428fa84640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42880b64b0 0x7f42880ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428fa84640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4288161c80 0x7f42880b8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428fa84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 0x7f428815fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428fa84640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f42880cf1e0 con 0x7f4288162060 2024-09-16T01:54:42.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428fa84640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42880d2aa0 con 0x7f4288161c80 2024-09-16T01:54:42.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428fa84640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42880cf360 con 0x7f42880b64b0 2024-09-16T01:54:42.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428e021640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 0x7f428815fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428e021640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 0x7f428815fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53156/0 (socket says 172.21.15.42:53156) 2024-09-16T01:54:42.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428e021640 1 -- 172.21.15.42:0/3824740336 learned_addr learned my addr 172.21.15.42:0/3824740336 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:42.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428d01f640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4288161c80 0x7f42880b8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428d820640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42880b64b0 0x7f42880ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428e021640 1 -- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42880b64b0 msgr2=0x7f42880ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428e021640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42880b64b0 0x7f42880ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428e021640 1 -- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4288161c80 msgr2=0x7f42880b8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428e021640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4288161c80 0x7f42880b8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428e021640 1 -- 172.21.15.42:0/3824740336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42880cbac0 con 0x7f4288162060 2024-09-16T01:54:42.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.414+0000 7f428d820640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42880b64b0 0x7f42880ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:42.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.415+0000 7f428e021640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 0x7f428815fdf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4280007ef0 tx=0x7f428000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:42.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.415+0000 7f427e7fc640 1 -- 172.21.15.42:0/3824740336 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428001a070 con 0x7f4288162060 2024-09-16T01:54:42.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.415+0000 7f427e7fc640 1 -- 172.21.15.42:0/3824740336 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4280003b90 con 0x7f4288162060 2024-09-16T01:54:42.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.415+0000 7f427e7fc640 1 -- 172.21.15.42:0/3824740336 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280004030 con 0x7f4288162060 2024-09-16T01:54:42.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.415+0000 7f428fa84640 1 -- 172.21.15.42:0/3824740336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42880cbda0 con 0x7f4288162060 2024-09-16T01:54:42.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.415+0000 7f428fa84640 1 -- 172.21.15.42:0/3824740336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42880cc360 con 0x7f4288162060 2024-09-16T01:54:42.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.416+0000 7f428fa84640 1 -- 172.21.15.42:0/3824740336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42880b5f70 con 0x7f4288162060 2024-09-16T01:54:42.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.416+0000 7f427e7fc640 1 -- 172.21.15.42:0/3824740336 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f428001d070 con 0x7f4288162060 2024-09-16T01:54:42.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.417+0000 7f427e7fc640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f426c06c2e0 0x7f426c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.417+0000 7f427e7fc640 1 -- 172.21.15.42:0/3824740336 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f428008b940 con 0x7f4288162060 2024-09-16T01:54:42.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.417+0000 7f428d820640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f426c06c2e0 0x7f426c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.417+0000 7f428d820640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f426c06c2e0 0x7f426c06e7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42880d0950 tx=0x7f4284009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:42.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.421+0000 7f427e7fc640 1 -- 172.21.15.42:0/3824740336 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4280010070 con 0x7f4288162060 2024-09-16T01:54:42.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.645+0000 7f428fa84640 1 -- 172.21.15.42:0/3824740336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f42880b5860 con 0x7f4288162060 2024-09-16T01:54:42.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.648+0000 7f427e7fc640 1 -- 172.21.15.42:0/3824740336 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173512 (secure 0 0 0) 0x7f4280059720 con 0x7f4288162060 2024-09-16T01:54:42.653 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:42.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 -- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f426c06c2e0 msgr2=0x7f426c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f426c06c2e0 0x7f426c06e7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42880d0950 tx=0x7f4284009040 comp rx=0 tx=0).stop 2024-09-16T01:54:42.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 -- 172.21.15.42:0/3824740336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 msgr2=0x7f428815fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 0x7f428815fdf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4280007ef0 tx=0x7f428000d4a0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 -- 172.21.15.42:0/3824740336 shutdown_connections 2024-09-16T01:54:42.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f426c06c2e0 0x7f426c06e7a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288162060 0x7f428815fdf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4288161c80 0x7f42880b8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 --2- 172.21.15.42:0/3824740336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42880b64b0 0x7f42880ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 -- 172.21.15.42:0/3824740336 >> 172.21.15.42:0/3824740336 conn(0x7f42880d44f0 msgr2=0x7f428806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:42.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 -- 172.21.15.42:0/3824740336 shutdown_connections 2024-09-16T01:54:42.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.651+0000 7f428fa84640 1 -- 172.21.15.42:0/3824740336 wait complete. 2024-09-16T01:54:42.665 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1809370608},{"type":"v1","addr":"172.21.15.107:6833","nonce":1809370608}]},"active_addr":"172.21.15.107:6833/1809370608","active_change":"2024-09-16T01:54:02.241162+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":1685120176}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":1408156034}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":1236460738}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3753746439}]}]} 2024-09-16T01:54:42.670 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T01:54:42.670 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T01:54:42.670 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:42.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.769+0000 7f41d41b7640 1 Processor -- start 2024-09-16T01:54:42.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.770+0000 7f41d41b7640 1 -- start start 2024-09-16T01:54:42.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.770+0000 7f41d41b7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc06df60 0x7f41cc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.770+0000 7f41d41b7640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41cc06cec0 con 0x7f41cc09af70 2024-09-16T01:54:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.770+0000 7f41d41b7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41cc06d1a0 con 0x7f41cc15e5d0 2024-09-16T01:54:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.770+0000 7f41d41b7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc06dad0 con 0x7f41cc06df60 2024-09-16T01:54:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.770+0000 7f41d2754640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f41cc09af70 0x7f41cc168560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45374/0 (socket says 172.21.15.42:45374) 2024-09-16T01:54:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.770+0000 7f41d2754640 1 -- 172.21.15.42:0/3642331911 learned_addr learned my addr 172.21.15.42:0/3642331911 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d1752640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc06df60 0x7f41cc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2129451247 0 0) 0x7f41cc06cec0 con 0x7f41cc09af70 2024-09-16T01:54:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41b4003520 con 0x7f41cc09af70 2024-09-16T01:54:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2875510299 0 0) 0x7f41b4003520 con 0x7f41cc09af70 2024-09-16T01:54:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc06df60 msgr2=0x7f41cc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc06df60 0x7f41cc09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 >> v1:172.21.15.107:6789/0 conn(0x7f41cc15e5d0 legacy=0x7f41cc0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc06d480 con 0x7f41cc09af70 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f41bc0019f0 con 0x7f41cc09af70 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 >> v1:172.21.15.42:6789/0 conn(0x7f41cc09af70 legacy=0x7f41cc168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41b40039e0 0x7f41b4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41b4004390 0x7f41b4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc06df60 0x7f41b40050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc06dad0 con 0x7f41b4004390 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f41b400b9c0 con 0x7f41b40039e0 2024-09-16T01:54:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f41b400bbc0 con 0x7f41cc06df60 2024-09-16T01:54:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d1752640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41b4004390 0x7f41b4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d1f53640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41b40039e0 0x7f41b4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.771+0000 7f41d2754640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc06df60 0x7f41b40050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.772+0000 7f41d1752640 1 -- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc06df60 msgr2=0x7f41b40050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.772+0000 7f41d1752640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc06df60 0x7f41b40050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.772+0000 7f41d1752640 1 -- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41b40039e0 msgr2=0x7f41b4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.772+0000 7f41d1752640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41b40039e0 0x7f41b4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.772+0000 7f41d1752640 1 -- 172.21.15.42:0/3642331911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b4003520 con 0x7f41b4004390 2024-09-16T01:54:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.772+0000 7f41d1752640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41b4004390 0x7f41b4004860 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009a90 tx=0x7f41b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a64c23fb0c2c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.772+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0036070 con 0x7f41b4004390 2024-09-16T01:54:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.772+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c0031400 con 0x7f41b4004390 2024-09-16T01:54:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.772+0000 7f41d0f51640 1 -- 172.21.15.42:0/3642331911 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0009690 con 0x7f41b4004390 2024-09-16T01:54:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.773+0000 7f41d41b7640 1 -- 172.21.15.42:0/3642331911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41b4004390 msgr2=0x7f41b4004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.773+0000 7f41d41b7640 1 --2- 172.21.15.42:0/3642331911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41b4004390 0x7f41b4004860 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009a90 tx=0x7f41b4005830 comp rx=0 tx=0).stop 2024-09-16T01:54:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.773+0000 7f41d2754640 1 -- 172.21.15.42:0/3642331911 reap_dead start 2024-09-16T01:54:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.773+0000 7f41d41b7640 1 -- 172.21.15.42:0/3642331911 shutdown_connections 2024-09-16T01:54:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.773+0000 7f41d41b7640 1 -- 172.21.15.42:0/3642331911 >> 172.21.15.42:0/3642331911 conn(0x7f41cc0d23a0 msgr2=0x7f41cc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.773+0000 7f41d41b7640 1 -- 172.21.15.42:0/3642331911 shutdown_connections 2024-09-16T01:54:42.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.773+0000 7f41d41b7640 1 -- 172.21.15.42:0/3642331911 wait complete. 2024-09-16T01:54:42.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.774+0000 7f41d41b7640 1 Processor -- start 2024-09-16T01:54:42.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.774+0000 7f41d41b7640 1 -- start start 2024-09-16T01:54:42.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d41b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41b4004390 0x7f41cc0c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d41b7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41cc1f49c0 0x7f41cc1f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d41b7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc0b6820 0x7f41cc0b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d41b7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc0d1980 con 0x7f41cc1f49c0 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d41b7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc0d1800 con 0x7f41b4004390 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d41b7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc15e9b0 con 0x7f41cc0b6820 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d1752640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41cc1f49c0 0x7f41cc1f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d1752640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41cc1f49c0 0x7f41cc1f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53174/0 (socket says 172.21.15.42:53174) 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d1752640 1 -- 172.21.15.42:0/3904825903 learned_addr learned my addr 172.21.15.42:0/3904825903 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d1f53640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41b4004390 0x7f41cc0c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d2754640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc0b6820 0x7f41cc0b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d1752640 1 -- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc0b6820 msgr2=0x7f41cc0b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d1752640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc0b6820 0x7f41cc0b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d1752640 1 -- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41b4004390 msgr2=0x7f41cc0c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d1752640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41b4004390 0x7f41cc0c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.775+0000 7f41d1752640 1 -- 172.21.15.42:0/3904825903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc0b51d0 con 0x7f41cc1f49c0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.776+0000 7f41d1752640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41cc1f49c0 0x7f41cc1f4e20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f41c0034040 tx=0x7f41c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.776+0000 7f41ca7fc640 1 -- 172.21.15.42:0/3904825903 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0040020 con 0x7f41cc1f49c0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.776+0000 7f41ca7fc640 1 -- 172.21.15.42:0/3904825903 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c003b6a0 con 0x7f41cc1f49c0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.776+0000 7f41d41b7640 1 -- 172.21.15.42:0/3904825903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41cc0b54b0 con 0x7f41cc1f49c0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.776+0000 7f41ca7fc640 1 -- 172.21.15.42:0/3904825903 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0036040 con 0x7f41cc1f49c0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.776+0000 7f41d41b7640 1 -- 172.21.15.42:0/3904825903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41cc0b5a70 con 0x7f41cc1f49c0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.777+0000 7f41d41b7640 1 -- 172.21.15.42:0/3904825903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41cc06d1a0 con 0x7f41cc1f49c0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.777+0000 7f41ca7fc640 1 -- 172.21.15.42:0/3904825903 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f41c0043020 con 0x7f41cc1f49c0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.778+0000 7f41ca7fc640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b806c2b0 0x7f41b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.778+0000 7f41ca7fc640 1 -- 172.21.15.42:0/3904825903 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f41c00abdd0 con 0x7f41cc1f49c0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.778+0000 7f41d1f53640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b806c2b0 0x7f41b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:42.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.779+0000 7f41d1f53640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b806c2b0 0x7f41b806e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f41c4001910 tx=0x7f41c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:42.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.782+0000 7f41ca7fc640 1 -- 172.21.15.42:0/3904825903 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41c004a030 con 0x7f41cc1f49c0 2024-09-16T01:54:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.960+0000 7f41d41b7640 1 -- 172.21.15.42:0/3904825903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41cc0b8320 con 0x7f41cc1f49c0 2024-09-16T01:54:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.961+0000 7f41ca7fc640 1 -- 172.21.15.42:0/3904825903 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7f41c00ad020 con 0x7f41cc1f49c0 2024-09-16T01:54:42.964 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:42.964 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 -- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b806c2b0 msgr2=0x7f41b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b806c2b0 0x7f41b806e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f41c4001910 tx=0x7f41c4009040 comp rx=0 tx=0).stop 2024-09-16T01:54:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 -- 172.21.15.42:0/3904825903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41cc1f49c0 msgr2=0x7f41cc1f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41cc1f49c0 0x7f41cc1f4e20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f41c0034040 tx=0x7f41c0004730 comp rx=0 tx=0).stop 2024-09-16T01:54:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 -- 172.21.15.42:0/3904825903 shutdown_connections 2024-09-16T01:54:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b806c2b0 0x7f41b806e770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41cc0b6820 0x7f41cc0b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41cc1f49c0 0x7f41cc1f4e20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 --2- 172.21.15.42:0/3904825903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41b4004390 0x7f41cc0c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 -- 172.21.15.42:0/3904825903 >> 172.21.15.42:0/3904825903 conn(0x7f41cc0d23a0 msgr2=0x7f41cc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 -- 172.21.15.42:0/3904825903 shutdown_connections 2024-09-16T01:54:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:42.963+0000 7f41d41b7640 1 -- 172.21.15.42:0/3904825903 wait complete. 2024-09-16T01:54:42.977 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T01:54:42.977 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:43.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.077+0000 7f7c3d0b7640 1 Processor -- start 2024-09-16T01:54:43.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.077+0000 7f7c3d0b7640 1 -- start start 2024-09-16T01:54:43.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.078+0000 7f7c3d0b7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38161c80 0x7f7c3806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.078+0000 7f7c3d0b7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7c38162060 0x7f7c380b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.078+0000 7f7c3d0b7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c3806e870 con 0x7f7c380b64b0 2024-09-16T01:54:43.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.078+0000 7f7c3d0b7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7c3806d9f0 con 0x7f7c38162060 2024-09-16T01:54:43.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.078+0000 7f7c3d0b7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3806dcd0 con 0x7f7c38161c80 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.078+0000 7f7c36d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38161c80 0x7f7c3806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.078+0000 7f7c3659c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7c38162060 0x7f7c380b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.078+0000 7f7c36d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38161c80 0x7f7c3806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45342/0 (socket says 172.21.15.42:45342) 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.078+0000 7f7c36d9d640 1 -- 172.21.15.42:0/646964146 learned_addr learned my addr 172.21.15.42:0/646964146 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.078+0000 7f7c3659c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7c38162060 0x7f7c380b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:50966/0 (socket says 172.21.15.42:50966) 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.079+0000 7f7c3659c640 1 -- 172.21.15.42:0/646964146 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38161c80 msgr2=0x7f7c3806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.079+0000 7f7c3659c640 1 --2- 172.21.15.42:0/646964146 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38161c80 0x7f7c3806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.079+0000 7f7c3659c640 1 -- 172.21.15.42:0/646964146 >> v1:172.21.15.107:6789/0 conn(0x7f7c380b64b0 legacy=0x7f7c38162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.079+0000 7f7c35d9b640 1 -- 172.21.15.42:0/646964146 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768441742 0 0) 0x7f7c30001490 con 0x7f7c380b64b0 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.079+0000 7f7c3659c640 1 -- 172.21.15.42:0/646964146 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3806dfb0 con 0x7f7c38162060 2024-09-16T01:54:43.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.079+0000 7f7c36d9d640 1 --2- 172.21.15.42:0/646964146 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38161c80 0x7f7c3806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:43.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.079+0000 7f7c3659c640 1 --2- 172.21.15.42:0/646964146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c38162060 0x7f7c380b5f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0097a0 tx=0x7f7c2c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259820eeb6d43a4d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c35d9b640 1 -- 172.21.15.42:0/646964146 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c037070 con 0x7f7c38162060 2024-09-16T01:54:43.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c35d9b640 1 -- 172.21.15.42:0/646964146 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2c032440 con 0x7f7c38162060 2024-09-16T01:54:43.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c35d9b640 1 -- 172.21.15.42:0/646964146 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c032810 con 0x7f7c38162060 2024-09-16T01:54:43.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/646964146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c38162060 msgr2=0x7f7c380b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c3d0b7640 1 --2- 172.21.15.42:0/646964146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c38162060 0x7f7c380b5f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0097a0 tx=0x7f7c2c02a180 comp rx=0 tx=0).stop 2024-09-16T01:54:43.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/646964146 shutdown_connections 2024-09-16T01:54:43.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c3d0b7640 1 --2- 172.21.15.42:0/646964146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c38162060 0x7f7c380b5f70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c3d0b7640 1 --2- 172.21.15.42:0/646964146 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38161c80 0x7f7c3806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/646964146 >> 172.21.15.42:0/646964146 conn(0x7f7c380d44f0 msgr2=0x7f7c380d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/646964146 shutdown_connections 2024-09-16T01:54:43.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.080+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/646964146 wait complete. 2024-09-16T01:54:43.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.082+0000 7f7c3d0b7640 1 Processor -- start 2024-09-16T01:54:43.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.082+0000 7f7c3d0b7640 1 -- start start 2024-09-16T01:54:43.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.082+0000 7f7c3d0b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c380b64b0 0x7f7c380c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.082+0000 7f7c3d0b7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c38161c80 0x7f7c380b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.082+0000 7f7c3d0b7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38162060 0x7f7c380b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.082+0000 7f7c3d0b7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7c380d2a10 con 0x7f7c38161c80 2024-09-16T01:54:43.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.082+0000 7f7c3d0b7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7c380d2890 con 0x7f7c380b64b0 2024-09-16T01:54:43.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.082+0000 7f7c3d0b7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7c380b6960 con 0x7f7c38162060 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c38161c80 0x7f7c380b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c38161c80 0x7f7c380b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53186/0 (socket says 172.21.15.42:53186) 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3659c640 1 -- 172.21.15.42:0/352392044 learned_addr learned my addr 172.21.15.42:0/352392044 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c36d9d640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c380b64b0 0x7f7c380c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3759e640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38162060 0x7f7c380b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3659c640 1 -- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38162060 msgr2=0x7f7c380b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3659c640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38162060 0x7f7c380b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3659c640 1 -- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c380b64b0 msgr2=0x7f7c380c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3659c640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c380b64b0 0x7f7c380c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3659c640 1 -- 172.21.15.42:0/352392044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c380b6150 con 0x7f7c38161c80 2024-09-16T01:54:43.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3759e640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38162060 0x7f7c380b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3659c640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c38161c80 0x7f7c380b2fc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0097a0 tx=0x7f7c2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c1f7fe640 1 -- 172.21.15.42:0/352392044 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c037050 con 0x7f7c38161c80 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c1f7fe640 1 -- 172.21.15.42:0/352392044 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2c038040 con 0x7f7c38161c80 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/352392044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c380b9c20 con 0x7f7c38161c80 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c1f7fe640 1 -- 172.21.15.42:0/352392044 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c004490 con 0x7f7c38161c80 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.083+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/352392044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c380ba1e0 con 0x7f7c38161c80 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.085+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/352392044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c380d0590 con 0x7f7c38161c80 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.085+0000 7f7c1f7fe640 1 -- 172.21.15.42:0/352392044 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7c2c03c6d0 con 0x7f7c38161c80 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.085+0000 7f7c1f7fe640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7c2406c2b0 0x7f7c2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.086+0000 7f7c1f7fe640 1 -- 172.21.15.42:0/352392044 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7c2c0ac050 con 0x7f7c38161c80 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.086+0000 7f7c36d9d640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7c2406c2b0 0x7f7c2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.086+0000 7f7c36d9d640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7c2406c2b0 0x7f7c2406e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c28006ca0 tx=0x7f7c28009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.090+0000 7f7c1f7fe640 1 -- 172.21.15.42:0/352392044 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c380d0590 con 0x7f7c38161c80 2024-09-16T01:54:43.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.264+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/352392044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c38068ea0 con 0x7f7c38161c80 2024-09-16T01:54:43.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.266+0000 7f7c1f7fe640 1 -- 172.21.15.42:0/352392044 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7f7c2c07a510 con 0x7f7c38161c80 2024-09-16T01:54:43.268 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:43.268 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7c2406c2b0 msgr2=0x7f7c2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7c2406c2b0 0x7f7c2406e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c28006ca0 tx=0x7f7c28009240 comp rx=0 tx=0).stop 2024-09-16T01:54:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/352392044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c38161c80 msgr2=0x7f7c380b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c38161c80 0x7f7c380b2fc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0097a0 tx=0x7f7c2c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/352392044 shutdown_connections 2024-09-16T01:54:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7c2406c2b0 0x7f7c2406e770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7c38162060 0x7f7c380b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c38161c80 0x7f7c380b2fc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 --2- 172.21.15.42:0/352392044 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c380b64b0 0x7f7c380c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/352392044 >> 172.21.15.42:0/352392044 conn(0x7f7c380d44f0 msgr2=0x7f7c380b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/352392044 shutdown_connections 2024-09-16T01:54:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.268+0000 7f7c3d0b7640 1 -- 172.21.15.42:0/352392044 wait complete. 2024-09-16T01:54:43.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T01:54:43.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T01:54:43.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T01:54:43.283 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T01:54:43.284 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-16T01:54:43.284 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-16T01:54:43.284 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-16T01:54:43.285 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-16T01:54:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.453+0000 7f3bbc83c640 1 Processor -- start 2024-09-16T01:54:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.453+0000 7f3bbc83c640 1 -- start start 2024-09-16T01:54:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.455+0000 7f3bbc83c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3bb80720b0 0x7f3bb80724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.455+0000 7f3bbc83c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bb80ce340 0x7f3bb80ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.455+0000 7f3bbc83c640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bb8072a10 con 0x7f3bb8162720 2024-09-16T01:54:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.455+0000 7f3bbc83c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3bb80b4b50 con 0x7f3bb80720b0 2024-09-16T01:54:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.455+0000 7f3bbc83c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb80b4df0 con 0x7f3bb80ce340 2024-09-16T01:54:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.455+0000 7f3bb659c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3bb8162720 0x7f3bb80b3ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45390/0 (socket says 172.21.15.42:45390) 2024-09-16T01:54:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.455+0000 7f3bb659c640 1 -- 172.21.15.42:0/3999126924 learned_addr learned my addr 172.21.15.42:0/3999126924 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.455+0000 7f3bb6d9d640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bb80ce340 0x7f3bb80ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.455+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2742547082 0 0) 0x7f3bb8072a10 con 0x7f3bb8162720 2024-09-16T01:54:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.455+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ba0003520 con 0x7f3bb8162720 2024-09-16T01:54:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2786814928 0 0) 0x7f3ba0003520 con 0x7f3bb8162720 2024-09-16T01:54:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bb80ce340 msgr2=0x7f3bb80ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bb80ce340 0x7f3bb80ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 >> v2:172.21.15.107:3300/0 conn(0x7f3bb80720b0 msgr2=0x7f3bb80724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 --2- 172.21.15.42:0/3999126924 >> v2:172.21.15.107:3300/0 conn(0x7f3bb80720b0 0x7f3bb80724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb80b50d0 con 0x7f3bb8162720 2024-09-16T01:54:43.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f3bac001670 con 0x7f3bb8162720 2024-09-16T01:54:43.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 >> v1:172.21.15.42:6789/0 conn(0x7f3bb8162720 legacy=0x7f3bb80b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 0x7f3ba0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bb80ce340 0x7f3ba0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0004d40 0x7f3ba00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb80b4b50 con 0x7f3ba0004d40 2024-09-16T01:54:43.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb80b4df0 con 0x7f3ba00039b0 2024-09-16T01:54:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.456+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba000bba0 con 0x7f3bb80ce340 2024-09-16T01:54:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.457+0000 7f3bb659c640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 0x7f3ba0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.457+0000 7f3bb6d9d640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0004d40 0x7f3ba00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.457+0000 7f3bb659c640 1 -- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bb80ce340 msgr2=0x7f3ba0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.457+0000 7f3bb659c640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bb80ce340 0x7f3ba0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.457+0000 7f3bb659c640 1 -- 172.21.15.42:0/3999126924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0004d40 msgr2=0x7f3ba00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.457+0000 7f3bb659c640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ba0004d40 0x7f3ba00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.457+0000 7f3bb659c640 1 -- 172.21.15.42:0/3999126924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba0003520 con 0x7f3ba00039b0 2024-09-16T01:54:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.458+0000 7f031af2f640 1 Processor -- start 2024-09-16T01:54:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.458+0000 7f38240f1640 1 Processor -- start 2024-09-16T01:54:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.458+0000 7f031af2f640 1 -- start start 2024-09-16T01:54:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.458+0000 7f3bb659c640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 0x7f3ba0003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c160 tx=0x7f3ba0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=915f687ed80f925f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.459+0000 7f8480b3d640 1 Processor -- start 2024-09-16T01:54:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.459+0000 7f8480b3d640 1 -- start start 2024-09-16T01:54:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.459+0000 7fc89ce01640 1 Processor -- start 2024-09-16T01:54:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.459+0000 7fc89ce01640 1 -- start start 2024-09-16T01:54:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.459+0000 7f38240f1640 1 -- start start 2024-09-16T01:54:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.459+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac007c80 con 0x7f3ba00039b0 2024-09-16T01:54:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.459+0000 7f3bb559a640 1 -- 172.21.15.42:0/3999126924 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bac005ad0 con 0x7f3ba00039b0 2024-09-16T01:54:43.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.459+0000 7f031af2f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f030c00bda0 0x7f030c00c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f031af2f640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f030c00c6c0 con 0x7f030c038230 2024-09-16T01:54:43.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f031af2f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f030c008f90 con 0x7f030c008760 2024-09-16T01:54:43.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f031af2f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f030c009270 con 0x7f030c00bda0 2024-09-16T01:54:43.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f031a72e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f030c008760 0x7f030c051b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:50980/0 (socket says 172.21.15.42:50980) 2024-09-16T01:54:43.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f031a72e640 1 -- 172.21.15.42:0/225649101 learned_addr learned my addr 172.21.15.42:0/225649101 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f38240f1640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f381c162ad0 0x7f381c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f8480b3d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f847c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f38240f1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f381c06f6f0 0x7f381c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f8480b3d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f847c0aee50 con 0x7f847c06f650 2024-09-16T01:54:43.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f8480b3d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f847c0ae5b0 con 0x7f847c0adfb0 2024-09-16T01:54:43.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f8480b3d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f847c06fa90 con 0x7f847c147920 2024-09-16T01:54:43.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f38240f1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f381c0afa20 con 0x7f381c0720b0 2024-09-16T01:54:43.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1460116771 0 0) 0x7f030c008f90 con 0x7f030c008760 2024-09-16T01:54:43.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0300003520 con 0x7f030c008760 2024-09-16T01:54:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f38240f1640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f381c0afce0 con 0x7f381c162ad0 2024-09-16T01:54:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f38240f1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f381c0b34d0 con 0x7f381c06f6f0 2024-09-16T01:54:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f382168c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f381c162ad0 0x7f381c0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f847bfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f847c0adfb0 0x7f847c0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:50990/0 (socket says 172.21.15.42:50990) 2024-09-16T01:54:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f3bbc83c640 1 -- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 msgr2=0x7f3ba0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f3bbc83c640 1 --2- 172.21.15.42:0/3999126924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 0x7f3ba0003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c160 tx=0x7f3ba0005830 comp rx=0 tx=0).stop 2024-09-16T01:54:43.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f3bb6d9d640 1 -- 172.21.15.42:0/3999126924 reap_dead start 2024-09-16T01:54:43.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f847b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f847c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f847b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f847c06f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45376/0 (socket says 172.21.15.42:45376) 2024-09-16T01:54:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f382168c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f381c162ad0 0x7f381c0cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53212/0 (socket says 172.21.15.42:53212) 2024-09-16T01:54:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.460+0000 7f382168c640 1 -- 172.21.15.42:0/2141200836 learned_addr learned my addr 172.21.15.42:0/2141200836 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f847bfff640 1 -- 172.21.15.42:0/1548424436 learned_addr learned my addr 172.21.15.42:0/1548424436 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f3bbc83c640 1 -- 172.21.15.42:0/3999126924 shutdown_connections 2024-09-16T01:54:43.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f3bbc83c640 1 -- 172.21.15.42:0/3999126924 >> 172.21.15.42:0/3999126924 conn(0x7f3bb8067b30 msgr2=0x7f3bb806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0319f2d640 1 --2- 172.21.15.42:0/225649101 >> v2:172.21.15.107:3300/0 conn(0x7f030c00bda0 0x7f030c00c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688969028 0 0) 0x7f030c00c6c0 con 0x7f030c038230 2024-09-16T01:54:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f030c008f90 con 0x7f030c038230 2024-09-16T01:54:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4035766090 0 0) 0x7f0300003520 con 0x7f030c008760 2024-09-16T01:54:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 >> v2:172.21.15.107:3300/0 conn(0x7f030c00bda0 msgr2=0x7f030c00c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 --2- 172.21.15.42:0/225649101 >> v2:172.21.15.107:3300/0 conn(0x7f030c00bda0 0x7f030c00c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 >> v1:172.21.15.42:6789/0 conn(0x7f030c038230 legacy=0x7f030c051430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c009550 con 0x7f030c008760 2024-09-16T01:54:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f0314050800 con 0x7f030c008760 2024-09-16T01:54:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 >> v1:172.21.15.107:6789/0 conn(0x7f030c008760 legacy=0x7f030c051b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 --2- 172.21.15.42:0/225649101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0300003b40 0x7f0300003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 --2- 172.21.15.42:0/225649101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03000079a0 0x7f0300009d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 --2- 172.21.15.42:0/225649101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f030000a380 0x7f030000c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f030c009270 con 0x7f03000079a0 2024-09-16T01:54:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f030000d120 con 0x7f030000a380 2024-09-16T01:54:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f030000d320 con 0x7f0300003b40 2024-09-16T01:54:43.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f0319f2d640 1 --2- 172.21.15.42:0/225649101 >> v2:172.21.15.107:3300/0 conn(0x7f030c00bda0 0x7f030c00c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:43.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017361826 0 0) 0x7f847c0ae5b0 con 0x7f847c0adfb0 2024-09-16T01:54:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f3820e8b640 1 -- 172.21.15.42:0/2141200836 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978723574 0 0) 0x7f381c0afa20 con 0x7f381c0720b0 2024-09-16T01:54:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f3820e8b640 1 -- 172.21.15.42:0/2141200836 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3808003520 con 0x7f381c0720b0 2024-09-16T01:54:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f382268e640 1 --2- 172.21.15.42:0/2141200836 >> v2:172.21.15.107:3300/0 conn(0x7f381c06f6f0 0x7f381c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f382168c640 1 -- 172.21.15.42:0/2141200836 >> v2:172.21.15.107:3300/0 conn(0x7f381c06f6f0 msgr2=0x7f381c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f382168c640 1 --2- 172.21.15.42:0/2141200836 >> v2:172.21.15.107:3300/0 conn(0x7f381c06f6f0 0x7f381c0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f382168c640 1 -- 172.21.15.42:0/2141200836 >> v1:172.21.15.107:6789/0 conn(0x7f381c0720b0 legacy=0x7f381c072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7f382168c640 1 -- 172.21.15.42:0/2141200836 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c0b37b0 con 0x7f381c162ad0 2024-09-16T01:54:43.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8468003520 con 0x7f847c0adfb0 2024-09-16T01:54:43.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f0319f2d640 1 --2- 172.21.15.42:0/225649101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0300003b40 0x7f0300003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f031a72e640 1 --2- 172.21.15.42:0/225649101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f030000a380 0x7f030000c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7fc89ce01640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc898147230 0x7fc89806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7fc89ce01640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8980727c0 0x7fc8980aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7fc89ce01640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc89806f480 con 0x7fc898147e90 2024-09-16T01:54:43.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7fc89ce01640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fc8980b34d0 con 0x7fc898147230 2024-09-16T01:54:43.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.461+0000 7fc89ce01640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc8980ae9e0 con 0x7fc8980727c0 2024-09-16T01:54:43.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f3bbc83c640 1 -- 172.21.15.42:0/3999126924 shutdown_connections 2024-09-16T01:54:43.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f3bbc83c640 1 -- 172.21.15.42:0/3999126924 wait complete. 2024-09-16T01:54:43.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7fc895d9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc898147e90 0x7fc8980720b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:51004/0 (socket says 172.21.15.42:51004) 2024-09-16T01:54:43.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7fc895d9b640 1 -- 172.21.15.42:0/599824372 learned_addr learned my addr 172.21.15.42:0/599824372 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:43.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7fc896d9d640 1 --2- 172.21.15.42:0/599824372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8980727c0 0x7fc8980aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2884416362 0 0) 0x7f8468003520 con 0x7f847c0adfb0 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 msgr2=0x7f847c06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f847c06f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 >> v1:172.21.15.42:6789/0 conn(0x7f847c06f650 legacy=0x7f847c0ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847c0ae890 con 0x7f847c0adfb0 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f84740019f0 con 0x7f847c0adfb0 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 >> v1:172.21.15.107:6789/0 conn(0x7f847c0adfb0 legacy=0x7f847c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84680039b0 0x7f8468003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8468004800 0x7f8468004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f84680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f847c06fa90 con 0x7f84680039b0 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8468014280 con 0x7f8468004800 2024-09-16T01:54:43.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8468014480 con 0x7f847c147920 2024-09-16T01:54:43.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f0319f2d640 1 -- 172.21.15.42:0/225649101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f030000a380 msgr2=0x7f030000c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7fc89659c640 1 --2- 172.21.15.42:0/599824372 >> v2:172.21.15.42:3300/0 conn(0x7fc898147230 0x7fc89806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f0319f2d640 1 --2- 172.21.15.42:0/225649101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f030000a380 0x7f030000c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f0319f2d640 1 -- 172.21.15.42:0/225649101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03000079a0 msgr2=0x7f0300009d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f0319f2d640 1 --2- 172.21.15.42:0/225649101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03000079a0 0x7f0300009d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f847affd640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8468004800 0x7f8468004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.462+0000 7f0319f2d640 1 -- 172.21.15.42:0/225649101 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0300003520 con 0x7f0300003b40 2024-09-16T01:54:43.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7f031a72e640 1 -- 172.21.15.42:0/225649101 reap_dead start 2024-09-16T01:54:43.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7fc89559a640 1 -- 172.21.15.42:0/599824372 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395206588 0 0) 0x7fc89806f480 con 0x7fc898147e90 2024-09-16T01:54:43.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7fc89559a640 1 -- 172.21.15.42:0/599824372 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc880003520 con 0x7fc898147e90 2024-09-16T01:54:43.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7f847bfff640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f84680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7f847b7fe640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84680039b0 0x7f8468003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7fd5cda37640 1 Processor -- start 2024-09-16T01:54:43.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7fc896d9d640 1 -- 172.21.15.42:0/599824372 >> v2:172.21.15.42:3300/0 conn(0x7fc898147230 msgr2=0x7fc89806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7fc896d9d640 1 --2- 172.21.15.42:0/599824372 >> v2:172.21.15.42:3300/0 conn(0x7fc898147230 0x7fc89806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7fc896d9d640 1 -- 172.21.15.42:0/599824372 >> v1:172.21.15.107:6789/0 conn(0x7fc898147e90 legacy=0x7fc8980720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7fc896d9d640 1 -- 172.21.15.42:0/599824372 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89806e900 con 0x7fc8980727c0 2024-09-16T01:54:43.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7fd5cda37640 1 -- start start 2024-09-16T01:54:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7f847bfff640 1 -- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8468004800 msgr2=0x7f8468004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7f847bfff640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8468004800 0x7f8468004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7f847bfff640 1 -- 172.21.15.42:0/1548424436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84680039b0 msgr2=0x7f8468003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7f847bfff640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84680039b0 0x7f8468003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.463+0000 7f847bfff640 1 -- 172.21.15.42:0/1548424436 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8468003520 con 0x7f847c147920 2024-09-16T01:54:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.464+0000 7f0319f2d640 1 --2- 172.21.15.42:0/225649101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0300003b40 0x7f0300003f80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f030400aa60 tx=0x7f0300005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e780d19a5682241d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.464+0000 7f3bbc83c640 1 Processor -- start 2024-09-16T01:54:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.464+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304037070 con 0x7f0300003b40 2024-09-16T01:54:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.464+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f030402abf0 con 0x7f0300003b40 2024-09-16T01:54:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.464+0000 7f0318f2b640 1 -- 172.21.15.42:0/225649101 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030400a630 con 0x7f0300003b40 2024-09-16T01:54:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.464+0000 7f3bbc83c640 1 -- start start 2024-09-16T01:54:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.464+0000 7eff1bfff640 1 Processor -- start 2024-09-16T01:54:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.464+0000 7eff1bfff640 1 -- start start 2024-09-16T01:54:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f382168c640 1 --2- 172.21.15.42:0/2141200836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f381c162ad0 0x7f381c0cfca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f381c0affc0 tx=0x7f381402a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6acdb90a27eee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f847bfff640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f84680051c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f847400a740 tx=0x7f8468005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67568b4328493c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7fc896d9d640 1 --2- 172.21.15.42:0/599824372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8980727c0 0x7fc8980aee10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc890009d90 tx=0x7fc89002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c217515d09637376 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7fc89559a640 1 -- 172.21.15.42:0/599824372 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc890007740 con 0x7fc8980727c0 2024-09-16T01:54:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f3820e8b640 1 -- 172.21.15.42:0/2141200836 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814036070 con 0x7f381c162ad0 2024-09-16T01:54:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f3820e8b640 1 -- 172.21.15.42:0/2141200836 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3814031600 con 0x7f381c162ad0 2024-09-16T01:54:43.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f3820e8b640 1 -- 172.21.15.42:0/2141200836 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38140319d0 con 0x7f381c162ad0 2024-09-16T01:54:43.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7fc89559a640 1 -- 172.21.15.42:0/599824372 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8900078e0 con 0x7fc8980727c0 2024-09-16T01:54:43.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7fd5cda37640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5c815ea90 0x7fd5c80cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f3bbc83c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 0x7f3bb8164a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7fd5c6ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd5c815a2c0 0x7fd5c80cc9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:51020/0 (socket says 172.21.15.42:51020) 2024-09-16T01:54:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7fd5c6ffd640 1 -- 172.21.15.42:0/2187096225 learned_addr learned my addr 172.21.15.42:0/2187096225 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f3bbc83c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb8160300 0x7f3bb815e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f031af2f640 1 -- 172.21.15.42:0/225649101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0300003b40 msgr2=0x7f0300003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f031af2f640 1 --2- 172.21.15.42:0/225649101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0300003b40 0x7f0300003f80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f030400aa60 tx=0x7f0300005830 comp rx=0 tx=0).stop 2024-09-16T01:54:43.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f3bbc83c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bb813c3e0 0x7f3bb813c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 0x7f3bb8164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 0x7f3bb8164a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51036/0 (socket says 172.21.15.42:51036) 2024-09-16T01:54:43.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f3bb659c640 1 -- 172.21.15.42:0/1376614752 learned_addr learned my addr 172.21.15.42:0/1376614752 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f031af2f640 1 -- 172.21.15.42:0/225649101 shutdown_connections 2024-09-16T01:54:43.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f031af2f640 1 --2- 172.21.15.42:0/225649101 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0300003b40 0x7f0300003f80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7f031af2f640 1 -- 172.21.15.42:0/225649101 >> 172.21.15.42:0/225649101 conn(0x7f030c0567b0 msgr2=0x7f030c056bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7fd5c67fc640 1 --2- 172.21.15.42:0/2187096225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5c815ea90 0x7fd5c80cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb80b45f0 con 0x7f3bb8160300 2024-09-16T01:54:43.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb80b5690 con 0x7f3ba00039b0 2024-09-16T01:54:43.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb8162b00 con 0x7f3bb813c3e0 2024-09-16T01:54:43.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847400a390 con 0x7f847c147920 2024-09-16T01:54:43.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847402f070 con 0x7f847c147920 2024-09-16T01:54:43.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7fd5cda37640 1 -- 172.21.15.42:0/2187096225 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5c80ce620 con 0x7fd5c80720b0 2024-09-16T01:54:43.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.465+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c073430 0x7eff1c15b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7fd5cda37640 1 -- 172.21.15.42:0/2187096225 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5c80ce8c0 con 0x7fd5c815a2c0 2024-09-16T01:54:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7fd5cda37640 1 -- 172.21.15.42:0/2187096225 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c80ce3f0 con 0x7fd5c815ea90 2024-09-16T01:54:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f031af2f640 1 -- 172.21.15.42:0/225649101 shutdown_connections 2024-09-16T01:54:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f3bb659c640 1 -- 172.21.15.42:0/1376614752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bb813c3e0 msgr2=0x7f3bb813c890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T01:54:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f3bb659c640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bb813c3e0 0x7f3bb813c890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f3bb659c640 1 -- 172.21.15.42:0/1376614752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb8160300 msgr2=0x7f3bb815e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f3bb659c640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bb8160300 0x7f3bb815e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f3bb659c640 1 -- 172.21.15.42:0/1376614752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb81368b0 con 0x7f3ba00039b0 2024-09-16T01:54:43.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f031af2f640 1 -- 172.21.15.42:0/225649101 wait complete. 2024-09-16T01:54:43.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f847a7fc640 1 -- 172.21.15.42:0/1548424436 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847402bc40 con 0x7f847c147920 2024-09-16T01:54:43.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f38240f1640 1 -- 172.21.15.42:0/2141200836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f381c162ad0 msgr2=0x7f381c0cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f38240f1640 1 --2- 172.21.15.42:0/2141200836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f381c162ad0 0x7f381c0cfca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f381c0affc0 tx=0x7f381402a740 comp rx=0 tx=0).stop 2024-09-16T01:54:43.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7eff1bfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7eff1c0d0c70 0x7eff1c15bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7eff1bfff640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c15c630 con 0x7eff1c13e070 2024-09-16T01:54:43.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7eff1bfff640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7eff1c0cfc80 con 0x7eff1c0d0c70 2024-09-16T01:54:43.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7eff1bfff640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c13e450 con 0x7eff1c073430 2024-09-16T01:54:43.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7eff1b7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7eff1c0d0c70 0x7eff1c15bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7eff1b7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7eff1c0d0c70 0x7eff1c15bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51048/0 (socket says 172.21.15.42:51048) 2024-09-16T01:54:43.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7eff1b7fe640 1 -- 172.21.15.42:0/2497040771 learned_addr learned my addr 172.21.15.42:0/2497040771 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7fc89559a640 1 -- 172.21.15.42:0/599824372 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc890007cb0 con 0x7fc8980727c0 2024-09-16T01:54:43.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f38240f1640 1 -- 172.21.15.42:0/2141200836 shutdown_connections 2024-09-16T01:54:43.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f38240f1640 1 --2- 172.21.15.42:0/2141200836 >> v2:172.21.15.107:3300/0 conn(0x7f381c06f6f0 0x7f381c0b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f38240f1640 1 --2- 172.21.15.42:0/2141200836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f381c162ad0 0x7f381c0cfca0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f38240f1640 1 -- 172.21.15.42:0/2141200836 >> 172.21.15.42:0/2141200836 conn(0x7f381c067d70 msgr2=0x7f381c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f38240f1640 1 -- 172.21.15.42:0/2141200836 shutdown_connections 2024-09-16T01:54:43.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f38240f1640 1 -- 172.21.15.42:0/2141200836 wait complete. 2024-09-16T01:54:43.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7fc89ce01640 1 -- 172.21.15.42:0/599824372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8980727c0 msgr2=0x7fc8980aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7fc89ce01640 1 --2- 172.21.15.42:0/599824372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8980727c0 0x7fc8980aee10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc890009d90 tx=0x7fc89002a660 comp rx=0 tx=0).stop 2024-09-16T01:54:43.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7fd5c67fc640 1 -- 172.21.15.42:0/2187096225 >> v1:172.21.15.107:6789/0 conn(0x7fd5c815a2c0 legacy=0x7fd5c80cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7fd5c67fc640 1 -- 172.21.15.42:0/2187096225 >> v1:172.21.15.42:6789/0 conn(0x7fd5c80720b0 legacy=0x7fd5c80b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7fd5c67fc640 1 -- 172.21.15.42:0/2187096225 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c80ceba0 con 0x7fd5c815ea90 2024-09-16T01:54:43.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7eff1a7fc640 1 --2- 172.21.15.42:0/2497040771 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c073430 0x7eff1c15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7eff1b7fe640 1 -- 172.21.15.42:0/2497040771 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c073430 msgr2=0x7eff1c15b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7eff1b7fe640 1 --2- 172.21.15.42:0/2497040771 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c073430 0x7eff1c15b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7eff1b7fe640 1 -- 172.21.15.42:0/2497040771 >> v1:172.21.15.42:6789/0 conn(0x7eff1c13e070 legacy=0x7eff1c072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7eff1b7fe640 1 -- 172.21.15.42:0/2497040771 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c0cfeb0 con 0x7eff1c0d0c70 2024-09-16T01:54:43.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.466+0000 7f5d531d6640 1 Processor -- start 2024-09-16T01:54:43.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f5d531d6640 1 -- start start 2024-09-16T01:54:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7fc89ce01640 1 -- 172.21.15.42:0/599824372 shutdown_connections 2024-09-16T01:54:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7fc89ce01640 1 --2- 172.21.15.42:0/599824372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc8980727c0 0x7fc8980aee10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7fc89ce01640 1 --2- 172.21.15.42:0/599824372 >> v2:172.21.15.42:3300/0 conn(0x7fc898147230 0x7fc89806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7fc89ce01640 1 -- 172.21.15.42:0/599824372 >> 172.21.15.42:0/599824372 conn(0x7fc898067d70 msgr2=0x7fc89806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f8480b3d640 1 -- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 msgr2=0x7f84680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f8480b3d640 1 --2- 172.21.15.42:0/1548424436 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f84680051c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f847400a740 tx=0x7f8468005830 comp rx=0 tx=0).stop 2024-09-16T01:54:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f847bfff640 1 -- 172.21.15.42:0/1548424436 reap_dead start 2024-09-16T01:54:43.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f8480b3d640 1 -- 172.21.15.42:0/1548424436 shutdown_connections 2024-09-16T01:54:43.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f8480b3d640 1 -- 172.21.15.42:0/1548424436 >> 172.21.15.42:0/1548424436 conn(0x7f847c0b1e00 msgr2=0x7f847c0b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7fc89ce01640 1 -- 172.21.15.42:0/599824372 shutdown_connections 2024-09-16T01:54:43.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7fc89ce01640 1 -- 172.21.15.42:0/599824372 wait complete. 2024-09-16T01:54:43.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7fd5c67fc640 1 --2- 172.21.15.42:0/2187096225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5c815ea90 0x7fd5c80cf680 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd5c806c800 tx=0x7fd5bc02b170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61ed251ea88d0302 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7eff1b7fe640 1 --2- 172.21.15.42:0/2497040771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d0c70 0x7eff1c15bdd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff1400d150 tx=0x7eff1402c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a10a42fecd55872 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7fd5c5ffb640 1 -- 172.21.15.42:0/2187096225 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0089e0 con 0x7fd5c815ea90 2024-09-16T01:54:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7fd5c5ffb640 1 -- 172.21.15.42:0/2187096225 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5bc008b80 con 0x7fd5c815ea90 2024-09-16T01:54:43.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f031af2f640 1 Processor -- start 2024-09-16T01:54:43.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7fd5c5ffb640 1 -- 172.21.15.42:0/2187096225 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00a0d0 con 0x7fd5c815ea90 2024-09-16T01:54:43.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7eff19ffb640 1 -- 172.21.15.42:0/2497040771 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1400b2e0 con 0x7eff1c0d0c70 2024-09-16T01:54:43.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7eff19ffb640 1 -- 172.21.15.42:0/2497040771 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff14009600 con 0x7eff1c0d0c70 2024-09-16T01:54:43.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7eff19ffb640 1 -- 172.21.15.42:0/2497040771 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1400b480 con 0x7eff1c0d0c70 2024-09-16T01:54:43.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f5d531d6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5d4c154a00 0x7f5d4c0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f5d531d6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5d4c0725f0 0x7f5d4c15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f5d43fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5d4c0725f0 0x7f5d4c15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f5d43fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5d4c0725f0 0x7f5d4c15e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53264/0 (socket says 172.21.15.42:53264) 2024-09-16T01:54:43.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f5d50f72640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5d4c154a00 0x7f5d4c0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f5d50f72640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5d4c154a00 0x7f5d4c0720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51062/0 (socket says 172.21.15.42:51062) 2024-09-16T01:54:43.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f5d50f72640 1 -- 172.21.15.42:0/2666493150 learned_addr learned my addr 172.21.15.42:0/2666493150 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f5d531d6640 1 -- 172.21.15.42:0/2666493150 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4c0b59d0 con 0x7f5d4c15e730 2024-09-16T01:54:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f5d531d6640 1 -- 172.21.15.42:0/2666493150 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4c15a980 con 0x7f5d4c0725f0 2024-09-16T01:54:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f5d531d6640 1 -- 172.21.15.42:0/2666493150 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4c15b980 con 0x7f5d4c154a00 2024-09-16T01:54:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f38240f1640 1 Processor -- start 2024-09-16T01:54:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f3bb659c640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 0x7f3bb8164a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3bac02ad60 tx=0x7f3bb80b52a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f3ba6ffd640 1 -- 172.21.15.42:0/1376614752 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac040020 con 0x7f3ba00039b0 2024-09-16T01:54:43.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.467+0000 7f3ba6ffd640 1 -- 172.21.15.42:0/1376614752 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bac001630 con 0x7f3ba00039b0 2024-09-16T01:54:43.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f3ba6ffd640 1 -- 172.21.15.42:0/1376614752 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac037040 con 0x7f3ba00039b0 2024-09-16T01:54:43.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f8480b3d640 1 -- 172.21.15.42:0/1548424436 shutdown_connections 2024-09-16T01:54:43.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f38240f1640 1 -- start start 2024-09-16T01:54:43.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb81607e0 con 0x7f3ba00039b0 2024-09-16T01:54:43.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb8160da0 con 0x7f3ba00039b0 2024-09-16T01:54:43.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.468+0000 7f031af2f640 1 -- start start 2024-09-16T01:54:43.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f5d437fe640 1 -- 172.21.15.42:0/2666493150 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3456370672 0 0) 0x7f5d4c0b59d0 con 0x7f5d4c15e730 2024-09-16T01:54:43.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7fd5cda37640 1 -- 172.21.15.42:0/2187096225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5c815ea90 msgr2=0x7fd5c80cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7fd5cda37640 1 --2- 172.21.15.42:0/2187096225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5c815ea90 0x7fd5c80cf680 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd5c806c800 tx=0x7fd5bc02b170 comp rx=0 tx=0).stop 2024-09-16T01:54:43.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7eff1bfff640 1 -- 172.21.15.42:0/2497040771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d0c70 msgr2=0x7eff1c15bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7eff1bfff640 1 --2- 172.21.15.42:0/2497040771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d0c70 0x7eff1c15bdd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff1400d150 tx=0x7eff1402c8e0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f5d437fe640 1 -- 172.21.15.42:0/2666493150 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d34003520 con 0x7f5d4c15e730 2024-09-16T01:54:43.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f031af2f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0300003b40 0x7f030c03c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f031af2f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f030c0e0a30 0x7f030c055470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f031af2f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f030c0559b0 0x7f030c04eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f031af2f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f030c008d70 con 0x7f0300003b40 2024-09-16T01:54:43.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f031af2f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f030c008bf0 con 0x7f030c0e0a30 2024-09-16T01:54:43.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f031af2f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f030c0ea710 con 0x7f030c0559b0 2024-09-16T01:54:43.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7fd5cda37640 1 -- 172.21.15.42:0/2187096225 shutdown_connections 2024-09-16T01:54:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7eff1bfff640 1 -- 172.21.15.42:0/2497040771 shutdown_connections 2024-09-16T01:54:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7eff1bfff640 1 --2- 172.21.15.42:0/2497040771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c0d0c70 0x7eff1c15bdd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7eff1bfff640 1 --2- 172.21.15.42:0/2497040771 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c073430 0x7eff1c15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7eff1bfff640 1 -- 172.21.15.42:0/2497040771 >> 172.21.15.42:0/2497040771 conn(0x7eff1c0b2f20 msgr2=0x7eff1c0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7eff1bfff640 1 -- 172.21.15.42:0/2497040771 shutdown_connections 2024-09-16T01:54:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7fd5cda37640 1 --2- 172.21.15.42:0/2187096225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5c815ea90 0x7fd5c80cf680 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7fd5cda37640 1 -- 172.21.15.42:0/2187096225 >> 172.21.15.42:0/2187096225 conn(0x7fd5c8067b30 msgr2=0x7fd5c806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.469+0000 7f5d43fff640 1 -- 172.21.15.42:0/2666493150 >> v2:172.21.15.107:3300/0 conn(0x7f5d4c154a00 msgr2=0x7f5d4c0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f5d43fff640 1 --2- 172.21.15.42:0/2666493150 >> v2:172.21.15.107:3300/0 conn(0x7f5d4c154a00 0x7f5d4c0720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f5d43fff640 1 -- 172.21.15.42:0/2666493150 >> v1:172.21.15.107:6789/0 conn(0x7f5d4c15e730 legacy=0x7f5d4c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f031a72e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f030c0559b0 0x7f030c04eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7eff1bfff640 1 -- 172.21.15.42:0/2497040771 wait complete. 2024-09-16T01:54:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f031a72e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f030c0559b0 0x7f030c04eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45426/0 (socket says 172.21.15.42:45426) 2024-09-16T01:54:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7fd5cda37640 1 -- 172.21.15.42:0/2187096225 shutdown_connections 2024-09-16T01:54:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7fd5cda37640 1 -- 172.21.15.42:0/2187096225 wait complete. 2024-09-16T01:54:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f5d43fff640 1 -- 172.21.15.42:0/2666493150 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c15abc0 con 0x7f5d4c0725f0 2024-09-16T01:54:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7fc89ce01640 1 Processor -- start 2024-09-16T01:54:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f0319f2d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0300003b40 0x7f030c03c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7fc89ce01640 1 -- start start 2024-09-16T01:54:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f0319f2d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0300003b40 0x7f030c03c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53266/0 (socket says 172.21.15.42:53266) 2024-09-16T01:54:43.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f0319f2d640 1 -- 172.21.15.42:0/2359601515 learned_addr learned my addr 172.21.15.42:0/2359601515 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f3ba4ff9640 1 -- 172.21.15.42:0/1376614752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3bb80cc790 con 0x7f3ba00039b0 2024-09-16T01:54:43.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f031972c640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f030c0e0a30 0x7f030c055470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f0319f2d640 1 -- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f030c0559b0 msgr2=0x7f030c04eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f0319f2d640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f030c0559b0 0x7f030c04eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f0319f2d640 1 -- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f030c0e0a30 msgr2=0x7f030c055470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f0319f2d640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f030c0e0a30 0x7f030c055470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f38240f1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f381c06f6f0 0x7f381c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f0319f2d640 1 -- 172.21.15.42:0/2359601515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c0e0e90 con 0x7f0300003b40 2024-09-16T01:54:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f031a72e640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f030c0559b0 0x7f030c04eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f38240f1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f381c0720b0 0x7f381c15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f8480b3d640 1 -- 172.21.15.42:0/1548424436 wait complete. 2024-09-16T01:54:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.470+0000 7f031972c640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f030c0e0a30 0x7f030c055470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f0319f2d640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0300003b40 0x7f030c03c240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0304006bb0 tx=0x7f0304004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f3821e8d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f381c06f6f0 0x7f381c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f3821e8d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f381c06f6f0 0x7f381c15b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45438/0 (socket says 172.21.15.42:45438) 2024-09-16T01:54:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f030a7fc640 1 -- 172.21.15.42:0/2359601515 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304040020 con 0x7f0300003b40 2024-09-16T01:54:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030c03b1a0 con 0x7f0300003b40 2024-09-16T01:54:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030c03b760 con 0x7f0300003b40 2024-09-16T01:54:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f030a7fc640 1 -- 172.21.15.42:0/2359601515 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0304038040 con 0x7f0300003b40 2024-09-16T01:54:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f030a7fc640 1 -- 172.21.15.42:0/2359601515 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304037070 con 0x7f0300003b40 2024-09-16T01:54:43.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7f5d43fff640 1 --2- 172.21.15.42:0/2666493150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d4c0725f0 0x7f5d4c15e1f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c06c5e0 tx=0x7f5d3c02c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e094b5a383f2e443 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.471+0000 7fc89ce01640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8980727c0 0x7fc8981f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7eff1bfff640 1 Processor -- start 2024-09-16T01:54:43.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7fc89ce01640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc898147230 0x7fc8980ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7fc89ce01640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc898147e90 0x7fc8980abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7fd5cda37640 1 Processor -- start 2024-09-16T01:54:43.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7fc895d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc898147230 0x7fc8980ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7eff1bfff640 1 -- start start 2024-09-16T01:54:43.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f030c00c180 con 0x7f0300003b40 2024-09-16T01:54:43.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7fc895d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc898147230 0x7fc8980ab910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51084/0 (socket says 172.21.15.42:51084) 2024-09-16T01:54:43.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7f38240f1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f381c162ad0 0x7f381c1f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7fc895d9b640 1 -- 172.21.15.42:0/2812001528 learned_addr learned my addr 172.21.15.42:0/2812001528 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7fd5cda37640 1 -- start start 2024-09-16T01:54:43.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7f8480b3d640 1 Processor -- start 2024-09-16T01:54:43.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7f38240f1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f381c0b47d0 con 0x7f381c0720b0 2024-09-16T01:54:43.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7f38240f1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f381c0b3d70 con 0x7f381c162ad0 2024-09-16T01:54:43.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7f38240f1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f381c0b4950 con 0x7f381c06f6f0 2024-09-16T01:54:43.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7f382168c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f381c0720b0 0x7f381c15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7f382168c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f381c0720b0 0x7f381c15c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53276/0 (socket says 172.21.15.42:53276) 2024-09-16T01:54:43.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.472+0000 7f382168c640 1 -- 172.21.15.42:0/2273849873 learned_addr learned my addr 172.21.15.42:0/2273849873 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7fc896d9d640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc898147e90 0x7fc8980abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7f8480b3d640 1 -- start start 2024-09-16T01:54:43.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7fc89659c640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8980727c0 0x7fc8981f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7f382168c640 1 -- 172.21.15.42:0/2273849873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f381c06f6f0 msgr2=0x7f381c15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7f382168c640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f381c06f6f0 0x7f381c15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7f382168c640 1 -- 172.21.15.42:0/2273849873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f381c162ad0 msgr2=0x7f381c1f91f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:54:43.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7f382168c640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f381c162ad0 0x7f381c1f91f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c073430 0x7eff1c155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7f382168c640 1 -- 172.21.15.42:0/2273849873 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c15a4f0 con 0x7f381c0720b0 2024-09-16T01:54:43.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d0c70 0x7eff1c152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7eff1affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c073430 0x7eff1c155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7f5d437fe640 1 -- 172.21.15.42:0/2666493150 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c031710 con 0x7f5d4c0725f0 2024-09-16T01:54:43.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7f5d437fe640 1 -- 172.21.15.42:0/2666493150 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0318b0 con 0x7f5d4c0725f0 2024-09-16T01:54:43.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7f5d437fe640 1 -- 172.21.15.42:0/2666493150 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c031c80 con 0x7f5d4c0725f0 2024-09-16T01:54:43.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7eff1affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c073430 0x7eff1c155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51106/0 (socket says 172.21.15.42:51106) 2024-09-16T01:54:43.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7eff1a7fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d0c70 0x7eff1c152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7fc89ce01640 1 -- 172.21.15.42:0/2812001528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc89806f1a0 con 0x7fc8980727c0 2024-09-16T01:54:43.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7fc89ce01640 1 -- 172.21.15.42:0/2812001528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc89806eec0 con 0x7fc898147230 2024-09-16T01:54:43.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7fc89ce01640 1 -- 172.21.15.42:0/2812001528 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc89806e5f0 con 0x7fc898147e90 2024-09-16T01:54:43.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7f382168c640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f381c0720b0 0x7f381c15c7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f381402ad30 tx=0x7f3814004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.473+0000 7eff1a7fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d0c70 0x7eff1c152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45448/0 (socket says 172.21.15.42:45448) 2024-09-16T01:54:43.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7eff1affd640 1 -- 172.21.15.42:0/2086300455 learned_addr learned my addr 172.21.15.42:0/2086300455 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7eff1bfff640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff1c13e070 0x7eff1c153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f3ba6ffd640 1 -- 172.21.15.42:0/1376614752 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3bac043020 con 0x7f3ba00039b0 2024-09-16T01:54:43.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f8480b3d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f847c140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f8480b3d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f847c141ab0 0x7f847c0a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f8480b3d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f847c0aa3e0 0x7f847c13f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f8480b3d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f847c147d00 con 0x7f847c141ab0 2024-09-16T01:54:43.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f8480b3d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f847c071ec0 con 0x7f847c0aa3e0 2024-09-16T01:54:43.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f8480b3d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f847c147e80 con 0x7f847c147920 2024-09-16T01:54:43.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f38127fc640 1 -- 172.21.15.42:0/2273849873 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814041030 con 0x7f381c0720b0 2024-09-16T01:54:43.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381c15a7d0 con 0x7f381c0720b0 2024-09-16T01:54:43.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f381c15ad90 con 0x7f381c0720b0 2024-09-16T01:54:43.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f38127fc640 1 -- 172.21.15.42:0/2273849873 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3814037040 con 0x7f381c0720b0 2024-09-16T01:54:43.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7eff1bfff640 1 -- 172.21.15.42:0/2086300455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c0d0750 con 0x7eff1c13e070 2024-09-16T01:54:43.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7eff1bfff640 1 -- 172.21.15.42:0/2086300455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c0d0470 con 0x7eff1c073430 2024-09-16T01:54:43.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7eff1bfff640 1 -- 172.21.15.42:0/2086300455 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c15c310 con 0x7eff1c0d0c70 2024-09-16T01:54:43.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7fd5cda37640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c80720b0 0x7fd5c81f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f3ba6ffd640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3b9806c380 0x7f3b9806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f030a7fc640 1 -- 172.21.15.42:0/2359601515 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0304043020 con 0x7f0300003b40 2024-09-16T01:54:43.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f3ba6ffd640 1 -- 172.21.15.42:0/1376614752 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3bac0abca0 con 0x7f3ba00039b0 2024-09-16T01:54:43.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7fd5c6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c80720b0 0x7fd5c81f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7fd5c6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c80720b0 0x7fd5c81f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51120/0 (socket says 172.21.15.42:51120) 2024-09-16T01:54:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f5d531d6640 1 -- 172.21.15.42:0/2666493150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d4c0725f0 msgr2=0x7f5d4c15e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7f5d531d6640 1 --2- 172.21.15.42:0/2666493150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d4c0725f0 0x7f5d4c15e1f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c06c5e0 tx=0x7f5d3c02c7e0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7fd5cda37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c815a2c0 0x7fd5c81f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f3ba6ffd640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] conn(0x7f3b98075b00 0x7f3b98077f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f847b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f847c140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7fd5c6ffd640 1 -- 172.21.15.42:0/920381541 learned_addr learned my addr 172.21.15.42:0/920381541 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7fd5c67fc640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c815a2c0 0x7fd5c81f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f3bb5d9b640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3b9806c380 0x7f3b9806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f847b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f847c140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45450/0 (socket says 172.21.15.42:45450) 2024-09-16T01:54:43.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f847b7fe640 1 -- 172.21.15.42:0/745674968 learned_addr learned my addr 172.21.15.42:0/745674968 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f3ba6ffd640 1 -- 172.21.15.42:0/1376614752 --> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b98078610 con 0x7f3b98075b00 2024-09-16T01:54:43.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f847affd640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f847c141ab0 0x7f847c0a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f3ba6ffd640 1 -- 172.21.15.42:0/1376614752 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3bac0ac090 con 0x7f3ba00039b0 2024-09-16T01:54:43.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7fd5cda37640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5c815ea90 0x7fd5c814e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f030a7fc640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f806c2b0 0x7f02f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f3bb6d9d640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] conn(0x7f3b98075b00 0x7f3b98077f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f030a7fc640 1 -- 172.21.15.42:0/2359601515 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f03040abfa0 con 0x7f0300003b40 2024-09-16T01:54:43.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f847affd640 1 -- 172.21.15.42:0/745674968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 msgr2=0x7f847c140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f847affd640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f847c147920 0x7f847c140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f847affd640 1 -- 172.21.15.42:0/745674968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f847c0aa3e0 msgr2=0x7f847c13f200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T01:54:43.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f847affd640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f847c0aa3e0 0x7f847c13f200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f847affd640 1 -- 172.21.15.42:0/745674968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847c140a10 con 0x7f847c141ab0 2024-09-16T01:54:43.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7fd5c77fe640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5c815ea90 0x7fd5c814e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c80cfbc0 con 0x7fd5c815a2c0 2024-09-16T01:54:43.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f5d531d6640 1 -- 172.21.15.42:0/2666493150 shutdown_connections 2024-09-16T01:54:43.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f5d531d6640 1 --2- 172.21.15.42:0/2666493150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d4c0725f0 0x7f5d4c15e1f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f5d531d6640 1 --2- 172.21.15.42:0/2666493150 >> v2:172.21.15.107:3300/0 conn(0x7f5d4c154a00 0x7f5d4c0720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f5d531d6640 1 -- 172.21.15.42:0/2666493150 >> 172.21.15.42:0/2666493150 conn(0x7f5d4c067d70 msgr2=0x7f5d4c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c80cf1f0 con 0x7fd5c80720b0 2024-09-16T01:54:43.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c815a6a0 con 0x7fd5c815ea90 2024-09-16T01:54:43.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f030a7fc640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x7f02f8075a30 0x7f02f8077e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7f031a72e640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x7f02f8075a30 0x7f02f8077e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7f5d531d6640 1 -- 172.21.15.42:0/2666493150 shutdown_connections 2024-09-16T01:54:43.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7f030a7fc640 1 -- 172.21.15.42:0/2359601515 --> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f030404be50 con 0x7f02f8075a30 2024-09-16T01:54:43.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7eff1affd640 1 -- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d0c70 msgr2=0x7eff1c152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7eff1affd640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7eff1c0d0c70 0x7eff1c152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7eff1affd640 1 -- 172.21.15.42:0/2086300455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff1c13e070 msgr2=0x7eff1c153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7eff1affd640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff1c13e070 0x7eff1c153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.474+0000 7eff1affd640 1 -- 172.21.15.42:0/2086300455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c156330 con 0x7eff1c073430 2024-09-16T01:54:43.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7eff1affd640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c073430 0x7eff1c155d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c410 tx=0x7eff0c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7eff037fe640 1 -- 172.21.15.42:0/2086300455 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c017070 con 0x7eff1c073430 2024-09-16T01:54:43.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7eff037fe640 1 -- 172.21.15.42:0/2086300455 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0c0035f0 con 0x7eff1c073430 2024-09-16T01:54:43.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7eff037fe640 1 -- 172.21.15.42:0/2086300455 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0039e0 con 0x7eff1c073430 2024-09-16T01:54:43.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7f3bb5d9b640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3b9806c380 0x7f3b9806e840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8145e80 tx=0x7f3bb0009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7f030a7fc640 1 -- 172.21.15.42:0/2359601515 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f03040ac390 con 0x7f0300003b40 2024-09-16T01:54:43.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7f031a72e640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x7f02f8075a30 0x7f02f8077e70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.475+0000 7f38127fc640 1 -- 172.21.15.42:0/2273849873 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814036070 con 0x7f381c0720b0 2024-09-16T01:54:43.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fd5c6ffd640 1 -- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5c815ea90 msgr2=0x7fd5c814e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fd5c6ffd640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd5c815ea90 0x7fd5c814e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fd5c6ffd640 1 -- 172.21.15.42:0/920381541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c815a2c0 msgr2=0x7fd5c81f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fd5c6ffd640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5c815a2c0 0x7fd5c81f0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fd5c6ffd640 1 -- 172.21.15.42:0/920381541 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c81f1090 con 0x7fd5c80720b0 2024-09-16T01:54:43.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7f031972c640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f806c2b0 0x7f02f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fc895d9b640 1 -- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc898147e90 msgr2=0x7fc8980abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fc895d9b640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc898147e90 0x7fc8980abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fc895d9b640 1 -- 172.21.15.42:0/2812001528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8980727c0 msgr2=0x7fc8981f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fc895d9b640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8980727c0 0x7fc8981f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fc895d9b640 1 -- 172.21.15.42:0/2812001528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89815fbf0 con 0x7fc898147230 2024-09-16T01:54:43.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7f3bb6d9d640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] conn(0x7f3b98075b00 0x7f3b98077f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7fd5c6ffd640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c80720b0 0x7fd5c81f0a70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c550 tx=0x7fd5b800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7fd5affff640 1 -- 172.21.15.42:0/920381541 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8005ce0 con 0x7fd5c80720b0 2024-09-16T01:54:43.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7f847affd640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f847c141ab0 0x7f847c0a9ea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f846c00f620 tx=0x7f846c00fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f381c15b160 con 0x7f381c0720b0 2024-09-16T01:54:43.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7fd5affff640 1 -- 172.21.15.42:0/920381541 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b8007070 con 0x7fd5c80720b0 2024-09-16T01:54:43.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7f8473fff640 1 -- 172.21.15.42:0/745674968 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c0052e0 con 0x7f847c141ab0 2024-09-16T01:54:43.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7eff1bfff640 1 -- 172.21.15.42:0/2086300455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c156610 con 0x7eff1c073430 2024-09-16T01:54:43.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7eff1bfff640 1 -- 172.21.15.42:0/2086300455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c156bd0 con 0x7eff1c073430 2024-09-16T01:54:43.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c81f1370 con 0x7fd5c80720b0 2024-09-16T01:54:43.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7f030a7fc640 1 -- 172.21.15.42:0/2359601515 <== osd.1 v2:172.21.15.42:6824/2370128537 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f030404be50 con 0x7f02f8075a30 2024-09-16T01:54:43.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7f8480b3d640 1 -- 172.21.15.42:0/745674968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847c140cf0 con 0x7f847c141ab0 2024-09-16T01:54:43.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7f8480b3d640 1 -- 172.21.15.42:0/745674968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f847c1412b0 con 0x7f847c141ab0 2024-09-16T01:54:43.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7fc895d9b640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc898147230 0x7fc8980ab910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c440 tx=0x7fc88c00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.477+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c81f1930 con 0x7fd5c80720b0 2024-09-16T01:54:43.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.478+0000 7fd5affff640 1 -- 172.21.15.42:0/920381541 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8007460 con 0x7fd5c80720b0 2024-09-16T01:54:43.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.478+0000 7f3ba6ffd640 1 -- 172.21.15.42:0/1376614752 <== osd.0 v2:172.21.15.42:6808/4033955434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b98078610 con 0x7f3b98075b00 2024-09-16T01:54:43.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.476+0000 7f5d531d6640 1 -- 172.21.15.42:0/2666493150 wait complete. 2024-09-16T01:54:43.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.478+0000 7f5d531d6640 1 Processor -- start 2024-09-16T01:54:43.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.478+0000 7f38127fc640 1 -- 172.21.15.42:0/2273849873 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3814044070 con 0x7f381c0720b0 2024-09-16T01:54:43.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.478+0000 7f8473fff640 1 -- 172.21.15.42:0/745674968 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846c018070 con 0x7f847c141ab0 2024-09-16T01:54:43.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.478+0000 7f8473fff640 1 -- 172.21.15.42:0/745674968 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c0037f0 con 0x7f847c141ab0 2024-09-16T01:54:43.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.478+0000 7f031972c640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f806c2b0 0x7f02f806e770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f030c0508d0 tx=0x7f0310009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.479+0000 7f38127fc640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f380006c2b0 0x7f380006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.478+0000 7eff1bfff640 1 -- 172.21.15.42:0/2086300455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff1c156fb0 con 0x7eff1c073430 2024-09-16T01:54:43.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.479+0000 7f38127fc640 1 -- 172.21.15.42:0/2273849873 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f38140ac100 con 0x7f381c0720b0 2024-09-16T01:54:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.479+0000 7f8471ffb640 1 -- 172.21.15.42:0/745674968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8460001030 con 0x7f847c141ab0 2024-09-16T01:54:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.479+0000 7f38127fc640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] conn(0x7f38000759b0 0x7f3800077df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.479+0000 7f38127fc640 1 -- 172.21.15.42:0/2273849873 --> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f381402fe50 con 0x7f38000759b0 2024-09-16T01:54:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.479+0000 7f3821e8d640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f380006c2b0 0x7f380006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7f382268e640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] conn(0x7f38000759b0 0x7f3800077df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7f382268e640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] conn(0x7f38000759b0 0x7f3800077df0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7fc886ffd640 1 -- 172.21.15.42:0/2812001528 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c017070 con 0x7fc898147230 2024-09-16T01:54:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7fc89ce01640 1 -- 172.21.15.42:0/2812001528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89815fed0 con 0x7fc898147230 2024-09-16T01:54:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7fc89ce01640 1 -- 172.21.15.42:0/2812001528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc898160490 con 0x7fc898147230 2024-09-16T01:54:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.479+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5c8073580 con 0x7fd5c80720b0 2024-09-16T01:54:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7fd5affff640 1 -- 172.21.15.42:0/920381541 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd5b8007600 con 0x7fd5c80720b0 2024-09-16T01:54:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7fd5affff640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd5b406c380 0x7fd5b406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7eff037fe640 1 -- 172.21.15.42:0/2086300455 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7eff0c003b80 con 0x7eff1c073430 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.478+0000 7f5d531d6640 1 -- start start 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.479+0000 7f5d531d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d4c0725f0 0x7f5d4c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.479+0000 7f5d531d6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d4c154a00 0x7f5d4c1557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.479+0000 7f5d531d6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d4c15e730 0x7f5d4c158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7f5d43fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d4c154a00 0x7f5d4c1557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7f5d43fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d4c154a00 0x7f5d4c1557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51130/0 (socket says 172.21.15.42:51130) 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7f5d43fff640 1 -- 172.21.15.42:0/1385624378 learned_addr learned my addr 172.21.15.42:0/1385624378 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c15b460 con 0x7f5d4c0725f0 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c15b180 con 0x7f5d4c154a00 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7f5d51773640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d4c15e730 0x7f5d4c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.480+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c154de0 con 0x7f5d4c15e730 2024-09-16T01:54:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7fd5affff640 1 -- 172.21.15.42:0/920381541 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd5b808b360 con 0x7fd5c80720b0 2024-09-16T01:54:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7f5d51773640 1 -- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d4c154a00 msgr2=0x7f5d4c1557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7f5d51773640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d4c154a00 0x7f5d4c1557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7eff037fe640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7eff08074ac0 0x7eff08076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7f5d51773640 1 -- 172.21.15.42:0/1385624378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d4c0725f0 msgr2=0x7f5d4c153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7f5d51773640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d4c0725f0 0x7f5d4c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7f5d51773640 1 -- 172.21.15.42:0/1385624378 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c156c80 con 0x7f5d4c15e730 2024-09-16T01:54:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7f5d43fff640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d4c154a00 0x7f5d4c1557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7f5d51773640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d4c15e730 0x7f5d4c158080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400c730 tx=0x7f5d4400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7eff037fe640 1 -- 172.21.15.42:0/2086300455 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7eff0c08aca0 con 0x7eff1c073430 2024-09-16T01:54:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7f8473fff640 1 -- 172.21.15.42:0/745674968 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f846c003990 con 0x7f847c141ab0 2024-09-16T01:54:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7fc886ffd640 1 -- 172.21.15.42:0/2812001528 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc88c005ce0 con 0x7fc898147230 2024-09-16T01:54:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7fd5affff640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x7fd5b4075b00 0x7fd5b4077f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7eff037fe640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] conn(0x7eff0807e240 0x7eff08080680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.481+0000 7eff1a7fc640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7eff08074ac0 0x7eff08076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7fc886ffd640 1 -- 172.21.15.42:0/2812001528 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c0072b0 con 0x7fc898147230 2024-09-16T01:54:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7f38127fc640 1 -- 172.21.15.42:0/2273849873 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38140b3050 con 0x7f381c0720b0 2024-09-16T01:54:43.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7fd5affff640 1 -- 172.21.15.42:0/920381541 --> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5b801ce50 con 0x7fd5b4075b00 2024-09-16T01:54:43.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7fd5affff640 1 -- 172.21.15.42:0/920381541 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5b8092050 con 0x7fd5c80720b0 2024-09-16T01:54:43.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7f38127fc640 1 -- 172.21.15.42:0/2273849873 <== osd.3 v2:172.21.15.42:6816/3057553949 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f381402fe50 con 0x7f38000759b0 2024-09-16T01:54:43.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7eff037fe640 1 -- 172.21.15.42:0/2086300455 --> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff0c016ec0 con 0x7eff0807e240 2024-09-16T01:54:43.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7eff037fe640 1 -- 172.21.15.42:0/2086300455 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7eff0c08b090 con 0x7eff1c073430 2024-09-16T01:54:43.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7f8473fff640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f845c06c330 0x7f845c06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7f5d417fa640 1 -- 172.21.15.42:0/1385624378 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44003b70 con 0x7f5d4c15e730 2024-09-16T01:54:43.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7eff1b7fe640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] conn(0x7eff0807e240 0x7eff08080680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7fd5c67fc640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd5b406c380 0x7fd5b406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7f5d417fa640 1 -- 172.21.15.42:0/1385624378 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d44003d10 con 0x7f5d4c15e730 2024-09-16T01:54:43.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4c156f20 con 0x7f5d4c15e730 2024-09-16T01:54:43.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7fd5c77fe640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x7fd5b4075b00 0x7fd5b4077f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7f847b7fe640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f845c06c330 0x7f845c06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4c1f5c40 con 0x7f5d4c15e730 2024-09-16T01:54:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.483+0000 7eff1a7fc640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7eff08074ac0 0x7eff08076f80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff1c1f3600 tx=0x7eff10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.483+0000 7f5d417fa640 1 -- 172.21.15.42:0/1385624378 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d440052f0 con 0x7f5d4c15e730 2024-09-16T01:54:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.483+0000 7f8473fff640 1 -- 172.21.15.42:0/745674968 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f846c08bd50 con 0x7f847c141ab0 2024-09-16T01:54:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.483+0000 7f847b7fe640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f845c06c330 0x7f845c06e7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f847c0adb90 tx=0x7f8464008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.483+0000 7f8473fff640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] conn(0x7f845c075ab0 0x7f845c077ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.483+0000 7f8473fff640 1 -- 172.21.15.42:0/745674968 --> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f845c0785c0 con 0x7f845c075ab0 2024-09-16T01:54:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.483+0000 7f8473fff640 1 -- 172.21.15.42:0/745674968 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f846c08c230 con 0x7f847c141ab0 2024-09-16T01:54:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.482+0000 7fc884ff9640 1 -- 172.21.15.42:0/2812001528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc87c001030 con 0x7fc898147230 2024-09-16T01:54:43.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.484+0000 7f847bfff640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] conn(0x7f845c075ab0 0x7f845c077ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.484+0000 7f3821e8d640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f380006c2b0 0x7f380006e770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3818001650 tx=0x7f3818009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.484+0000 7eff1b7fe640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] conn(0x7eff0807e240 0x7eff08080680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.484+0000 7fd5c77fe640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x7fd5b4075b00 0x7fd5b4077f40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.484+0000 7fd5c67fc640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd5b406c380 0x7fd5b406e840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc034000 tx=0x7fd5bc02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.484+0000 7fc886ffd640 1 -- 172.21.15.42:0/2812001528 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc88c01a070 con 0x7fc898147230 2024-09-16T01:54:43.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.484+0000 7f847bfff640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] conn(0x7f845c075ab0 0x7f845c077ef0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.484+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5d2c001030 con 0x7f5d4c15e730 2024-09-16T01:54:43.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.485+0000 7eff037fe640 1 -- 172.21.15.42:0/2086300455 <== osd.6 v2:172.21.15.107:6824/986436490 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff0c016ec0 con 0x7eff0807e240 2024-09-16T01:54:43.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.485+0000 7f5d417fa640 1 -- 172.21.15.42:0/1385624378 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5d44005490 con 0x7f5d4c15e730 2024-09-16T01:54:43.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.485+0000 7fc886ffd640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc87806c380 0x7fc87806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.485+0000 7fc886ffd640 1 -- 172.21.15.42:0/2812001528 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc88c08aa50 con 0x7fc898147230 2024-09-16T01:54:43.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.485+0000 7fd5affff640 1 -- 172.21.15.42:0/920381541 <== osd.5 v2:172.21.15.107:6816/188494589 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5b801ce50 con 0x7fd5b4075b00 2024-09-16T01:54:43.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.485+0000 7f5d417fa640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5d3806c380 0x7f5d3806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.485+0000 7fc886ffd640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] conn(0x7fc878075b00 0x7fc878077f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.485+0000 7fc886ffd640 1 -- 172.21.15.42:0/2812001528 --> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc88c01ae50 con 0x7fc878075b00 2024-09-16T01:54:43.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.485+0000 7fc886ffd640 1 -- 172.21.15.42:0/2812001528 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc88c08f2a0 con 0x7fc898147230 2024-09-16T01:54:43.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.485+0000 7f5d50f72640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5d3806c380 0x7f5d3806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.486+0000 7f5d417fa640 1 -- 172.21.15.42:0/1385624378 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5d4408b480 con 0x7f5d4c15e730 2024-09-16T01:54:43.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.486+0000 7f8473fff640 1 -- 172.21.15.42:0/745674968 <== osd.2 v2:172.21.15.42:6800/773751051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f845c0785c0 con 0x7f845c075ab0 2024-09-16T01:54:43.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.486+0000 7fc896d9d640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] conn(0x7fc878075b00 0x7fc878077f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.486+0000 7fc89659c640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc87806c380 0x7fc87806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.486+0000 7f5d417fa640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x7f5d38075b00 0x7f5d38077f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.486+0000 7f5d417fa640 1 -- 172.21.15.42:0/1385624378 --> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d44014e50 con 0x7f5d38075b00 2024-09-16T01:54:43.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.486+0000 7f5d417fa640 1 -- 172.21.15.42:0/1385624378 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5d44092050 con 0x7f5d4c15e730 2024-09-16T01:54:43.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.486+0000 7f5d43fff640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x7f5d38075b00 0x7f5d38077f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.486+0000 7f5d50f72640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5d3806c380 0x7f5d3806e840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800a990 tx=0x7f5d48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.487+0000 7fc89659c640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc87806c380 0x7fc87806e840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc888009b40 tx=0x7fc888009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.487+0000 7fc896d9d640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] conn(0x7fc878075b00 0x7fc878077f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.487+0000 7f5d43fff640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x7f5d38075b00 0x7f5d38077f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.487+0000 7fc886ffd640 1 -- 172.21.15.42:0/2812001528 <== osd.4 v2:172.21.15.107:6808/3395815991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc88c01ae50 con 0x7fc878075b00 2024-09-16T01:54:43.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.488+0000 7f5d417fa640 1 -- 172.21.15.42:0/1385624378 <== osd.7 v2:172.21.15.107:6800/1756026323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5d44014e50 con 0x7f5d38075b00 2024-09-16T01:54:43.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.508+0000 7f3ba4ff9640 1 -- 172.21.15.42:0/1376614752 --> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3bb80b4890 con 0x7f3b98075b00 2024-09-16T01:54:43.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.509+0000 7f3ba6ffd640 1 -- 172.21.15.42:0/1376614752 <== osd.0 v2:172.21.15.42:6808/4033955434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3bb80b4890 con 0x7f3b98075b00 2024-09-16T01:54:43.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.509+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 --> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f030c03bc20 con 0x7f02f8075a30 2024-09-16T01:54:43.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 >> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] conn(0x7f3b98075b00 msgr2=0x7f3b98077f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bbc83c640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] conn(0x7f3b98075b00 0x7f3b98077f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3b9806c380 msgr2=0x7f3b9806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bbc83c640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3b9806c380 0x7f3b9806e840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8145e80 tx=0x7f3bb0009250 comp rx=0 tx=0).stop 2024-09-16T01:54:43.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 msgr2=0x7f3bb8164a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bbc83c640 1 --2- 172.21.15.42:0/1376614752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ba00039b0 0x7f3bb8164a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3bac02ad60 tx=0x7f3bb80b52a0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f030a7fc640 1 -- 172.21.15.42:0/2359601515 <== osd.1 v2:172.21.15.42:6824/2370128537 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f030c03bc20 con 0x7f02f8075a30 2024-09-16T01:54:43.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bb6d9d640 1 -- 172.21.15.42:0/1376614752 reap_dead start 2024-09-16T01:54:43.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 shutdown_connections 2024-09-16T01:54:43.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 >> 172.21.15.42:0/1376614752 conn(0x7f3bb8067b30 msgr2=0x7f3bb8148480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 shutdown_connections 2024-09-16T01:54:43.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f3bbc83c640 1 -- 172.21.15.42:0/1376614752 wait complete. 2024-09-16T01:54:43.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x7f02f8075a30 msgr2=0x7f02f8077e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.510+0000 7f031af2f640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x7f02f8075a30 0x7f02f8077e70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.511+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f806c2b0 msgr2=0x7f02f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.511+0000 7f031af2f640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f806c2b0 0x7f02f806e770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f030c0508d0 tx=0x7f0310009040 comp rx=0 tx=0).stop 2024-09-16T01:54:43.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.511+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0300003b40 msgr2=0x7f030c03c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.511+0000 7f031af2f640 1 --2- 172.21.15.42:0/2359601515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0300003b40 0x7f030c03c240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0304006bb0 tx=0x7f0304004730 comp rx=0 tx=0).stop 2024-09-16T01:54:43.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.511+0000 7f031a72e640 1 -- 172.21.15.42:0/2359601515 reap_dead start 2024-09-16T01:54:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.511+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 shutdown_connections 2024-09-16T01:54:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.511+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 >> 172.21.15.42:0/2359601515 conn(0x7f030c0567b0 msgr2=0x7f030c0526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.511+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 shutdown_connections 2024-09-16T01:54:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.511+0000 7f031af2f640 1 -- 172.21.15.42:0/2359601515 wait complete. 2024-09-16T01:54:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.513+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 --> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f381c073580 con 0x7f38000759b0 2024-09-16T01:54:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.514+0000 7f38127fc640 1 -- 172.21.15.42:0/2273849873 <== osd.3 v2:172.21.15.42:6816/3057553949 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f381c073580 con 0x7f38000759b0 2024-09-16T01:54:43.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.515+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 >> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] conn(0x7f38000759b0 msgr2=0x7f3800077df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.515+0000 7f38240f1640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] conn(0x7f38000759b0 0x7f3800077df0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.515+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f380006c2b0 msgr2=0x7f380006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.515+0000 7f38240f1640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f380006c2b0 0x7f380006e770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3818001650 tx=0x7f3818009040 comp rx=0 tx=0).stop 2024-09-16T01:54:43.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.515+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f381c0720b0 msgr2=0x7f381c15c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.515+0000 7f38240f1640 1 --2- 172.21.15.42:0/2273849873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f381c0720b0 0x7f381c15c7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f381402ad30 tx=0x7f3814004a40 comp rx=0 tx=0).stop 2024-09-16T01:54:43.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.515+0000 7f382268e640 1 -- 172.21.15.42:0/2273849873 reap_dead start 2024-09-16T01:54:43.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.515+0000 7f8471ffb640 1 -- 172.21.15.42:0/745674968 --> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8460002dd0 con 0x7f845c075ab0 2024-09-16T01:54:43.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.516+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 shutdown_connections 2024-09-16T01:54:43.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.516+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 >> 172.21.15.42:0/2273849873 conn(0x7f381c067d70 msgr2=0x7f381c072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.516+0000 7f8473fff640 1 -- 172.21.15.42:0/745674968 <== osd.2 v2:172.21.15.42:6800/773751051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8460002dd0 con 0x7f845c075ab0 2024-09-16T01:54:43.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.517+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 shutdown_connections 2024-09-16T01:54:43.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.517+0000 7f38240f1640 1 -- 172.21.15.42:0/2273849873 wait complete. 2024-09-16T01:54:43.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.517+0000 7f8480b3d640 1 -- 172.21.15.42:0/745674968 >> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] conn(0x7f845c075ab0 msgr2=0x7f845c077ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.517+0000 7f8480b3d640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] conn(0x7f845c075ab0 0x7f845c077ef0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.517+0000 7f8480b3d640 1 -- 172.21.15.42:0/745674968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f845c06c330 msgr2=0x7f845c06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.517+0000 7eff1bfff640 1 -- 172.21.15.42:0/2086300455 --> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff1c072d20 con 0x7eff0807e240 2024-09-16T01:54:43.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.517+0000 7f8480b3d640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f845c06c330 0x7f845c06e7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f847c0adb90 tx=0x7f8464008040 comp rx=0 tx=0).stop 2024-09-16T01:54:43.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7f8480b3d640 1 -- 172.21.15.42:0/745674968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f847c141ab0 msgr2=0x7f847c0a9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 --> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd5c806bf50 con 0x7fd5b4075b00 2024-09-16T01:54:43.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7f8480b3d640 1 --2- 172.21.15.42:0/745674968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f847c141ab0 0x7f847c0a9ea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f846c00f620 tx=0x7f846c00fae0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7eff037fe640 1 -- 172.21.15.42:0/2086300455 <== osd.6 v2:172.21.15.107:6824/986436490 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff1c072d20 con 0x7eff0807e240 2024-09-16T01:54:43.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7f847bfff640 1 -- 172.21.15.42:0/745674968 reap_dead start 2024-09-16T01:54:43.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7f8480b3d640 1 -- 172.21.15.42:0/745674968 shutdown_connections 2024-09-16T01:54:43.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7f8480b3d640 1 -- 172.21.15.42:0/745674968 >> 172.21.15.42:0/745674968 conn(0x7f847c0b1e00 msgr2=0x7f847c06e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7eff017fa640 1 -- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] conn(0x7eff0807e240 msgr2=0x7eff08080680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7eff017fa640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] conn(0x7eff0807e240 0x7eff08080680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7fd5affff640 1 -- 172.21.15.42:0/920381541 <== osd.5 v2:172.21.15.107:6816/188494589 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd5c806bf50 con 0x7fd5b4075b00 2024-09-16T01:54:43.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7eff017fa640 1 -- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7eff08074ac0 msgr2=0x7eff08076f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7eff017fa640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7eff08074ac0 0x7eff08076f80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff1c1f3600 tx=0x7eff10008040 comp rx=0 tx=0).stop 2024-09-16T01:54:43.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7eff017fa640 1 -- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c073430 msgr2=0x7eff1c155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.518+0000 7eff017fa640 1 --2- 172.21.15.42:0/2086300455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff1c073430 0x7eff1c155d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c410 tx=0x7eff0c00c8d0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.519+0000 7eff1b7fe640 1 -- 172.21.15.42:0/2086300455 reap_dead start 2024-09-16T01:54:43.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.519+0000 7eff017fa640 1 -- 172.21.15.42:0/2086300455 shutdown_connections 2024-09-16T01:54:43.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.519+0000 7eff017fa640 1 -- 172.21.15.42:0/2086300455 >> 172.21.15.42:0/2086300455 conn(0x7eff1c0b2f20 msgr2=0x7eff1c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.519+0000 7eff017fa640 1 -- 172.21.15.42:0/2086300455 shutdown_connections 2024-09-16T01:54:43.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.519+0000 7f8480b3d640 1 -- 172.21.15.42:0/745674968 shutdown_connections 2024-09-16T01:54:43.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.519+0000 7f8480b3d640 1 -- 172.21.15.42:0/745674968 wait complete. 2024-09-16T01:54:43.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.519+0000 7eff017fa640 1 -- 172.21.15.42:0/2086300455 wait complete. 2024-09-16T01:54:43.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.519+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x7fd5b4075b00 msgr2=0x7fd5b4077f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.519+0000 7fd5cda37640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x7fd5b4075b00 0x7fd5b4077f40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.519+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd5b406c380 msgr2=0x7fd5b406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.520+0000 7fd5cda37640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd5b406c380 0x7fd5b406e840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc034000 tx=0x7fd5bc02f000 comp rx=0 tx=0).stop 2024-09-16T01:54:43.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.520+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c80720b0 msgr2=0x7fd5c81f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.520+0000 7fd5cda37640 1 --2- 172.21.15.42:0/920381541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5c80720b0 0x7fd5c81f0a70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c550 tx=0x7fd5b800ca10 comp rx=0 tx=0).stop 2024-09-16T01:54:43.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.520+0000 7fd5c77fe640 1 -- 172.21.15.42:0/920381541 reap_dead start 2024-09-16T01:54:43.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.520+0000 7fc884ff9640 1 -- 172.21.15.42:0/2812001528 --> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc87c002dd0 con 0x7fc878075b00 2024-09-16T01:54:43.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.520+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 shutdown_connections 2024-09-16T01:54:43.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.520+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 >> 172.21.15.42:0/920381541 conn(0x7fd5c8067b30 msgr2=0x7fd5c814b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.520+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 --> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5d2c002dd0 con 0x7f5d38075b00 2024-09-16T01:54:43.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.520+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 shutdown_connections 2024-09-16T01:54:43.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.520+0000 7fd5cda37640 1 -- 172.21.15.42:0/920381541 wait complete. 2024-09-16T01:54:43.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.521+0000 7fc886ffd640 1 -- 172.21.15.42:0/2812001528 <== osd.4 v2:172.21.15.107:6808/3395815991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc87c002dd0 con 0x7fc878075b00 2024-09-16T01:54:43.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.521+0000 7f5d417fa640 1 -- 172.21.15.42:0/1385624378 <== osd.7 v2:172.21.15.107:6800/1756026323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5d2c002dd0 con 0x7f5d38075b00 2024-09-16T01:54:43.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.522+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x7f5d38075b00 msgr2=0x7f5d38077f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.522+0000 7f5d531d6640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x7f5d38075b00 0x7f5d38077f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.522+0000 7fc884ff9640 1 -- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] conn(0x7fc878075b00 msgr2=0x7fc878077f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.522+0000 7fc884ff9640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] conn(0x7fc878075b00 0x7fc878077f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.522+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5d3806c380 msgr2=0x7f5d3806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.522+0000 7f5d531d6640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5d3806c380 0x7f5d3806e840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800a990 tx=0x7f5d48008040 comp rx=0 tx=0).stop 2024-09-16T01:54:43.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.522+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d4c15e730 msgr2=0x7f5d4c158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.522+0000 7f5d531d6640 1 --2- 172.21.15.42:0/1385624378 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5d4c15e730 0x7f5d4c158080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400c730 tx=0x7f5d4400cbf0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.522+0000 7f5d51773640 1 -- 172.21.15.42:0/1385624378 reap_dead start 2024-09-16T01:54:43.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 shutdown_connections 2024-09-16T01:54:43.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 >> 172.21.15.42:0/1385624378 conn(0x7f5d4c067d70 msgr2=0x7f5d4c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7fc884ff9640 1 -- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc87806c380 msgr2=0x7fc87806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7fc884ff9640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc87806c380 0x7fc87806e840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc888009b40 tx=0x7fc888009190 comp rx=0 tx=0).stop 2024-09-16T01:54:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7fc884ff9640 1 -- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc898147230 msgr2=0x7fc8980ab910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7fc884ff9640 1 --2- 172.21.15.42:0/2812001528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc898147230 0x7fc8980ab910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c440 tx=0x7fc88c00c900 comp rx=0 tx=0).stop 2024-09-16T01:54:43.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7fc896d9d640 1 -- 172.21.15.42:0/2812001528 reap_dead start 2024-09-16T01:54:43.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 shutdown_connections 2024-09-16T01:54:43.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7f5d531d6640 1 -- 172.21.15.42:0/1385624378 wait complete. 2024-09-16T01:54:43.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7fc884ff9640 1 -- 172.21.15.42:0/2812001528 shutdown_connections 2024-09-16T01:54:43.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7fc884ff9640 1 -- 172.21.15.42:0/2812001528 >> 172.21.15.42:0/2812001528 conn(0x7fc898067d70 msgr2=0x7fc8980b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7fc884ff9640 1 -- 172.21.15.42:0/2812001528 shutdown_connections 2024-09-16T01:54:43.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.523+0000 7fc884ff9640 1 -- 172.21.15.42:0/2812001528 wait complete. 2024-09-16T01:54:43.608 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-09-16T01:54:43.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T01:54:43.609 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-09-16T01:54:43.609 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T01:54:43.610 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-09-16T01:54:43.610 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T01:54:43.611 INFO:teuthology.orchestra.run.smithi042.stdout:55834574858 2024-09-16T01:54:43.611 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T01:54:43.612 INFO:teuthology.orchestra.run.smithi042.stdout:64424509450 2024-09-16T01:54:43.612 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T01:54:43.613 INFO:teuthology.orchestra.run.smithi042.stdout:64424509450 2024-09-16T01:54:43.613 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T01:54:43.614 INFO:teuthology.orchestra.run.smithi042.stdout:64424509450 2024-09-16T01:54:43.614 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T01:54:43.615 INFO:teuthology.orchestra.run.smithi042.stdout:55834574858 2024-09-16T01:54:43.615 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T01:54:43.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.822+0000 7f9ed2af2640 1 Processor -- start 2024-09-16T01:54:43.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.823+0000 7f9ed2af2640 1 -- start start 2024-09-16T01:54:43.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.823+0000 7f1dd7eba640 1 Processor -- start 2024-09-16T01:54:43.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.823+0000 7f704faaf640 1 Processor -- start 2024-09-16T01:54:43.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.823+0000 7f028088d640 1 Processor -- start 2024-09-16T01:54:43.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.824+0000 7f6599ee4640 1 Processor -- start 2024-09-16T01:54:43.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.824+0000 7f704faaf640 1 -- start start 2024-09-16T01:54:43.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.824+0000 7f6599ee4640 1 -- start start 2024-09-16T01:54:43.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.823+0000 7f028088d640 1 -- start start 2024-09-16T01:54:43.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.823+0000 7f1dd7eba640 1 -- start start 2024-09-16T01:54:43.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f9ed2af2640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9ecc15b300 0x7f9ecc0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f028088d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f02740e0a80 0x7f02740358d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f704faaf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f704815b340 0x7f704809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f1dd7eba640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1dd0166170 0x7f1dd00cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f1dd7eba640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd00b5f40 con 0x7f1dd00b0520 2024-09-16T01:54:43.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f1dd7eba640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd006c8e0 con 0x7f1dd00ae140 2024-09-16T01:54:43.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f1dd7eba640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1dd009ae10 con 0x7f1dd0166170 2024-09-16T01:54:43.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f027a59c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f02740e0a80 0x7f02740358d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f9ed2af2640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ecc0b02a0 con 0x7f9ecc0b4600 2024-09-16T01:54:43.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f9ed12ef640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9ecc09ab10 0x7f9ecc0b13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:51048/0 (socket says 172.21.15.42:51048) 2024-09-16T01:54:43.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f027a59c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f02740e0a80 0x7f02740358d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53352/0 (socket says 172.21.15.42:53352) 2024-09-16T01:54:43.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f704d84b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f704815b340 0x7f704809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f704d84b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f704815b340 0x7f704809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51158/0 (socket says 172.21.15.42:51158) 2024-09-16T01:54:43.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f704d84b640 1 -- 172.21.15.42:0/1239656280 learned_addr learned my addr 172.21.15.42:0/1239656280 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f027a59c640 1 -- 172.21.15.42:0/2327204588 learned_addr learned my addr 172.21.15.42:0/2327204588 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f6599ee4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f659409ca20 0x7f6594166c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f6599ee4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f65940d3150 0x7f65940b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f6599ee4640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65940cf700 con 0x7f659409ce00 2024-09-16T01:54:43.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f6599ee4640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f65940d0310 con 0x7f65940d3150 2024-09-16T01:54:43.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f6599ee4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f65940cf9e0 con 0x7f659409ca20 2024-09-16T01:54:43.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f6593fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f65940d3150 0x7f65940b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f6593fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f65940d3150 0x7f65940b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51140/0 (socket says 172.21.15.42:51140) 2024-09-16T01:54:43.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f6593fff640 1 -- 172.21.15.42:0/4161844433 learned_addr learned my addr 172.21.15.42:0/4161844433 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f028088d640 1 --2- 172.21.15.42:0/2327204588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f027400bdd0 0x7f0274056ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f028088d640 1 -- 172.21.15.42:0/2327204588 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0274051640 con 0x7f0274054b10 2024-09-16T01:54:43.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.825+0000 7f9ed12ef640 1 -- 172.21.15.42:0/3094080257 learned_addr learned my addr 172.21.15.42:0/3094080257 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:43.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f704faaf640 1 --2- 172.21.15.42:0/1239656280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70480b5050 0x7f704815b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f1dd6457640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1dd00ae140 0x7f1dd00b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:51042/0 (socket says 172.21.15.42:51042) 2024-09-16T01:54:43.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f028088d640 1 -- 172.21.15.42:0/2327204588 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f02740556b0 con 0x7f02740e0a80 2024-09-16T01:54:43.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f028088d640 1 -- 172.21.15.42:0/2327204588 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0274054550 con 0x7f027400bdd0 2024-09-16T01:54:43.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f704faaf640 1 -- 172.21.15.42:0/1239656280 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70480b3830 con 0x7f70480b43f0 2024-09-16T01:54:43.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f9ed2af2640 1 -- 172.21.15.42:0/3094080257 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ecc0b08e0 con 0x7f9ecc09ab10 2024-09-16T01:54:43.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f9ed2af2640 1 -- 172.21.15.42:0/3094080257 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f9ecc0b4a70 con 0x7f9ecc15b300 2024-09-16T01:54:43.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f704e04c640 1 --2- 172.21.15.42:0/1239656280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70480b5050 0x7f704815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f704faaf640 1 -- 172.21.15.42:0/1239656280 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f70480b5bd0 con 0x7f704815b340 2024-09-16T01:54:43.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f704faaf640 1 -- 172.21.15.42:0/1239656280 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f70480b5610 con 0x7f70480b5050 2024-09-16T01:54:43.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f65937fe640 1 --2- 172.21.15.42:0/4161844433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f659409ca20 0x7f6594166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f6593fff640 1 -- 172.21.15.42:0/4161844433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f659409ca20 msgr2=0x7f6594166c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f6593fff640 1 --2- 172.21.15.42:0/4161844433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f659409ca20 0x7f6594166c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f6593fff640 1 -- 172.21.15.42:0/4161844433 >> v1:172.21.15.107:6789/0 conn(0x7f659409ce00 legacy=0x7f6594167160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f6593fff640 1 -- 172.21.15.42:0/4161844433 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65940cfcc0 con 0x7f65940d3150 2024-09-16T01:54:43.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f9ed1af0640 1 --2- 172.21.15.42:0/3094080257 >> v2:172.21.15.42:3300/0 conn(0x7f9ecc15b300 0x7f9ecc0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816787077 0 0) 0x7f9ecc0b08e0 con 0x7f9ecc09ab10 2024-09-16T01:54:43.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f1dd6457640 1 -- 172.21.15.42:0/3584362095 learned_addr learned my addr 172.21.15.42:0/3584362095 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:43.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9eb8003520 con 0x7f9ecc09ab10 2024-09-16T01:54:43.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7fe98127b640 1 Processor -- start 2024-09-16T01:54:43.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7fe98127b640 1 -- start start 2024-09-16T01:54:43.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.826+0000 7f1dd5c56640 1 --2- 172.21.15.42:0/3584362095 >> v2:172.21.15.107:3300/0 conn(0x7f1dd0166170 0x7f1dd00cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f1985eb1640 1 Processor -- start 2024-09-16T01:54:43.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7fdf86a77640 1 Processor -- start 2024-09-16T01:54:43.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f1dd4c54640 1 -- 172.21.15.42:0/3584362095 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 703237484 0 0) 0x7f1dd006c8e0 con 0x7f1dd00ae140 2024-09-16T01:54:43.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f1985eb1640 1 -- start start 2024-09-16T01:54:43.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f1dd4c54640 1 -- 172.21.15.42:0/3584362095 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dbc003520 con 0x7f1dd00ae140 2024-09-16T01:54:43.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3915278387 0 0) 0x7f9eb8003520 con 0x7f9ecc09ab10 2024-09-16T01:54:43.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 >> v2:172.21.15.42:3300/0 conn(0x7f9ecc15b300 msgr2=0x7f9ecc0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 --2- 172.21.15.42:0/3094080257 >> v2:172.21.15.42:3300/0 conn(0x7f9ecc15b300 0x7f9ecc0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 >> v1:172.21.15.42:6789/0 conn(0x7f9ecc0b4600 legacy=0x7f9ecc0af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc0b0bc0 con 0x7f9ecc09ab10 2024-09-16T01:54:43.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f9ec0001670 con 0x7f9ecc09ab10 2024-09-16T01:54:43.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 >> v1:172.21.15.107:6789/0 conn(0x7f9ecc09ab10 legacy=0x7f9ecc0b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9eb8003a00 0x7f9eb8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9eb8004800 0x7f9eb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb80099b0 0x7f9eb8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc0b4a70 con 0x7f9eb8003a00 2024-09-16T01:54:43.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb80148c0 con 0x7f9eb80099b0 2024-09-16T01:54:43.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb8014ac0 con 0x7f9eb8004800 2024-09-16T01:54:43.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed12ef640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9eb8004800 0x7f9eb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7fdf86a77640 1 -- start start 2024-09-16T01:54:43.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f0279d9b640 1 --2- 172.21.15.42:0/2327204588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f027400bdd0 0x7f0274056ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f027a59c640 1 -- 172.21.15.42:0/2327204588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f027400bdd0 msgr2=0x7f0274056ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f1dd4c54640 1 -- 172.21.15.42:0/3584362095 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 470991264 0 0) 0x7f1dbc003520 con 0x7f1dd00ae140 2024-09-16T01:54:43.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f1dd5c56640 1 -- 172.21.15.42:0/3584362095 >> v1:172.21.15.107:6789/0 conn(0x7f1dd00ae140 legacy=0x7f1dd00b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f1dd5c56640 1 -- 172.21.15.42:0/3584362095 >> v1:172.21.15.42:6789/0 conn(0x7f1dd00b0520 legacy=0x7f1dd006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f1dd5c56640 1 -- 172.21.15.42:0/3584362095 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd00b61c0 con 0x7f1dd0166170 2024-09-16T01:54:43.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7fe98127b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe97c0b3cb0 0x7fe97c06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed12ef640 1 -- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb80099b0 msgr2=0x7f9eb8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f9ed22f1640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb80099b0 0x7f9eb8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f9ed12ef640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb80099b0 0x7f9eb8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f9ed12ef640 1 -- 172.21.15.42:0/3094080257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9eb8003a00 msgr2=0x7f9eb8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f65937fe640 1 --2- 172.21.15.42:0/4161844433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f659409ca20 0x7f6594166c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:43.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f6593fff640 1 --2- 172.21.15.42:0/4161844433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65940d3150 0x7f65940b1c30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f658c009e50 tx=0x7f658c02a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5d1ea89b9b5d5b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f9ed12ef640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9eb8003a00 0x7f9eb8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f9ed12ef640 1 -- 172.21.15.42:0/3094080257 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb8003520 con 0x7f9eb8004800 2024-09-16T01:54:43.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f1985eb1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1978036730 0x7f197804ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f704d84b640 1 -- 172.21.15.42:0/1239656280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70480b5050 msgr2=0x7f704815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f704d84b640 1 --2- 172.21.15.42:0/1239656280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70480b5050 0x7f704815b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f704d84b640 1 -- 172.21.15.42:0/1239656280 >> v1:172.21.15.42:6789/0 conn(0x7f70480b43f0 legacy=0x7f70480b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f704c849640 1 -- 172.21.15.42:0/1239656280 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524339046 0 0) 0x7f70480b3830 con 0x7f70480b43f0 2024-09-16T01:54:43.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.827+0000 7f704d84b640 1 -- 172.21.15.42:0/1239656280 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70480b58f0 con 0x7f704815b340 2024-09-16T01:54:43.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7fe98127b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe97c06e5b0 con 0x7fe97c162730 2024-09-16T01:54:43.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7fe98127b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe97c073b10 con 0x7fe97c06e1a0 2024-09-16T01:54:43.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f1985eb1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f19780551b0 0x7f197804f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7fe98127b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe97c0b3820 con 0x7fe97c0b3cb0 2024-09-16T01:54:43.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7fe97a7fc640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe97c0b3cb0 0x7fe97c06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f197ffff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1978036730 0x7f197804ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f197ffff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1978036730 0x7f197804ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45494/0 (socket says 172.21.15.42:45494) 2024-09-16T01:54:43.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7fe97a7fc640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe97c0b3cb0 0x7fe97c06dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53368/0 (socket says 172.21.15.42:53368) 2024-09-16T01:54:43.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f197ffff640 1 -- 172.21.15.42:0/3526662802 learned_addr learned my addr 172.21.15.42:0/3526662802 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f19856b0640 1 --2- 172.21.15.42:0/3526662802 >> v2:172.21.15.107:3300/0 conn(0x7f19780551b0 0x7f197804f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f9ed22f1640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb80099b0 0x7f9eb8005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:43.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7fe97a7fc640 1 -- 172.21.15.42:0/414880906 learned_addr learned my addr 172.21.15.42:0/414880906 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f1985eb1640 1 -- 172.21.15.42:0/3526662802 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1978039630 con 0x7f197800a4f0 2024-09-16T01:54:43.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f704d84b640 1 --2- 172.21.15.42:0/1239656280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f704815b340 0x7f704809aa30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7044009870 tx=0x7f704402a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ecc7c76eacf3d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f9ed22f1640 1 -- 172.21.15.42:0/3094080257 reap_dead start 2024-09-16T01:54:43.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fdf86a77640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdf80067f40 0x7fdf800cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fdf86a77640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf800720b0 0x7fdf80072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fdf86a77640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf800ce8c0 con 0x7fdf8015ea90 2024-09-16T01:54:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fdf86a77640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdf800ce3f0 con 0x7fdf80067f40 2024-09-16T01:54:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fdf86a77640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdf80072a40 con 0x7fdf800720b0 2024-09-16T01:54:43.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f1985eb1640 1 -- 172.21.15.42:0/3526662802 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1978050250 con 0x7f19780551b0 2024-09-16T01:54:43.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f1985eb1640 1 -- 172.21.15.42:0/3526662802 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1978039910 con 0x7f1978036730 2024-09-16T01:54:43.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f65927fc640 1 -- 172.21.15.42:0/4161844433 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c036070 con 0x7f65940d3150 2024-09-16T01:54:43.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fe97a7fc640 1 -- 172.21.15.42:0/414880906 >> v1:172.21.15.107:6789/0 conn(0x7fe97c06e1a0 legacy=0x7fe97c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fe97a7fc640 1 -- 172.21.15.42:0/414880906 >> v1:172.21.15.42:6789/0 conn(0x7fe97c162730 legacy=0x7fe97c072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fe97a7fc640 1 -- 172.21.15.42:0/414880906 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c073560 con 0x7fe97c0b3cb0 2024-09-16T01:54:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f65927fc640 1 -- 172.21.15.42:0/4161844433 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658c031600 con 0x7f65940d3150 2024-09-16T01:54:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f65927fc640 1 -- 172.21.15.42:0/4161844433 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c0319d0 con 0x7f65940d3150 2024-09-16T01:54:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f027a59c640 1 --2- 172.21.15.42:0/2327204588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f027400bdd0 0x7f0274056ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f027a59c640 1 -- 172.21.15.42:0/2327204588 >> v1:172.21.15.42:6789/0 conn(0x7f0274054b10 legacy=0x7f0274054fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.828+0000 7f027a59c640 1 -- 172.21.15.42:0/2327204588 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0274054830 con 0x7f02740e0a80 2024-09-16T01:54:43.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f704c849640 1 -- 172.21.15.42:0/1239656280 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7044037070 con 0x7f704815b340 2024-09-16T01:54:43.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fdf84813640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdf80067f40 0x7fdf800cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f19856b0640 1 -- 172.21.15.42:0/3526662802 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1978036730 msgr2=0x7f197804ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f9ed12ef640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9eb8004800 0x7f9eb8004c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000c190 tx=0x7f9eb8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efd8c47a41374312 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fdf84813640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdf80067f40 0x7fdf800cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51186/0 (socket says 172.21.15.42:51186) 2024-09-16T01:54:43.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7fdf84813640 1 -- 172.21.15.42:0/654743369 learned_addr learned my addr 172.21.15.42:0/654743369 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f704c849640 1 -- 172.21.15.42:0/1239656280 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7044032440 con 0x7f704815b340 2024-09-16T01:54:43.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f19856b0640 1 --2- 172.21.15.42:0/3526662802 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1978036730 0x7f197804ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f19856b0640 1 -- 172.21.15.42:0/3526662802 >> v1:172.21.15.42:6789/0 conn(0x7f197800a4f0 legacy=0x7f1978036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f19856b0640 1 -- 172.21.15.42:0/3526662802 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1978039bf0 con 0x7f19780551b0 2024-09-16T01:54:43.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f1dd5c56640 1 --2- 172.21.15.42:0/3584362095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd0166170 0x7f1dd00cd670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009720 tx=0x7f1dc002a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eca32d51e76b5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f704c849640 1 -- 172.21.15.42:0/1239656280 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7044032850 con 0x7f704815b340 2024-09-16T01:54:43.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f1dd4c54640 1 -- 172.21.15.42:0/3584362095 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0037070 con 0x7f1dd0166170 2024-09-16T01:54:43.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f1dd4c54640 1 -- 172.21.15.42:0/3584362095 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc002abe0 con 0x7f1dd0166170 2024-09-16T01:54:43.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f1dd4c54640 1 -- 172.21.15.42:0/3584362095 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80019f0 con 0x7f1dd0166170 2024-09-16T01:54:43.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0007c60 con 0x7f9eb8004800 2024-09-16T01:54:43.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec0005ad0 con 0x7f9eb8004800 2024-09-16T01:54:43.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7fdf84813640 1 -- 172.21.15.42:0/654743369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf800720b0 msgr2=0x7fdf80072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7fdf85014640 1 --2- 172.21.15.42:0/654743369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf800720b0 0x7fdf80072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7fdf84813640 1 --2- 172.21.15.42:0/654743369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf800720b0 0x7fdf80072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7fdf84813640 1 -- 172.21.15.42:0/654743369 >> v1:172.21.15.42:6789/0 conn(0x7fdf8015ea90 legacy=0x7fdf800cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:43.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f9ed0aee640 1 -- 172.21.15.42:0/3094080257 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0007070 con 0x7f9eb8004800 2024-09-16T01:54:43.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.829+0000 7f0279d9b640 1 --2- 172.21.15.42:0/2327204588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f027400bdd0 0x7f0274056ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:43.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f027a59c640 1 --2- 172.21.15.42:0/2327204588 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 0x7f02740358d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f027c076320 tx=0x7f026c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600740b17834f0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f027959a640 1 -- 172.21.15.42:0/2327204588 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c037070 con 0x7f02740e0a80 2024-09-16T01:54:43.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f027959a640 1 -- 172.21.15.42:0/2327204588 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c02add0 con 0x7f02740e0a80 2024-09-16T01:54:43.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f027959a640 1 -- 172.21.15.42:0/2327204588 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c032680 con 0x7f02740e0a80 2024-09-16T01:54:43.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f6599ee4640 1 -- 172.21.15.42:0/4161844433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65940d3150 msgr2=0x7f65940b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f6599ee4640 1 --2- 172.21.15.42:0/4161844433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65940d3150 0x7f65940b1c30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f658c009e50 tx=0x7f658c02a6d0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f6599ee4640 1 -- 172.21.15.42:0/4161844433 shutdown_connections 2024-09-16T01:54:43.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f6599ee4640 1 --2- 172.21.15.42:0/4161844433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65940d3150 0x7f65940b1c30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f6599ee4640 1 --2- 172.21.15.42:0/4161844433 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f659409ca20 0x7f6594166c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f6599ee4640 1 -- 172.21.15.42:0/4161844433 >> 172.21.15.42:0/4161844433 conn(0x7f65940d11f0 msgr2=0x7f65940d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7fdf84813640 1 -- 172.21.15.42:0/654743369 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf800ceba0 con 0x7fdf80067f40 2024-09-16T01:54:43.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7fdf85014640 1 --2- 172.21.15.42:0/654743369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf800720b0 0x7fdf80072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:43.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f19856b0640 1 --2- 172.21.15.42:0/3526662802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19780551b0 0x7f197804f480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f196c00d7b0 tx=0x7f196c02c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeb2bbf175d9a8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f704faaf640 1 -- 172.21.15.42:0/1239656280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f704815b340 msgr2=0x7f704809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f704faaf640 1 --2- 172.21.15.42:0/1239656280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f704815b340 0x7f704809aa30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7044009870 tx=0x7f704402a1f0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f704faaf640 1 -- 172.21.15.42:0/1239656280 shutdown_connections 2024-09-16T01:54:43.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f704faaf640 1 --2- 172.21.15.42:0/1239656280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70480b5050 0x7f704815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f704faaf640 1 --2- 172.21.15.42:0/1239656280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f704815b340 0x7f704809aa30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.830+0000 7f704faaf640 1 -- 172.21.15.42:0/1239656280 >> 172.21.15.42:0/1239656280 conn(0x7f7048073490 msgr2=0x7f70480b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f6599ee4640 1 -- 172.21.15.42:0/4161844433 shutdown_connections 2024-09-16T01:54:43.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f6599ee4640 1 -- 172.21.15.42:0/4161844433 wait complete. 2024-09-16T01:54:43.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f704faaf640 1 -- 172.21.15.42:0/1239656280 shutdown_connections 2024-09-16T01:54:43.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f704faaf640 1 -- 172.21.15.42:0/1239656280 wait complete. 2024-09-16T01:54:43.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f9ed2af2640 1 -- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9eb8004800 msgr2=0x7f9eb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7fe97a7fc640 1 --2- 172.21.15.42:0/414880906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c0b3cb0 0x7fe97c06dc60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe970009870 tx=0x7fe97002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa195cd5a5d8d1e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f9ed2af2640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9eb8004800 0x7f9eb8004c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000c190 tx=0x7f9eb8005830 comp rx=0 tx=0).stop 2024-09-16T01:54:43.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f197f7fe640 1 -- 172.21.15.42:0/3526662802 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c038070 con 0x7f19780551b0 2024-09-16T01:54:43.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f197f7fe640 1 -- 172.21.15.42:0/3526662802 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c031710 con 0x7f19780551b0 2024-09-16T01:54:43.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f197f7fe640 1 -- 172.21.15.42:0/3526662802 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c031ae0 con 0x7f19780551b0 2024-09-16T01:54:43.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f1dd7eba640 1 -- 172.21.15.42:0/3584362095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd0166170 msgr2=0x7f1dd00cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f1dd7eba640 1 --2- 172.21.15.42:0/3584362095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd0166170 0x7f1dd00cd670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009720 tx=0x7f1dc002a0d0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7fdf84813640 1 --2- 172.21.15.42:0/654743369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf80067f40 0x7fdf800cc9e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009e50 tx=0x7fdf7002a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73b1225515c72a7c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7fe979ffb640 1 -- 172.21.15.42:0/414880906 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970037070 con 0x7fe97c0b3cb0 2024-09-16T01:54:43.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7fe979ffb640 1 -- 172.21.15.42:0/414880906 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe970032440 con 0x7fe97c0b3cb0 2024-09-16T01:54:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7fe979ffb640 1 -- 172.21.15.42:0/414880906 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970032810 con 0x7fe97c0b3cb0 2024-09-16T01:54:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f028088d640 1 -- 172.21.15.42:0/2327204588 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 msgr2=0x7f02740358d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f028088d640 1 --2- 172.21.15.42:0/2327204588 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 0x7f02740358d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f027c076320 tx=0x7f026c02a140 comp rx=0 tx=0).stop 2024-09-16T01:54:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f9ed2af2640 1 -- 172.21.15.42:0/3094080257 shutdown_connections 2024-09-16T01:54:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f9ed2af2640 1 --2- 172.21.15.42:0/3094080257 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9eb8004800 0x7f9eb8004c80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f9ed2af2640 1 -- 172.21.15.42:0/3094080257 >> 172.21.15.42:0/3094080257 conn(0x7f9ecc0732d0 msgr2=0x7f9ecc0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f9ed2af2640 1 -- 172.21.15.42:0/3094080257 shutdown_connections 2024-09-16T01:54:43.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f9ed2af2640 1 -- 172.21.15.42:0/3094080257 wait complete. 2024-09-16T01:54:43.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f028088d640 1 -- 172.21.15.42:0/2327204588 shutdown_connections 2024-09-16T01:54:43.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f028088d640 1 --2- 172.21.15.42:0/2327204588 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f027400bdd0 0x7f0274056ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f028088d640 1 --2- 172.21.15.42:0/2327204588 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 0x7f02740358d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f028088d640 1 -- 172.21.15.42:0/2327204588 >> 172.21.15.42:0/2327204588 conn(0x7f027401fb70 msgr2=0x7f02740567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f028088d640 1 -- 172.21.15.42:0/2327204588 shutdown_connections 2024-09-16T01:54:43.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7fdf7f7fe640 1 -- 172.21.15.42:0/654743369 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70036070 con 0x7fdf80067f40 2024-09-16T01:54:43.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7fdf7f7fe640 1 -- 172.21.15.42:0/654743369 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf70031600 con 0x7fdf80067f40 2024-09-16T01:54:43.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f028088d640 1 -- 172.21.15.42:0/2327204588 wait complete. 2024-09-16T01:54:43.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f1985eb1640 1 -- 172.21.15.42:0/3526662802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19780551b0 msgr2=0x7f197804f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f1985eb1640 1 --2- 172.21.15.42:0/3526662802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19780551b0 0x7f197804f480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f196c00d7b0 tx=0x7f196c02c560 comp rx=0 tx=0).stop 2024-09-16T01:54:43.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7fdf7f7fe640 1 -- 172.21.15.42:0/654743369 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70036070 con 0x7fdf80067f40 2024-09-16T01:54:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7f6599ee4640 1 Processor -- start 2024-09-16T01:54:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f1dd7eba640 1 -- 172.21.15.42:0/3584362095 shutdown_connections 2024-09-16T01:54:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f1dd7eba640 1 --2- 172.21.15.42:0/3584362095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd0166170 0x7f1dd00cd670 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.831+0000 7f1dd7eba640 1 -- 172.21.15.42:0/3584362095 >> 172.21.15.42:0/3584362095 conn(0x7f1dd0073490 msgr2=0x7f1dd00b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7fe98127b640 1 -- 172.21.15.42:0/414880906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c0b3cb0 msgr2=0x7fe97c06dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f1985eb1640 1 -- 172.21.15.42:0/3526662802 shutdown_connections 2024-09-16T01:54:43.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f1985eb1640 1 --2- 172.21.15.42:0/3526662802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19780551b0 0x7f197804f480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f1985eb1640 1 --2- 172.21.15.42:0/3526662802 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1978036730 0x7f197804ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f1985eb1640 1 -- 172.21.15.42:0/3526662802 >> 172.21.15.42:0/3526662802 conn(0x7f197801d930 msgr2=0x7f19780545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.832+0000 7fe98127b640 1 --2- 172.21.15.42:0/414880906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c0b3cb0 0x7fe97c06dc60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe970009870 tx=0x7fe97002a210 comp rx=0 tx=0).stop 2024-09-16T01:54:43.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f6599ee4640 1 -- start start 2024-09-16T01:54:43.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7fe98127b640 1 -- 172.21.15.42:0/414880906 shutdown_connections 2024-09-16T01:54:43.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7fe98127b640 1 --2- 172.21.15.42:0/414880906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c0b3cb0 0x7fe97c06dc60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7fe98127b640 1 -- 172.21.15.42:0/414880906 >> 172.21.15.42:0/414880906 conn(0x7fe97c067950 msgr2=0x7fe97c067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7fdf86a77640 1 -- 172.21.15.42:0/654743369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf80067f40 msgr2=0x7fdf800cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7fdf86a77640 1 --2- 172.21.15.42:0/654743369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf80067f40 0x7fdf800cc9e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009e50 tx=0x7fdf7002a7a0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7fe98127b640 1 -- 172.21.15.42:0/414880906 shutdown_connections 2024-09-16T01:54:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f1985eb1640 1 -- 172.21.15.42:0/3526662802 shutdown_connections 2024-09-16T01:54:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f1985eb1640 1 -- 172.21.15.42:0/3526662802 wait complete. 2024-09-16T01:54:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f704faaf640 1 Processor -- start 2024-09-16T01:54:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f704faaf640 1 -- start start 2024-09-16T01:54:43.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f1dd7eba640 1 -- 172.21.15.42:0/3584362095 shutdown_connections 2024-09-16T01:54:43.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7f1dd7eba640 1 -- 172.21.15.42:0/3584362095 wait complete. 2024-09-16T01:54:43.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7fdf86a77640 1 -- 172.21.15.42:0/654743369 shutdown_connections 2024-09-16T01:54:43.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7fdf86a77640 1 --2- 172.21.15.42:0/654743369 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf800720b0 0x7fdf80072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7fdf86a77640 1 --2- 172.21.15.42:0/654743369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf80067f40 0x7fdf800cc9e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7fdf86a77640 1 -- 172.21.15.42:0/654743369 >> 172.21.15.42:0/654743369 conn(0x7fdf80067b30 msgr2=0x7fdf8006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:43.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7fdf86a77640 1 -- 172.21.15.42:0/654743369 shutdown_connections 2024-09-16T01:54:43.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7f6599ee4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f659409ca20 0x7f659415c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7f028088d640 1 Processor -- start 2024-09-16T01:54:43.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7f028088d640 1 -- start start 2024-09-16T01:54:43.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7f9ed2af2640 1 Processor -- start 2024-09-16T01:54:43.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7f9ed2af2640 1 -- start start 2024-09-16T01:54:43.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704faaf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70480b43f0 0x7f704814b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704faaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70480b5050 0x7f70480cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f65937fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f659409ca20 0x7f659415c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f1dd7eba640 1 Processor -- start 2024-09-16T01:54:43.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.833+0000 7fe98127b640 1 -- 172.21.15.42:0/414880906 wait complete. 2024-09-16T01:54:43.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7fe98127b640 1 Processor -- start 2024-09-16T01:54:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704d84b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70480b43f0 0x7f704814b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704d84b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70480b43f0 0x7f704814b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51202/0 (socket says 172.21.15.42:51202) 2024-09-16T01:54:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704d84b640 1 -- 172.21.15.42:0/2849419598 learned_addr learned my addr 172.21.15.42:0/2849419598 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704faaf640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704815b340 0x7f704809e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704faaf640 1 -- 172.21.15.42:0/2849419598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f70480cdb30 con 0x7f70480b5050 2024-09-16T01:54:43.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f65937fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f659409ca20 0x7f659415c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53376/0 (socket says 172.21.15.42:53376) 2024-09-16T01:54:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f1985eb1640 1 Processor -- start 2024-09-16T01:54:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f6599ee4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f659409ce00 0x7f659409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f6599ee4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65940d3150 0x7f65941fbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f6599ee4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6594073470 con 0x7f659409ca20 2024-09-16T01:54:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f6599ee4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f65940732f0 con 0x7f65940d3150 2024-09-16T01:54:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f6599ee4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f65940737d0 con 0x7f659409ce00 2024-09-16T01:54:43.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f65937fe640 1 -- 172.21.15.42:0/3554743669 learned_addr learned my addr 172.21.15.42:0/3554743669 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f1dd7eba640 1 -- start start 2024-09-16T01:54:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7fe98127b640 1 -- start start 2024-09-16T01:54:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704faaf640 1 -- 172.21.15.42:0/2849419598 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f704815d8f0 con 0x7f70480b43f0 2024-09-16T01:54:43.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704faaf640 1 -- 172.21.15.42:0/2849419598 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f70480cdcb0 con 0x7f704815b340 2024-09-16T01:54:43.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704d04a640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70480b5050 0x7f70480cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.835+0000 7f704e04c640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704815b340 0x7f704809e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f028088d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f027400bdd0 0x7f027404c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.834+0000 7fdf86a77640 1 -- 172.21.15.42:0/654743369 wait complete. 2024-09-16T01:54:43.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7fdf86a77640 1 Processor -- start 2024-09-16T01:54:43.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f9ed2af2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb8004800 0x7f9ecc153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7fdf86a77640 1 -- start start 2024-09-16T01:54:43.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f6593fff640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65940d3150 0x7f65941fbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f65937fe640 1 -- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f659409ce00 msgr2=0x7f659409ed00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:54:43.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f65937fe640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f659409ce00 0x7f659409ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f65937fe640 1 -- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65940d3150 msgr2=0x7f65941fbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f65937fe640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65940d3150 0x7f65941fbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f65937fe640 1 -- 172.21.15.42:0/3554743669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65940a1550 con 0x7f659409ca20 2024-09-16T01:54:43.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f6593fff640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65940d3150 0x7f65941fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:43.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f704e04c640 1 -- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70480b43f0 msgr2=0x7f704814b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f704e04c640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70480b43f0 0x7f704814b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f704e04c640 1 -- 172.21.15.42:0/2849419598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70480b5050 msgr2=0x7f70480cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f704e04c640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70480b5050 0x7f70480cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f704e04c640 1 -- 172.21.15.42:0/2849419598 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70480d07c0 con 0x7f704815b340 2024-09-16T01:54:43.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f028088d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0274054b10 0x7f027403bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f1dd7eba640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00ae140 0x7f1dd014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f028088d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 0x7f02740df900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f704e04c640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704815b340 0x7f704809e8a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7040010f60 tx=0x7f7040010f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f028088d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0274051ca0 con 0x7f02740e0a80 2024-09-16T01:54:43.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f1dd7eba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00b0520 0x7f1dd01508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f028088d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0274051b20 con 0x7f027400bdd0 2024-09-16T01:54:43.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f9ed2af2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ecc0cfa90 0x7f9ecc0cff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f703e7fc640 1 -- 172.21.15.42:0/2849419598 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704001a070 con 0x7f704815b340 2024-09-16T01:54:43.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f703e7fc640 1 -- 172.21.15.42:0/2849419598 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f704000b0d0 con 0x7f704815b340 2024-09-16T01:54:43.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f703e7fc640 1 -- 172.21.15.42:0/2849419598 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70400155c0 con 0x7f704815b340 2024-09-16T01:54:43.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f027ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 0x7f02740df900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f027ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 0x7f02740df900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53400/0 (socket says 172.21.15.42:53400) 2024-09-16T01:54:43.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f027ad9d640 1 -- 172.21.15.42:0/2138609440 learned_addr learned my addr 172.21.15.42:0/2138609440 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f9ed1af0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb8004800 0x7f9ecc153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f9ed1af0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb8004800 0x7f9ecc153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51224/0 (socket says 172.21.15.42:51224) 2024-09-16T01:54:43.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f0279d9b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0274054b10 0x7f027403bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0274051e20 con 0x7f0274054b10 2024-09-16T01:54:43.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f9ed1af0640 1 -- 172.21.15.42:0/2049009241 learned_addr learned my addr 172.21.15.42:0/2049009241 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f65937fe640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f659409ca20 0x7f659415c4d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f658800c820 tx=0x7f658800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f1dd5c56640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00ae140 0x7f1dd014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f9ed12ef640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ecc0cfa90 0x7f9ecc0cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f9ed2af2640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ecc0cdbb0 0x7f9ecc0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f1dd5c56640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00ae140 0x7f1dd014e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45534/0 (socket says 172.21.15.42:45534) 2024-09-16T01:54:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f1dd5c56640 1 -- 172.21.15.42:0/2839101081 learned_addr learned my addr 172.21.15.42:0/2839101081 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc0b0580 con 0x7f9ecc0cdbb0 2024-09-16T01:54:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7f1985eb1640 1 -- start start 2024-09-16T01:54:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f1985eb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1978036730 0x7f1978174b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f1985eb1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19780551b0 0x7f19780d7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f1985eb1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f197804ced0 0x7f197804a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f1985eb1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f19780393d0 con 0x7f1978036730 2024-09-16T01:54:43.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc15b6e0 con 0x7f9eb8004800 2024-09-16T01:54:43.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9ecc0b40c0 con 0x7f9ecc0cfa90 2024-09-16T01:54:43.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f1985eb1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1978039250 con 0x7f19780551b0 2024-09-16T01:54:43.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f1985eb1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1978054cb0 con 0x7f197804ced0 2024-09-16T01:54:43.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f704faaf640 1 -- 172.21.15.42:0/2849419598 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70481effe0 con 0x7f704815b340 2024-09-16T01:54:43.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f704faaf640 1 -- 172.21.15.42:0/2849419598 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f704814b6a0 con 0x7f704815b340 2024-09-16T01:54:43.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f9ed22f1640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ecc0cdbb0 0x7f9ecc0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f027ad9d640 1 -- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0274054b10 msgr2=0x7f027403bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f027ad9d640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0274054b10 0x7f027403bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f027ad9d640 1 -- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f027400bdd0 msgr2=0x7f027404c3b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T01:54:43.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f027ad9d640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f027400bdd0 0x7f027404c3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f027ad9d640 1 -- 172.21.15.42:0/2138609440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0274050cf0 con 0x7f02740e0a80 2024-09-16T01:54:43.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7fe98127b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe97c06e1a0 0x7fe97c15a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7fe98127b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe97c0b3cb0 0x7fe97c1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7fe98127b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c162730 0x7fe97c0c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7fe98127b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c0b31d0 con 0x7fe97c162730 2024-09-16T01:54:43.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7fe98127b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c0b4120 con 0x7fe97c0b3cb0 2024-09-16T01:54:43.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.836+0000 7fe98127b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c0b34b0 con 0x7fe97c06e1a0 2024-09-16T01:54:43.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7fe97b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c162730 0x7fe97c0c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f657bfff640 1 -- 172.21.15.42:0/3554743669 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588015070 con 0x7f659409ca20 2024-09-16T01:54:43.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.837+0000 7f6599ee4640 1 -- 172.21.15.42:0/3554743669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65940a1830 con 0x7f659409ca20 2024-09-16T01:54:43.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f6599ee4640 1 -- 172.21.15.42:0/3554743669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65940a1df0 con 0x7f659409ca20 2024-09-16T01:54:43.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f657bfff640 1 -- 172.21.15.42:0/3554743669 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6588007a30 con 0x7f659409ca20 2024-09-16T01:54:43.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f9ed1af0640 1 -- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ecc0cfa90 msgr2=0x7f9ecc0cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f9ed1af0640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ecc0cfa90 0x7f9ecc0cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f9ed1af0640 1 -- 172.21.15.42:0/2049009241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ecc0cdbb0 msgr2=0x7f9ecc0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f9ed1af0640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ecc0cdbb0 0x7f9ecc0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f9ed1af0640 1 -- 172.21.15.42:0/2049009241 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc1f2f20 con 0x7f9eb8004800 2024-09-16T01:54:43.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fdf86a77640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf80067f40 0x7fdf80144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fdf86a77640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf800720b0 0x7fdf8015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fdf86a77640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf8015ea90 0x7fdf80146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fdf86a77640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdf800ccf20 con 0x7fdf800720b0 2024-09-16T01:54:43.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fdf86a77640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdf800cf1f0 con 0x7fdf8015ea90 2024-09-16T01:54:43.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fdf86a77640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8015a050 con 0x7fdf80067f40 2024-09-16T01:54:43.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fdf85014640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf8015ea90 0x7fdf80146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fdf85014640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf8015ea90 0x7fdf80146780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51228/0 (socket says 172.21.15.42:51228) 2024-09-16T01:54:43.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fdf85014640 1 -- 172.21.15.42:0/1524352660 learned_addr learned my addr 172.21.15.42:0/1524352660 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fdf84813640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf80067f40 0x7fdf80144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1dd7eba640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd0166170 0x7f1dd0150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fe97affd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe97c06e1a0 0x7fe97c15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fe97affd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe97c06e1a0 0x7fe97c15a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45566/0 (socket says 172.21.15.42:45566) 2024-09-16T01:54:43.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7fe97affd640 1 -- 172.21.15.42:0/3973380328 learned_addr learned my addr 172.21.15.42:0/3973380328 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fe97affd640 1 -- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe97c0b3cb0 msgr2=0x7fe97c1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fe97affd640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe97c0b3cb0 0x7fe97c1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fe97affd640 1 -- 172.21.15.42:0/3973380328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c162730 msgr2=0x7fe97c0c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fe97affd640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c162730 0x7fe97c0c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fe97affd640 1 -- 172.21.15.42:0/3973380328 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c159ac0 con 0x7fe97c06e1a0 2024-09-16T01:54:43.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fe97affd640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe97c06e1a0 0x7fe97c15a940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe97400ba50 tx=0x7fe97400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd00b6530 con 0x7f1dd0166170 2024-09-16T01:54:43.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fdf84813640 1 -- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf8015ea90 msgr2=0x7fdf80146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fdf84813640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf8015ea90 0x7fdf80146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd0166550 con 0x7f1dd00b0520 2024-09-16T01:54:43.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd006c320 con 0x7f1dd00ae140 2024-09-16T01:54:43.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1dd5455640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00b0520 0x7f1dd01508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fdf84813640 1 -- 172.21.15.42:0/1524352660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf800720b0 msgr2=0x7fdf8015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fdf84813640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf800720b0 0x7fdf8015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f9ed1af0640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb8004800 0x7f9ecc153b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800ecf0 tx=0x7f9ec800d720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f9ebe7fc640 1 -- 172.21.15.42:0/2049009241 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8019680 con 0x7f9eb8004800 2024-09-16T01:54:43.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f9ebe7fc640 1 -- 172.21.15.42:0/2049009241 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec8019840 con 0x7f9eb8004800 2024-09-16T01:54:43.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f657bfff640 1 -- 172.21.15.42:0/3554743669 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588007de0 con 0x7f659409ca20 2024-09-16T01:54:43.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fdf84813640 1 -- 172.21.15.42:0/1524352660 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf80141f60 con 0x7fdf80067f40 2024-09-16T01:54:43.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7fdf84813640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf80067f40 0x7fdf80144f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf800b3270 tx=0x7fdf70004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1dd6457640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd0166170 0x7f1dd0150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f1dd5455640 1 -- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00ae140 msgr2=0x7f1dd014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f1dd5455640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00ae140 0x7f1dd014e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f1dd5455640 1 -- 172.21.15.42:0/2839101081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd0166170 msgr2=0x7f1dd0150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f1dd5455640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd0166170 0x7f1dd0150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f1dd5455640 1 -- 172.21.15.42:0/2839101081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd014e550 con 0x7f1dd00b0520 2024-09-16T01:54:43.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f1dd6457640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd0166170 0x7f1dd0150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:43.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fe9637fe640 1 -- 172.21.15.42:0/3973380328 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974019070 con 0x7fe97c06e1a0 2024-09-16T01:54:43.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fe9637fe640 1 -- 172.21.15.42:0/3973380328 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97400cc20 con 0x7fe97c06e1a0 2024-09-16T01:54:43.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7fe9637fe640 1 -- 172.21.15.42:0/3973380328 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974014680 con 0x7fe97c06e1a0 2024-09-16T01:54:43.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f9ebe7fc640 1 -- 172.21.15.42:0/2049009241 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8019c30 con 0x7f9eb8004800 2024-09-16T01:54:43.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ecc0d0630 con 0x7f9eb8004800 2024-09-16T01:54:43.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.841+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ecc1f34a0 con 0x7f9eb8004800 2024-09-16T01:54:43.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f703e7fc640 1 -- 172.21.15.42:0/2849419598 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7040005d10 con 0x7f704815b340 2024-09-16T01:54:43.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f704faaf640 1 -- 172.21.15.42:0/2849419598 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f704809aa30 con 0x7f704815b340 2024-09-16T01:54:43.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f703e7fc640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f702c06c380 0x7f702c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f703e7fc640 1 -- 172.21.15.42:0/2849419598 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f704008fa20 con 0x7f704815b340 2024-09-16T01:54:43.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f027ad9d640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 0x7f02740df900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f027c0504d0 tx=0x7f027c069740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f026affd640 1 -- 172.21.15.42:0/2138609440 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c093400 con 0x7f02740e0a80 2024-09-16T01:54:43.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f026affd640 1 -- 172.21.15.42:0/2138609440 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027c0935c0 con 0x7f02740e0a80 2024-09-16T01:54:43.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f026affd640 1 -- 172.21.15.42:0/2138609440 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c0939b0 con 0x7f02740e0a80 2024-09-16T01:54:43.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027404b310 con 0x7f02740e0a80 2024-09-16T01:54:43.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027404b8d0 con 0x7f02740e0a80 2024-09-16T01:54:43.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.841+0000 7f9ed22f1640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ecc0cdbb0 0x7f9ecc0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:43.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f19856b0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f197804ced0 0x7f197804a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f19856b0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f197804ced0 0x7f197804a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45558/0 (socket says 172.21.15.42:45558) 2024-09-16T01:54:43.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f19856b0640 1 -- 172.21.15.42:0/3101758464 learned_addr learned my addr 172.21.15.42:0/3101758464 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:43.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.841+0000 7fe98127b640 1 -- 172.21.15.42:0/3973380328 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c159da0 con 0x7fe97c06e1a0 2024-09-16T01:54:43.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.838+0000 7f1984eaf640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1978036730 0x7f1978174b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1984eaf640 1 -- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f197804ced0 msgr2=0x7f197804a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:43.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1984eaf640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f197804ced0 0x7f197804a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.841+0000 7f657bfff640 1 -- 172.21.15.42:0/3554743669 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6588018070 con 0x7f659409ca20 2024-09-16T01:54:43.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1984eaf640 1 -- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19780551b0 msgr2=0x7f19780d7720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T01:54:43.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1984eaf640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19780551b0 0x7f19780d7720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:43.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1984eaf640 1 -- 172.21.15.42:0/3101758464 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197804d440 con 0x7f1978036730 2024-09-16T01:54:43.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f19856b0640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f197804ced0 0x7f197804a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:43.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f1984eaf640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1978036730 0x7f1978174b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f198006a6a0 tx=0x7f1980069740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.839+0000 7f197d7fa640 1 -- 172.21.15.42:0/3101758464 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980099070 con 0x7f1978036730 2024-09-16T01:54:43.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f197d7fa640 1 -- 172.21.15.42:0/3101758464 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1980095850 con 0x7f1978036730 2024-09-16T01:54:43.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f197d7fa640 1 -- 172.21.15.42:0/3101758464 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980095cc0 con 0x7f1978036730 2024-09-16T01:54:43.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.840+0000 7f1985eb1640 1 -- 172.21.15.42:0/3101758464 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197804d720 con 0x7f1978036730 2024-09-16T01:54:43.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.841+0000 7f1985eb1640 1 -- 172.21.15.42:0/3101758464 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197804dce0 con 0x7f1978036730 2024-09-16T01:54:43.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.841+0000 7fe98127b640 1 -- 172.21.15.42:0/3973380328 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c15fbf0 con 0x7fe97c06e1a0 2024-09-16T01:54:43.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.841+0000 7f704d84b640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f702c06c380 0x7f702c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.841+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0274039030 con 0x7f02740e0a80 2024-09-16T01:54:43.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.841+0000 7f6599ee4640 1 -- 172.21.15.42:0/3554743669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6574005290 con 0x7f659409ca20 2024-09-16T01:54:43.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.842+0000 7f657bfff640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f658006c330 0x7f658006e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.842+0000 7f657bfff640 1 -- 172.21.15.42:0/3554743669 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f658808f020 con 0x7f659409ca20 2024-09-16T01:54:43.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.842+0000 7fdf7d7fa640 1 -- 172.21.15.42:0/1524352660 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7003f070 con 0x7fdf80067f40 2024-09-16T01:54:43.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.842+0000 7f1985eb1640 1 -- 172.21.15.42:0/3101758464 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19780e2120 con 0x7f1978036730 2024-09-16T01:54:43.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.843+0000 7f026affd640 1 -- 172.21.15.42:0/2138609440 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f027c093b50 con 0x7f02740e0a80 2024-09-16T01:54:43.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.843+0000 7fdf86a77640 1 -- 172.21.15.42:0/1524352660 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf80142220 con 0x7fdf80067f40 2024-09-16T01:54:43.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.843+0000 7fdf86a77640 1 -- 172.21.15.42:0/1524352660 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf801427e0 con 0x7fdf80067f40 2024-09-16T01:54:43.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.842+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ecc0b61e0 con 0x7f9eb8004800 2024-09-16T01:54:43.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.841+0000 7f1dd5455640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00b0520 0x7f1dd01508c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00c340 tx=0x7f1dcc00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.842+0000 7f1dc67fc640 1 -- 172.21.15.42:0/2839101081 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0052d0 con 0x7f1dd00b0520 2024-09-16T01:54:43.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.842+0000 7f1dc67fc640 1 -- 172.21.15.42:0/2839101081 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc005490 con 0x7f1dd00b0520 2024-09-16T01:54:43.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.842+0000 7f1dc67fc640 1 -- 172.21.15.42:0/2839101081 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc007260 con 0x7f1dd00b0520 2024-09-16T01:54:43.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.843+0000 7f704d84b640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f702c06c380 0x7f702c06e840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7044009870 tx=0x7f704402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.843+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd014f610 con 0x7f1dd00b0520 2024-09-16T01:54:43.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.843+0000 7f6592ffd640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f658006c330 0x7f658006e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.843+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd014fbd0 con 0x7f1dd00b0520 2024-09-16T01:54:43.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.843+0000 7fdf7d7fa640 1 -- 172.21.15.42:0/1524352660 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf70007a30 con 0x7fdf80067f40 2024-09-16T01:54:43.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.843+0000 7f9ebe7fc640 1 -- 172.21.15.42:0/2049009241 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9ec8010440 con 0x7f9eb8004800 2024-09-16T01:54:43.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.843+0000 7f026affd640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f025c06c300 0x7f025c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7f027a59c640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f025c06c300 0x7f025c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7f6592ffd640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f658006c330 0x7f658006e7f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65940cf490 tx=0x7f6584006b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7f026affd640 1 -- 172.21.15.42:0/2138609440 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f027c106ff0 con 0x7f02740e0a80 2024-09-16T01:54:43.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7fdf7d7fa640 1 -- 172.21.15.42:0/1524352660 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70036070 con 0x7fdf80067f40 2024-09-16T01:54:43.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7f027a59c640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f025c06c300 0x7f025c06e7c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f026c034000 tx=0x7f026c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7f9ebe7fc640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9eb006c380 0x7f9eb006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7f9ebe7fc640 1 -- 172.21.15.42:0/2049009241 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9ec808c6e0 con 0x7f9eb8004800 2024-09-16T01:54:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7f9ed12ef640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9eb006c380 0x7f9eb006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7fdf86a77640 1 -- 172.21.15.42:0/1524352660 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf64005290 con 0x7fdf80067f40 2024-09-16T01:54:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7f197d7fa640 1 -- 172.21.15.42:0/3101758464 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1980094030 con 0x7f1978036730 2024-09-16T01:54:43.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.845+0000 7f197d7fa640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f196407d2c0 0x7f196407f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.844+0000 7fe98127b640 1 -- 172.21.15.42:0/3973380328 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97c162b10 con 0x7fe97c06e1a0 2024-09-16T01:54:43.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.845+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dd00cd670 con 0x7f1dd00b0520 2024-09-16T01:54:43.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.845+0000 7f197ffff640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f196407d2c0 0x7f196407f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.845+0000 7f1dc67fc640 1 -- 172.21.15.42:0/2839101081 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1dcc007400 con 0x7f1dd00b0520 2024-09-16T01:54:43.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.845+0000 7f9ed12ef640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9eb006c380 0x7f9eb006e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0032000 tx=0x7f9ec002d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.845+0000 7f197ffff640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f196407d2c0 0x7f196407f780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19780481c0 tx=0x7f1974008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.845+0000 7f1dc67fc640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1db406c330 0x7f1db406e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.846+0000 7f1dc67fc640 1 -- 172.21.15.42:0/2839101081 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1dcc08aa50 con 0x7f1dd00b0520 2024-09-16T01:54:43.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.846+0000 7f1dd5c56640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1db406c330 0x7f1db406e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.846+0000 7f1dd5c56640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1db406c330 0x7f1db406e7f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0070d00 tx=0x7f1dc002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.846+0000 7f703e7fc640 1 -- 172.21.15.42:0/2849419598 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f704005d7e0 con 0x7f704815b340 2024-09-16T01:54:43.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.848+0000 7fdf7d7fa640 1 -- 172.21.15.42:0/1524352660 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdf70042070 con 0x7fdf80067f40 2024-09-16T01:54:43.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.848+0000 7fe9637fe640 1 -- 172.21.15.42:0/3973380328 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe97401c070 con 0x7fe97c06e1a0 2024-09-16T01:54:43.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.848+0000 7fdf7d7fa640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fdf6006c380 0x7fdf6006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.848+0000 7fdf7d7fa640 1 -- 172.21.15.42:0/1524352660 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdf700ac4f0 con 0x7fdf80067f40 2024-09-16T01:54:43.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.848+0000 7fe9637fe640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe96806c300 0x7fe96806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:43.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.849+0000 7fdf7ffff640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fdf6006c380 0x7fdf6006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.849+0000 7fe9637fe640 1 -- 172.21.15.42:0/3973380328 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe97408bb80 con 0x7fe97c06e1a0 2024-09-16T01:54:43.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.849+0000 7fe97a7fc640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe96806c300 0x7fe96806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:43.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.849+0000 7fe97a7fc640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe96806c300 0x7fe96806e7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe970034000 tx=0x7fe97002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.849+0000 7fdf7ffff640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fdf6006c380 0x7fdf6006e840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf68000f60 tx=0x7fdf680079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:43.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.850+0000 7f197d7fa640 1 -- 172.21.15.42:0/3101758464 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f19800d2f40 con 0x7f1978036730 2024-09-16T01:54:43.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.850+0000 7f9ebe7fc640 1 -- 172.21.15.42:0/2049009241 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ec800be20 con 0x7f9eb8004800 2024-09-16T01:54:43.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.850+0000 7f657bfff640 1 -- 172.21.15.42:0/3554743669 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6588058f00 con 0x7f659409ca20 2024-09-16T01:54:43.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.851+0000 7fe9637fe640 1 -- 172.21.15.42:0/3973380328 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe974059ad0 con 0x7fe97c06e1a0 2024-09-16T01:54:43.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.854+0000 7f1dc67fc640 1 -- 172.21.15.42:0/2839101081 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1dd014e550 con 0x7f1dd00b0520 2024-09-16T01:54:43.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.857+0000 7fdf7d7fa640 1 -- 172.21.15.42:0/1524352660 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf70007e20 con 0x7fdf80067f40 2024-09-16T01:54:43.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.860+0000 7f026affd640 1 -- 172.21.15.42:0/2138609440 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0274039030 con 0x7f02740e0a80 2024-09-16T01:54:43.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:43.867+0000 7f197d7fa640 1 -- 172.21.15.42:0/3101758464 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19800a3020 con 0x7f1978036730 2024-09-16T01:54:44.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.252+0000 7f704faaf640 1 -- 172.21.15.42:0/2849419598 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7048070220 con 0x7f704815b340 2024-09-16T01:54:44.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.253+0000 7f703e7fc640 1 -- 172.21.15.42:0/2849419598 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7040061ae0 con 0x7f704815b340 2024-09-16T01:54:44.259 INFO:teuthology.orchestra.run.smithi042.stdout:55834574856 2024-09-16T01:54:44.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.258+0000 7f702bfff640 1 -- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f702c06c380 msgr2=0x7f702c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.258+0000 7f702bfff640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f702c06c380 0x7f702c06e840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7044009870 tx=0x7f704402e000 comp rx=0 tx=0).stop 2024-09-16T01:54:44.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.258+0000 7f702bfff640 1 -- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704815b340 msgr2=0x7f704809e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.258+0000 7f702bfff640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704815b340 0x7f704809e8a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7040010f60 tx=0x7f7040010f90 comp rx=0 tx=0).stop 2024-09-16T01:54:44.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.258+0000 7f702bfff640 1 -- 172.21.15.42:0/2849419598 shutdown_connections 2024-09-16T01:54:44.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.259+0000 7f702bfff640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f702c06c380 0x7f702c06e840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.259+0000 7f702bfff640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f704815b340 0x7f704809e8a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.259+0000 7f702bfff640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70480b5050 0x7f70480cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.259+0000 7f702bfff640 1 --2- 172.21.15.42:0/2849419598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70480b43f0 0x7f704814b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.259+0000 7f702bfff640 1 -- 172.21.15.42:0/2849419598 >> 172.21.15.42:0/2849419598 conn(0x7f7048073490 msgr2=0x7f70481587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:44.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.259+0000 7f702bfff640 1 -- 172.21.15.42:0/2849419598 shutdown_connections 2024-09-16T01:54:44.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.259+0000 7f702bfff640 1 -- 172.21.15.42:0/2849419598 wait complete. 2024-09-16T01:54:44.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.261+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1dd00b2900 con 0x7f1dd00b0520 2024-09-16T01:54:44.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.261+0000 7f1dc67fc640 1 -- 172.21.15.42:0/2839101081 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1dd00b5f40 con 0x7f1dd00b0520 2024-09-16T01:54:44.265 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-09-16T01:54:44.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.262+0000 7f6599ee4640 1 -- 172.21.15.42:0/3554743669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6574005850 con 0x7f659409ca20 2024-09-16T01:54:44.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.263+0000 7f657bfff640 1 -- 172.21.15.42:0/3554743669 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f658805f0d0 con 0x7f659409ca20 2024-09-16T01:54:44.266 INFO:teuthology.orchestra.run.smithi042.stdout:64424509448 2024-09-16T01:54:44.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.264+0000 7fe98127b640 1 -- 172.21.15.42:0/3973380328 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe97c163510 con 0x7fe97c06e1a0 2024-09-16T01:54:44.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.264+0000 7fe9637fe640 1 -- 172.21.15.42:0/3973380328 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe97405ddd0 con 0x7fe97c06e1a0 2024-09-16T01:54:44.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9ecc0af590 con 0x7f9eb8004800 2024-09-16T01:54:44.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1db406c330 msgr2=0x7f1db406e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1db406c330 0x7f1db406e7f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0070d00 tx=0x7f1dc002e000 comp rx=0 tx=0).stop 2024-09-16T01:54:44.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00b0520 msgr2=0x7f1dd01508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00b0520 0x7f1dd01508c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00c340 tx=0x7f1dcc00c800 comp rx=0 tx=0).stop 2024-09-16T01:54:44.268 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-09-16T01:54:44.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 shutdown_connections 2024-09-16T01:54:44.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1db406c330 0x7f1db406e7f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd0166170 0x7f1dd0150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00b0520 0x7f1dd01508c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 --2- 172.21.15.42:0/2839101081 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00ae140 0x7f1dd014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 >> 172.21.15.42:0/2839101081 conn(0x7f1dd0073490 msgr2=0x7f1dd00af520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:44.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 shutdown_connections 2024-09-16T01:54:44.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.265+0000 7f1dd7eba640 1 -- 172.21.15.42:0/2839101081 wait complete. 2024-09-16T01:54:44.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.266+0000 7f9ebe7fc640 1 -- 172.21.15.42:0/2049009241 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ec805a530 con 0x7f9eb8004800 2024-09-16T01:54:44.270 INFO:teuthology.orchestra.run.smithi042.stdout:64424509448 2024-09-16T01:54:44.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 -- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f658006c330 msgr2=0x7f658006e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f658006c330 0x7f658006e7f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65940cf490 tx=0x7f6584006b50 comp rx=0 tx=0).stop 2024-09-16T01:54:44.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 -- 172.21.15.42:0/3554743669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f659409ca20 msgr2=0x7f659415c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f659409ca20 0x7f659415c4d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f658800c820 tx=0x7f658800cce0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 -- 172.21.15.42:0/3554743669 shutdown_connections 2024-09-16T01:54:44.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f658006c330 0x7f658006e7f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65940d3150 0x7f65941fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f659409ce00 0x7f659409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 --2- 172.21.15.42:0/3554743669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f659409ca20 0x7f659415c4d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 -- 172.21.15.42:0/3554743669 >> 172.21.15.42:0/3554743669 conn(0x7f65940d11f0 msgr2=0x7f65940b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 -- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe96806c300 msgr2=0x7fe96806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe96806c300 0x7fe96806e7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe970034000 tx=0x7fe97002c000 comp rx=0 tx=0).stop 2024-09-16T01:54:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 -- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe97c06e1a0 msgr2=0x7fe97c15a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe97c06e1a0 0x7fe97c15a940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe97400ba50 tx=0x7fe97400bf10 comp rx=0 tx=0).stop 2024-09-16T01:54:44.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 -- 172.21.15.42:0/3973380328 shutdown_connections 2024-09-16T01:54:44.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe96806c300 0x7fe96806e7c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe97c162730 0x7fe97c0c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe97c0b3cb0 0x7fe97c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 --2- 172.21.15.42:0/3973380328 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe97c06e1a0 0x7fe97c15a940 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 -- 172.21.15.42:0/3973380328 >> 172.21.15.42:0/3973380328 conn(0x7fe97c067950 msgr2=0x7fe97c1619b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:44.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 -- 172.21.15.42:0/3973380328 shutdown_connections 2024-09-16T01:54:44.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7fe98127b640 1 -- 172.21.15.42:0/3973380328 wait complete. 2024-09-16T01:54:44.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 -- 172.21.15.42:0/3554743669 shutdown_connections 2024-09-16T01:54:44.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.268+0000 7f6599ee4640 1 -- 172.21.15.42:0/3554743669 wait complete. 2024-09-16T01:54:44.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.269+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9eb006c380 msgr2=0x7f9eb006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.269+0000 7f9ed2af2640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9eb006c380 0x7f9eb006e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0032000 tx=0x7f9ec002d000 comp rx=0 tx=0).stop 2024-09-16T01:54:44.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.270+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb8004800 msgr2=0x7f9ecc153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.270+0000 7f9ed2af2640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb8004800 0x7f9ecc153b20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800ecf0 tx=0x7f9ec800d720 comp rx=0 tx=0).stop 2024-09-16T01:54:44.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.270+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 shutdown_connections 2024-09-16T01:54:44.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.270+0000 7f9ed2af2640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9eb006c380 0x7f9eb006e840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.270+0000 7f9ed2af2640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ecc0cdbb0 0x7f9ecc0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.270+0000 7f9ed2af2640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9ecc0cfa90 0x7f9ecc0cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.270+0000 7f9ed2af2640 1 --2- 172.21.15.42:0/2049009241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb8004800 0x7f9ecc153b20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.270+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 >> 172.21.15.42:0/2049009241 conn(0x7f9ecc0732d0 msgr2=0x7f9ecc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:44.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.270+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 shutdown_connections 2024-09-16T01:54:44.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.270+0000 7f9ed2af2640 1 -- 172.21.15.42:0/2049009241 wait complete. 2024-09-16T01:54:44.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.274+0000 7fdf86a77640 1 -- 172.21.15.42:0/1524352660 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdf64005850 con 0x7fdf80067f40 2024-09-16T01:54:44.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.275+0000 7fdf7d7fa640 1 -- 172.21.15.42:0/1524352660 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf7007a340 con 0x7fdf80067f40 2024-09-16T01:54:44.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.275+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f02740344f0 con 0x7f02740e0a80 2024-09-16T01:54:44.279 INFO:teuthology.orchestra.run.smithi042.stdout:55834574856 2024-09-16T01:54:44.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.277+0000 7f1985eb1640 1 -- 172.21.15.42:0/3101758464 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f197804e4e0 con 0x7f1978036730 2024-09-16T01:54:44.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.278+0000 7f197d7fa640 1 -- 172.21.15.42:0/3101758464 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19800d55a0 con 0x7f1978036730 2024-09-16T01:54:44.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.278+0000 7f026affd640 1 -- 172.21.15.42:0/2138609440 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f027c08f030 con 0x7f02740e0a80 2024-09-16T01:54:44.281 INFO:teuthology.orchestra.run.smithi042.stdout:64424509448 2024-09-16T01:54:44.282 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-09-16T01:54:44.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.280+0000 7fdf86a77640 1 -- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fdf6006c380 msgr2=0x7fdf6006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.280+0000 7fdf86a77640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fdf6006c380 0x7fdf6006e840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf68000f60 tx=0x7fdf680079b0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.280+0000 7fdf86a77640 1 -- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf80067f40 msgr2=0x7fdf80144f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.280+0000 7fdf86a77640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf80067f40 0x7fdf80144f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf800b3270 tx=0x7fdf70004a40 comp rx=0 tx=0).stop 2024-09-16T01:54:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.280+0000 7fdf86a77640 1 -- 172.21.15.42:0/1524352660 shutdown_connections 2024-09-16T01:54:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.280+0000 7fdf86a77640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fdf6006c380 0x7fdf6006e840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.280+0000 7fdf86a77640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf8015ea90 0x7fdf80146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.281+0000 7fdf86a77640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf800720b0 0x7fdf8015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.281+0000 7fdf86a77640 1 --2- 172.21.15.42:0/1524352660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdf80067f40 0x7fdf80144f30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.281+0000 7fdf86a77640 1 -- 172.21.15.42:0/1524352660 >> 172.21.15.42:0/1524352660 conn(0x7fdf80067b30 msgr2=0x7fdf80157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:44.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.281+0000 7fdf86a77640 1 -- 172.21.15.42:0/1524352660 shutdown_connections 2024-09-16T01:54:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.281+0000 7fdf86a77640 1 -- 172.21.15.42:0/1524352660 wait complete. 2024-09-16T01:54:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f1985eb1640 1 -- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f196407d2c0 msgr2=0x7f196407f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f1985eb1640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f196407d2c0 0x7f196407f780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19780481c0 tx=0x7f1974008040 comp rx=0 tx=0).stop 2024-09-16T01:54:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f1985eb1640 1 -- 172.21.15.42:0/3101758464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1978036730 msgr2=0x7f1978174b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f1985eb1640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1978036730 0x7f1978174b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f198006a6a0 tx=0x7f1980069740 comp rx=0 tx=0).stop 2024-09-16T01:54:44.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2024-09-16T01:54:44.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f1985eb1640 1 -- 172.21.15.42:0/3101758464 shutdown_connections 2024-09-16T01:54:44.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f1985eb1640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f196407d2c0 0x7f196407f780 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f1985eb1640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f197804ced0 0x7f197804a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f1985eb1640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19780551b0 0x7f19780d7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f1985eb1640 1 --2- 172.21.15.42:0/3101758464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1978036730 0x7f1978174b10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f1985eb1640 1 -- 172.21.15.42:0/3101758464 >> 172.21.15.42:0/3101758464 conn(0x7f197801d930 msgr2=0x7f1978006ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f025c06c300 msgr2=0x7f025c06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f028088d640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f025c06c300 0x7f025c06e7c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f026c034000 tx=0x7f026c02e000 comp rx=0 tx=0).stop 2024-09-16T01:54:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 msgr2=0x7f02740df900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f028088d640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 0x7f02740df900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f027c0504d0 tx=0x7f027c069740 comp rx=0 tx=0).stop 2024-09-16T01:54:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 shutdown_connections 2024-09-16T01:54:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f028088d640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f025c06c300 0x7f025c06e7c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f028088d640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02740e0a80 0x7f02740df900 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f028088d640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0274054b10 0x7f027403bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f028088d640 1 --2- 172.21.15.42:0/2138609440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f027400bdd0 0x7f027404c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.282+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 >> 172.21.15.42:0/2138609440 conn(0x7f027401fb70 msgr2=0x7f0274038920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.283+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 shutdown_connections 2024-09-16T01:54:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.283+0000 7f028088d640 1 -- 172.21.15.42:0/2138609440 wait complete. 2024-09-16T01:54:44.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.283+0000 7f1985eb1640 1 -- 172.21.15.42:0/3101758464 shutdown_connections 2024-09-16T01:54:44.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:44.283+0000 7f1985eb1640 1 -- 172.21.15.42:0/3101758464 wait complete. 2024-09-16T01:54:44.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-09-16T01:54:44.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-09-16T01:54:44.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-09-16T01:54:44.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.1 2024-09-16T01:54:44.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2024-09-16T01:54:44.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-09-16T01:54:44.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.2 2024-09-16T01:54:45.287 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T01:54:45.292 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T01:54:45.294 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T01:54:45.294 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T01:54:45.296 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T01:54:45.302 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T01:54:45.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T01:54:45.307 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T01:54:45.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.456+0000 7efcdde5e640 1 Processor -- start 2024-09-16T01:54:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.456+0000 7efcdde5e640 1 -- start start 2024-09-16T01:54:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.458+0000 7efcdde5e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcd815ea90 0x7efcd80cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.458+0000 7efcdde5e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd80ce620 con 0x7efcd80720b0 2024-09-16T01:54:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.458+0000 7efcdde5e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd80ce8c0 con 0x7efcd815a2c0 2024-09-16T01:54:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.458+0000 7efcdde5e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efcd80ce3f0 con 0x7efcd815ea90 2024-09-16T01:54:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.459+0000 7efcd7fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7efcd80720b0 0x7efcd80b34d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45484/0 (socket says 172.21.15.42:45484) 2024-09-16T01:54:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.459+0000 7efcd7fff640 1 -- 172.21.15.42:0/1807158174 learned_addr learned my addr 172.21.15.42:0/1807158174 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:45.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.459+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953240795 0 0) 0x7efcd80ce620 con 0x7efcd80720b0 2024-09-16T01:54:45.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.459+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc0003520 con 0x7efcd80720b0 2024-09-16T01:54:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4006476166 0 0) 0x7efcc0003520 con 0x7efcd80720b0 2024-09-16T01:54:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcd815ea90 msgr2=0x7efcd80cf680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:54:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 --2- 172.21.15.42:0/1807158174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcd815ea90 0x7efcd80cf680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 >> v1:172.21.15.107:6789/0 conn(0x7efcd815a2c0 legacy=0x7efcd80cc9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:54:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd80ceba0 con 0x7efcd80720b0 2024-09-16T01:54:45.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7efcd00019d0 con 0x7efcd80720b0 2024-09-16T01:54:45.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 >> v1:172.21.15.42:6789/0 conn(0x7efcd80720b0 legacy=0x7efcd80b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 --2- 172.21.15.42:0/1807158174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcc00037a0 0x7efcc0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 --2- 172.21.15.42:0/1807158174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcc0004120 0x7efcc000b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 --2- 172.21.15.42:0/1807158174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc000b600 0x7efcc000da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efcc000e3d0 con 0x7efcc000b600 2024-09-16T01:54:45.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efcc0004e10 con 0x7efcc0004120 2024-09-16T01:54:45.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.460+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efcc0005010 con 0x7efcc00037a0 2024-09-16T01:54:45.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.461+0000 7efcd7fff640 1 --2- 172.21.15.42:0/1807158174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc000b600 0x7efcc000da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.462+0000 7efcd7fff640 1 -- 172.21.15.42:0/1807158174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcc00037a0 msgr2=0x7efcc0003be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:54:45.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.462+0000 7efcd7fff640 1 --2- 172.21.15.42:0/1807158174 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcc00037a0 0x7efcc0003be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.462+0000 7efcd7fff640 1 -- 172.21.15.42:0/1807158174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcc0004120 msgr2=0x7efcc000b010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:54:45.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.462+0000 7efcd7fff640 1 --2- 172.21.15.42:0/1807158174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcc0004120 0x7efcc000b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.462+0000 7efcd7fff640 1 -- 172.21.15.42:0/1807158174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd80ceba0 con 0x7efcc000b600 2024-09-16T01:54:45.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.464+0000 7efcd7fff640 1 --2- 172.21.15.42:0/1807158174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc000b600 0x7efcc000da90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efcd80ce7f0 tx=0x7efcc0004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74de1c3ef0aa2755 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.464+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd000a500 con 0x7efcc000b600 2024-09-16T01:54:45.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.464+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd002f070 con 0x7efcc000b600 2024-09-16T01:54:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.465+0000 7efcdde5e640 1 -- 172.21.15.42:0/1807158174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc000b600 msgr2=0x7efcc000da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.465+0000 7efcd67fc640 1 -- 172.21.15.42:0/1807158174 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd000a500 con 0x7efcc000b600 2024-09-16T01:54:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.465+0000 7efcdde5e640 1 --2- 172.21.15.42:0/1807158174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcc000b600 0x7efcc000da90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efcd80ce7f0 tx=0x7efcc0004820 comp rx=0 tx=0).stop 2024-09-16T01:54:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.466+0000 7efcd7fff640 1 -- 172.21.15.42:0/1807158174 reap_dead start 2024-09-16T01:54:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.466+0000 7efcdde5e640 1 -- 172.21.15.42:0/1807158174 shutdown_connections 2024-09-16T01:54:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.466+0000 7efcdde5e640 1 -- 172.21.15.42:0/1807158174 >> 172.21.15.42:0/1807158174 conn(0x7efcd8067b30 msgr2=0x7efcd806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.467+0000 7efcdde5e640 1 -- 172.21.15.42:0/1807158174 shutdown_connections 2024-09-16T01:54:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.467+0000 7efcdde5e640 1 -- 172.21.15.42:0/1807158174 wait complete. 2024-09-16T01:54:45.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.469+0000 7efcdde5e640 1 Processor -- start 2024-09-16T01:54:45.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.469+0000 7efcdde5e640 1 -- start start 2024-09-16T01:54:45.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcdde5e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd8158980 0x7efcd81514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcdde5e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcd8158d60 0x7efcd81519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcdde5e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd80b2100 0x7efcd8152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcdde5e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efcd80cfbc0 con 0x7efcd80b2100 2024-09-16T01:54:45.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcdde5e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efcd80cf1f0 con 0x7efcd8158980 2024-09-16T01:54:45.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcdde5e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efcd815a6a0 con 0x7efcd8158d60 2024-09-16T01:54:45.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcd77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd8158980 0x7efcd81514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcd77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd8158980 0x7efcd81514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51254/0 (socket says 172.21.15.42:51254) 2024-09-16T01:54:45.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcd77fe640 1 -- 172.21.15.42:0/1290912215 learned_addr learned my addr 172.21.15.42:0/1290912215 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcd6ffd640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcd8158d60 0x7efcd81519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.471+0000 7efcd7fff640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd80b2100 0x7efcd8152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.472+0000 7efcd77fe640 1 -- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcd8158d60 msgr2=0x7efcd81519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.472+0000 7efcd77fe640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcd8158d60 0x7efcd81519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.472+0000 7efcd77fe640 1 -- 172.21.15.42:0/1290912215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd80b2100 msgr2=0x7efcd8152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.472+0000 7efcd77fe640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd80b2100 0x7efcd8152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.472+0000 7efcd77fe640 1 -- 172.21.15.42:0/1290912215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd80cbdb0 con 0x7efcd8158980 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.472+0000 7efcd7fff640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd80b2100 0x7efcd8152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.473+0000 7efcd77fe640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd8158980 0x7efcd81514a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009fd0 tx=0x7efcc800b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.474+0000 7efcbffff640 1 -- 172.21.15.42:0/1290912215 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8037020 con 0x7efcd8158980 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.474+0000 7efcdde5e640 1 -- 172.21.15.42:0/1290912215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd80cc090 con 0x7efcd8158980 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.474+0000 7efcdde5e640 1 -- 172.21.15.42:0/1290912215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd81525c0 con 0x7efcd8158980 2024-09-16T01:54:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.475+0000 7efcbffff640 1 -- 172.21.15.42:0/1290912215 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc8033640 con 0x7efcd8158980 2024-09-16T01:54:45.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.475+0000 7efcbffff640 1 -- 172.21.15.42:0/1290912215 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8033a50 con 0x7efcd8158980 2024-09-16T01:54:45.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.477+0000 7efcdde5e640 1 -- 172.21.15.42:0/1290912215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb8005290 con 0x7efcd8158980 2024-09-16T01:54:45.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.478+0000 7efcbffff640 1 -- 172.21.15.42:0/1290912215 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efcc803a020 con 0x7efcd8158980 2024-09-16T01:54:45.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.479+0000 7efcbffff640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcc406c380 0x7efcc406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.479+0000 7efcbffff640 1 -- 172.21.15.42:0/1290912215 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efcc80ad2a0 con 0x7efcd8158980 2024-09-16T01:54:45.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.480+0000 7efcd6ffd640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcc406c380 0x7efcc406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.480+0000 7efcd6ffd640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcc406c380 0x7efcc406e840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efcd806b190 tx=0x7efccc006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.483+0000 7efcbffff640 1 -- 172.21.15.42:0/1290912215 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efcc8041030 con 0x7efcd8158980 2024-09-16T01:54:45.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.513+0000 7f635722b640 1 Processor -- start 2024-09-16T01:54:45.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.513+0000 7f635722b640 1 -- start start 2024-09-16T01:54:45.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.514+0000 7f4fcd620640 1 Processor -- start 2024-09-16T01:54:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.514+0000 7f4fcd620640 1 -- start start 2024-09-16T01:54:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.514+0000 7f2543fff640 1 Processor -- start 2024-09-16T01:54:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.514+0000 7f2543fff640 1 -- start start 2024-09-16T01:54:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.514+0000 7f8017eaf640 1 Processor -- start 2024-09-16T01:54:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f2543fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2544157ff0 0x7f2544072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f635722b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6348047c10 0x7f6348006910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f635722b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f634800b6c0 con 0x7f63480e6f80 2024-09-16T01:54:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f635722b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f634800b9a0 con 0x7f6348033a00 2024-09-16T01:54:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f635722b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f6348047780 con 0x7f6348047c10 2024-09-16T01:54:45.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f2543fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544072a80 0x7f254415a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f8017eaf640 1 -- start start 2024-09-16T01:54:45.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f2543fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f254415ad80 0x7f25440b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f4fcd620640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc80b2920 0x7f4fc8073860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f4fcd620640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc80722b0 con 0x7f4fc815d4c0 2024-09-16T01:54:45.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f4fcd620640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc8072590 con 0x7f4fc806f820 2024-09-16T01:54:45.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f4fcd620640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc8073da0 con 0x7f4fc80b2920 2024-09-16T01:54:45.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f25437fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f254415ad80 0x7f25440b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f4fcce1f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4fc806f820 0x7f4fc80b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:51088/0 (socket says 172.21.15.42:51088) 2024-09-16T01:54:45.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f4fcce1f640 1 -- 172.21.15.42:0/1055164412 learned_addr learned my addr 172.21.15.42:0/1055164412 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:45.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f25437fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f254415ad80 0x7f25440b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53454/0 (socket says 172.21.15.42:53454) 2024-09-16T01:54:45.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f4fc7fff640 1 --2- 172.21.15.42:0/1055164412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc80b2920 0x7f4fc8073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f2542ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2544157ff0 0x7f2544072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f2542ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2544157ff0 0x7f2544072540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51268/0 (socket says 172.21.15.42:51268) 2024-09-16T01:54:45.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f2542ffd640 1 -- 172.21.15.42:0/1654735377 learned_addr learned my addr 172.21.15.42:0/1654735377 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f4fc6ffd640 1 -- 172.21.15.42:0/1055164412 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186559805 0 0) 0x7f4fc8072590 con 0x7f4fc806f820 2024-09-16T01:54:45.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f25427fc640 1 --2- 172.21.15.42:0/1654735377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544072a80 0x7f254415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f4fc6ffd640 1 -- 172.21.15.42:0/1055164412 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fb0003520 con 0x7f4fc806f820 2024-09-16T01:54:45.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f2543fff640 1 -- 172.21.15.42:0/1654735377 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f254415b7e0 con 0x7f254415ad80 2024-09-16T01:54:45.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f4fc7fff640 1 -- 172.21.15.42:0/1055164412 >> v1:172.21.15.107:6789/0 conn(0x7f4fc806f820 legacy=0x7f4fc80b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f2543fff640 1 -- 172.21.15.42:0/1654735377 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f254415b220 con 0x7f2544157ff0 2024-09-16T01:54:45.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f4fc7fff640 1 -- 172.21.15.42:0/1055164412 >> v1:172.21.15.42:6789/0 conn(0x7f4fc815d4c0 legacy=0x7f4fc806f110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:54:45.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f6355a28640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6348047c10 0x7f6348006910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f6355a28640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6348047c10 0x7f6348006910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53448/0 (socket says 172.21.15.42:53448) 2024-09-16T01:54:45.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.515+0000 7f6355a28640 1 -- 172.21.15.42:0/426258292 learned_addr learned my addr 172.21.15.42:0/426258292 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f2543fff640 1 -- 172.21.15.42:0/1654735377 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f254415b500 con 0x7f2544072a80 2024-09-16T01:54:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f6355a28640 1 -- 172.21.15.42:0/426258292 >> v1:172.21.15.107:6789/0 conn(0x7f6348033a00 legacy=0x7f6348036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f6355a28640 1 -- 172.21.15.42:0/426258292 >> v1:172.21.15.42:6789/0 conn(0x7f63480e6f80 legacy=0x7f6348006200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f6355a28640 1 -- 172.21.15.42:0/426258292 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6348005ba0 con 0x7f6348047c10 2024-09-16T01:54:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.516+0000 7f6355227640 1 -- 172.21.15.42:0/426258292 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280172092 0 0) 0x7f634800b6c0 con 0x7f63480e6f80 2024-09-16T01:54:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f4fc7fff640 1 -- 172.21.15.42:0/1055164412 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc8161080 con 0x7f4fc80b2920 2024-09-16T01:54:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f8017eaf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f801015a860 0x7f80100b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f8017eaf640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015ac40 0x7f80100720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f8015c4b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f801015a860 0x7f80100b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f8015c4b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f801015a860 0x7f80100b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51282/0 (socket says 172.21.15.42:51282) 2024-09-16T01:54:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f8015c4b640 1 -- 172.21.15.42:0/1977269768 learned_addr learned my addr 172.21.15.42:0/1977269768 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1977269768 >> v2:172.21.15.42:3300/0 conn(0x7f80100b4d30 0x7f80100725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f801544a640 1 --2- 172.21.15.42:0/1977269768 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015ac40 0x7f80100720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f2542ffd640 1 -- 172.21.15.42:0/1654735377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544072a80 msgr2=0x7f254415a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:45.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f2542ffd640 1 --2- 172.21.15.42:0/1654735377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544072a80 0x7f254415a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f2542ffd640 1 -- 172.21.15.42:0/1654735377 >> v2:172.21.15.42:3300/0 conn(0x7f254415ad80 msgr2=0x7f25440b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:45.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f2542ffd640 1 --2- 172.21.15.42:0/1654735377 >> v2:172.21.15.42:3300/0 conn(0x7f254415ad80 0x7f25440b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f2542ffd640 1 -- 172.21.15.42:0/1654735377 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2544071d40 con 0x7f2544157ff0 2024-09-16T01:54:45.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f8017eaf640 1 -- 172.21.15.42:0/1977269768 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f80100b52b0 con 0x7f80100b4d30 2024-09-16T01:54:45.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f8017eaf640 1 -- 172.21.15.42:0/1977269768 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f80100b5590 con 0x7f801015a860 2024-09-16T01:54:45.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f8017eaf640 1 -- 172.21.15.42:0/1977269768 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f80100b5870 con 0x7f801015ac40 2024-09-16T01:54:45.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f801644c640 1 --2- 172.21.15.42:0/1977269768 >> v2:172.21.15.42:3300/0 conn(0x7f80100b4d30 0x7f80100725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7fb3a5255640 1 Processor -- start 2024-09-16T01:54:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f4fc7fff640 1 --2- 172.21.15.42:0/1055164412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc80b2920 0x7f4fc8073860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0097d0 tx=0x7f4fbc02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72bb386c77ff92cb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.517+0000 7f6355a28640 1 --2- 172.21.15.42:0/426258292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6348047c10 0x7f6348006910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f634c009870 tx=0x7f634c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a29d11a9618b64d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f6355227640 1 -- 172.21.15.42:0/426258292 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c037070 con 0x7f6348047c10 2024-09-16T01:54:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f8015c4b640 1 -- 172.21.15.42:0/1977269768 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015ac40 msgr2=0x7f80100720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f8015c4b640 1 --2- 172.21.15.42:0/1977269768 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015ac40 0x7f80100720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f8015c4b640 1 -- 172.21.15.42:0/1977269768 >> v2:172.21.15.42:3300/0 conn(0x7f80100b4d30 msgr2=0x7f80100725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:45.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f8015c4b640 1 --2- 172.21.15.42:0/1977269768 >> v2:172.21.15.42:3300/0 conn(0x7f80100b4d30 0x7f80100725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f8015c4b640 1 -- 172.21.15.42:0/1977269768 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80100cebd0 con 0x7f801015a860 2024-09-16T01:54:45.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f801544a640 1 --2- 172.21.15.42:0/1977269768 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015ac40 0x7f80100720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:45.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f6355227640 1 -- 172.21.15.42:0/426258292 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c032640 con 0x7f6348047c10 2024-09-16T01:54:45.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f6355227640 1 -- 172.21.15.42:0/426258292 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c032a10 con 0x7f6348047c10 2024-09-16T01:54:45.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7fb3a5255640 1 -- start start 2024-09-16T01:54:45.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f2542ffd640 1 --2- 172.21.15.42:0/1654735377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2544157ff0 0x7f2544072540 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f254406fc20 tx=0x7f253c02a990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5e98e2599430f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f2541ffb640 1 -- 172.21.15.42:0/1654735377 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c030680 con 0x7f2544157ff0 2024-09-16T01:54:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f2541ffb640 1 -- 172.21.15.42:0/1654735377 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c035070 con 0x7f2544157ff0 2024-09-16T01:54:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f2541ffb640 1 -- 172.21.15.42:0/1654735377 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c030a20 con 0x7f2544157ff0 2024-09-16T01:54:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f635722b640 1 -- 172.21.15.42:0/426258292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6348047c10 msgr2=0x7f6348006910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f635722b640 1 --2- 172.21.15.42:0/426258292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6348047c10 0x7f6348006910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f634c009870 tx=0x7f634c02a2c0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f635722b640 1 -- 172.21.15.42:0/426258292 shutdown_connections 2024-09-16T01:54:45.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f635722b640 1 --2- 172.21.15.42:0/426258292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6348047c10 0x7f6348006910 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f635722b640 1 -- 172.21.15.42:0/426258292 >> 172.21.15.42:0/426258292 conn(0x7f634801d930 msgr2=0x7f63480545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f8015c4b640 1 --2- 172.21.15.42:0/1977269768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f801015a860 0x7f80100b47f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f80100732b0 tx=0x7f800c02e5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb156dca0b63ee13 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f8014c49640 1 -- 172.21.15.42:0/1977269768 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c03a070 con 0x7f801015a860 2024-09-16T01:54:45.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f8014c49640 1 -- 172.21.15.42:0/1977269768 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800c033510 con 0x7f801015a860 2024-09-16T01:54:45.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f8014c49640 1 -- 172.21.15.42:0/1977269768 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c0338e0 con 0x7f801015a860 2024-09-16T01:54:45.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f635722b640 1 -- 172.21.15.42:0/426258292 shutdown_connections 2024-09-16T01:54:45.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.518+0000 7f4fc6ffd640 1 -- 172.21.15.42:0/1055164412 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc037070 con 0x7f4fc80b2920 2024-09-16T01:54:45.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f4fc6ffd640 1 -- 172.21.15.42:0/1055164412 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fbc032440 con 0x7f4fc80b2920 2024-09-16T01:54:45.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.519+0000 7f4fc6ffd640 1 -- 172.21.15.42:0/1055164412 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc032810 con 0x7f4fc80b2920 2024-09-16T01:54:45.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f4fcd620640 1 -- 172.21.15.42:0/1055164412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc80b2920 msgr2=0x7f4fc8073860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f4fcd620640 1 --2- 172.21.15.42:0/1055164412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc80b2920 0x7f4fc8073860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0097d0 tx=0x7f4fbc02a250 comp rx=0 tx=0).stop 2024-09-16T01:54:45.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7fb3a5255640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb3a0162850 0x7fb3a00b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7fb3a5255640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb3a006c320 0x7fb3a00b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7fb3a5255640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a00b2790 con 0x7fb3a00ae030 2024-09-16T01:54:45.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7fb3a5255640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a00b2a70 con 0x7fb3a0162850 2024-09-16T01:54:45.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7fb3a5255640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a00b0b70 con 0x7fb3a006c320 2024-09-16T01:54:45.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f2543fff640 1 -- 172.21.15.42:0/1654735377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2544157ff0 msgr2=0x7f2544072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f2543fff640 1 --2- 172.21.15.42:0/1654735377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2544157ff0 0x7f2544072540 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f254406fc20 tx=0x7f253c02a990 comp rx=0 tx=0).stop 2024-09-16T01:54:45.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f4fcd620640 1 -- 172.21.15.42:0/1055164412 shutdown_connections 2024-09-16T01:54:45.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f4fcd620640 1 --2- 172.21.15.42:0/1055164412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc80b2920 0x7f4fc8073860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f4fcd620640 1 -- 172.21.15.42:0/1055164412 >> 172.21.15.42:0/1055164412 conn(0x7f4fc80b1e00 msgr2=0x7f4fc80b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f2543fff640 1 -- 172.21.15.42:0/1654735377 shutdown_connections 2024-09-16T01:54:45.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f2543fff640 1 --2- 172.21.15.42:0/1654735377 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544072a80 0x7f254415a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f2543fff640 1 --2- 172.21.15.42:0/1654735377 >> v2:172.21.15.42:3300/0 conn(0x7f254415ad80 0x7f25440b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f2543fff640 1 --2- 172.21.15.42:0/1654735377 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2544157ff0 0x7f2544072540 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7fb39ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb3a0162850 0x7fb3a00b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7fb3a4a54640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb3a006c320 0x7fb3a00b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7fb39f7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb3a00ae030 0x7fb3a006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45500/0 (socket says 172.21.15.42:45500) 2024-09-16T01:54:45.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7fb39f7fe640 1 -- 172.21.15.42:0/1634472429 learned_addr learned my addr 172.21.15.42:0/1634472429 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:45.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f2543fff640 1 -- 172.21.15.42:0/1654735377 >> 172.21.15.42:0/1654735377 conn(0x7f254406f560 msgr2=0x7f254406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f8017eaf640 1 -- 172.21.15.42:0/1977269768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f801015a860 msgr2=0x7f80100b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1977269768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f801015a860 0x7f80100b47f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f80100732b0 tx=0x7f800c02e5e0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.520+0000 7f635722b640 1 -- 172.21.15.42:0/426258292 wait complete. 2024-09-16T01:54:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f8017eaf640 1 -- 172.21.15.42:0/1977269768 shutdown_connections 2024-09-16T01:54:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1977269768 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015ac40 0x7f80100720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1977269768 >> v2:172.21.15.42:3300/0 conn(0x7f80100b4d30 0x7f80100725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1977269768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f801015a860 0x7f80100b47f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f8017eaf640 1 -- 172.21.15.42:0/1977269768 >> 172.21.15.42:0/1977269768 conn(0x7f8010067d70 msgr2=0x7f801006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7fb3a4a54640 1 -- 172.21.15.42:0/1634472429 >> v2:172.21.15.42:3300/0 conn(0x7fb3a0162850 msgr2=0x7fb3a00b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7fb3a4a54640 1 --2- 172.21.15.42:0/1634472429 >> v2:172.21.15.42:3300/0 conn(0x7fb3a0162850 0x7fb3a00b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7fb3a4a54640 1 -- 172.21.15.42:0/1634472429 >> v1:172.21.15.42:6789/0 conn(0x7fb3a00ae030 legacy=0x7fb3a006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7fb3a4a54640 1 -- 172.21.15.42:0/1634472429 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a00b0e50 con 0x7fb3a006c320 2024-09-16T01:54:45.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f4fcd620640 1 -- 172.21.15.42:0/1055164412 shutdown_connections 2024-09-16T01:54:45.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f2543fff640 1 -- 172.21.15.42:0/1654735377 shutdown_connections 2024-09-16T01:54:45.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f1aa359e640 1 Processor -- start 2024-09-16T01:54:45.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f2543fff640 1 -- 172.21.15.42:0/1654735377 wait complete. 2024-09-16T01:54:45.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f1aa359e640 1 -- start start 2024-09-16T01:54:45.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f8017eaf640 1 -- 172.21.15.42:0/1977269768 shutdown_connections 2024-09-16T01:54:45.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.521+0000 7f4fcd620640 1 -- 172.21.15.42:0/1055164412 wait complete. 2024-09-16T01:54:45.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.522+0000 7f635722b640 1 Processor -- start 2024-09-16T01:54:45.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.522+0000 7fb39ffff640 1 --2- 172.21.15.42:0/1634472429 >> v2:172.21.15.42:3300/0 conn(0x7fb3a0162850 0x7fb3a00b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:45.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.522+0000 7fb3a4a54640 1 --2- 172.21.15.42:0/1634472429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a006c320 0x7fb3a00b1650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00687a0 tx=0x7fb39802a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d82f8e8ed3b5d094 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.522+0000 7f635722b640 1 -- start start 2024-09-16T01:54:45.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f1aa359e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a9c005a60 0x7f1a9c053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7fb39effd640 1 -- 172.21.15.42:0/1634472429 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398007740 con 0x7fb3a006c320 2024-09-16T01:54:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7fb39effd640 1 -- 172.21.15.42:0/1634472429 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3980078e0 con 0x7fb3a006c320 2024-09-16T01:54:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f1aa359e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1a9c04eb60 0x7f1a9c01d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f1aa359e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a9c052330 con 0x7f1a9c0e7120 2024-09-16T01:54:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f1aa359e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f1a9c0520e0 con 0x7f1a9c04eb60 2024-09-16T01:54:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f1aa359e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9c006c80 con 0x7f1a9c005a60 2024-09-16T01:54:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7fb39effd640 1 -- 172.21.15.42:0/1634472429 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398007cf0 con 0x7fb3a006c320 2024-09-16T01:54:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f1aa1d9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1a9c0e7120 0x7f1a9c005e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:51096/0 (socket says 172.21.15.42:51096) 2024-09-16T01:54:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f1aa1d9b640 1 -- 172.21.15.42:0/4200104121 learned_addr learned my addr 172.21.15.42:0/4200104121 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f635722b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6348033a00 0x7f634804fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f1aa2d9d640 1 --2- 172.21.15.42:0/4200104121 >> v2:172.21.15.42:3300/0 conn(0x7f1a9c04eb60 0x7f1a9c01d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f635722b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6348047c10 0x7f63480d9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f4fcd620640 1 Processor -- start 2024-09-16T01:54:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f2543fff640 1 Processor -- start 2024-09-16T01:54:45.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f635722b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63480e6f80 0x7f6348050460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.523+0000 7f88f97f8640 1 Processor -- start 2024-09-16T01:54:45.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f4fcd620640 1 -- start start 2024-09-16T01:54:45.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f2543fff640 1 -- start start 2024-09-16T01:54:45.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f6355a28640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6348047c10 0x7f63480d9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f635722b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f63480e7360 con 0x7f63480e6f80 2024-09-16T01:54:45.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f635722b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6348006e50 con 0x7f6348033a00 2024-09-16T01:54:45.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f635722b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f63480502a0 con 0x7f6348047c10 2024-09-16T01:54:45.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f6355a28640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6348047c10 0x7f63480d9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45632/0 (socket says 172.21.15.42:45632) 2024-09-16T01:54:45.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f6355a28640 1 -- 172.21.15.42:0/3288511764 learned_addr learned my addr 172.21.15.42:0/3288511764 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f88f97f8640 1 -- start start 2024-09-16T01:54:45.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7fb3a5255640 1 -- 172.21.15.42:0/1634472429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a006c320 msgr2=0x7fb3a00b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7fb3a5255640 1 --2- 172.21.15.42:0/1634472429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a006c320 0x7fb3a00b1650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00687a0 tx=0x7fb39802a6a0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f1aa2d9d640 1 -- 172.21.15.42:0/4200104121 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a9c005a60 msgr2=0x7f1a9c053f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:54:45.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f1aa2d9d640 1 --2- 172.21.15.42:0/4200104121 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a9c005a60 0x7f1a9c053f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f1aa2d9d640 1 -- 172.21.15.42:0/4200104121 >> v1:172.21.15.107:6789/0 conn(0x7f1a9c0e7120 legacy=0x7f1a9c005e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f1aa2d9d640 1 -- 172.21.15.42:0/4200104121 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c006f60 con 0x7f1a9c04eb60 2024-09-16T01:54:45.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f1aa159a640 1 -- 172.21.15.42:0/4200104121 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413818799 0 0) 0x7f1a9c052330 con 0x7f1a9c0e7120 2024-09-16T01:54:45.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f8017eaf640 1 -- 172.21.15.42:0/1977269768 wait complete. 2024-09-16T01:54:45.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f6356a2a640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63480e6f80 0x7f6348050460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7f6356229640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6348033a00 0x7f634804fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7fb3a5255640 1 -- 172.21.15.42:0/1634472429 shutdown_connections 2024-09-16T01:54:45.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7fb3a5255640 1 --2- 172.21.15.42:0/1634472429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a006c320 0x7fb3a00b1650 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7fb3a5255640 1 --2- 172.21.15.42:0/1634472429 >> v2:172.21.15.42:3300/0 conn(0x7fb3a0162850 0x7fb3a00b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.524+0000 7fb3a5255640 1 -- 172.21.15.42:0/1634472429 >> 172.21.15.42:0/1634472429 conn(0x7fb3a009aa30 msgr2=0x7fb3a00b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f6355a28640 1 -- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6348033a00 msgr2=0x7f634804fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f6355a28640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6348033a00 0x7f634804fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f6355a28640 1 -- 172.21.15.42:0/3288511764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63480e6f80 msgr2=0x7f6348050460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f6355a28640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63480e6f80 0x7f6348050460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f6355a28640 1 -- 172.21.15.42:0/3288511764 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6348032f30 con 0x7f6348047c10 2024-09-16T01:54:45.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f6356a2a640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63480e6f80 0x7f6348050460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:45.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f4fcd620640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc806f820 0x7f4fc81fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f4fcd620640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fc80b2920 0x7f4fc8144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f6355a28640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6348047c10 0x7f63480d9a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f634c009870 tx=0x7f634c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f4fcd620640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc815d4c0 0x7f4fc80b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f4fcd620640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc80cfd10 con 0x7f4fc80b2920 2024-09-16T01:54:45.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f4fcd620640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8072b50 con 0x7f4fc806f820 2024-09-16T01:54:45.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f4fcd620640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc8071c10 con 0x7f4fc815d4c0 2024-09-16T01:54:45.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fc80b2920 0x7f4fc8144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f1aa2d9d640 1 --2- 172.21.15.42:0/4200104121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a9c04eb60 0x7f1a9c01d530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1aa406a6a0 tx=0x7f1aa40a63f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8633b57fc0d50a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f6346ffd640 1 -- 172.21.15.42:0/3288511764 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c041070 con 0x7f6348047c10 2024-09-16T01:54:45.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f6346ffd640 1 -- 172.21.15.42:0/3288511764 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c03c870 con 0x7f6348047c10 2024-09-16T01:54:45.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f6346ffd640 1 -- 172.21.15.42:0/3288511764 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c037040 con 0x7f6348047c10 2024-09-16T01:54:45.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f88f97f8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88f40c5370 0x7f88f40c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f88f97f8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f88f40b2190 0x7f88f40b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f88f97f8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f4162eb0 con 0x7f88f4162ad0 2024-09-16T01:54:45.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f88f97f8640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f88f40c5cf0 con 0x7f88f40c5370 2024-09-16T01:54:45.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f88f97f8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f88f409b140 con 0x7f88f40b2190 2024-09-16T01:54:45.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fc80b2920 0x7f4fc8144130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53498/0 (socket says 172.21.15.42:53498) 2024-09-16T01:54:45.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f4fc77fe640 1 -- 172.21.15.42:0/2547633389 learned_addr learned my addr 172.21.15.42:0/2547633389 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.525+0000 7f4fc7fff640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc806f820 0x7f4fc81fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f1aa159a640 1 -- 172.21.15.42:0/4200104121 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40b2070 con 0x7f1a9c04eb60 2024-09-16T01:54:45.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f635722b640 1 -- 172.21.15.42:0/3288511764 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63480326f0 con 0x7f6348047c10 2024-09-16T01:54:45.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f635722b640 1 -- 172.21.15.42:0/3288511764 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63480315f0 con 0x7f6348047c10 2024-09-16T01:54:45.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f88f37fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f88f40b2190 0x7f88f40b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f4fcce1f640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc815d4c0 0x7f4fc80b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f88f37fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f88f40b2190 0x7f88f40b25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51312/0 (socket says 172.21.15.42:51312) 2024-09-16T01:54:45.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f88f37fe640 1 -- 172.21.15.42:0/3974919282 learned_addr learned my addr 172.21.15.42:0/3974919282 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f8017eaf640 1 Processor -- start 2024-09-16T01:54:45.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f2543fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544157ff0 0x7f2544154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f2543fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f254415ad80 0x7f25440b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f2543fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25441560a0 0x7f25441fbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f2543fff640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2544073980 con 0x7f25441560a0 2024-09-16T01:54:45.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f88ebfff640 1 --2- 172.21.15.42:0/3974919282 >> v2:172.21.15.42:3300/0 conn(0x7f88f40c5370 0x7f88f40c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7fb3a5255640 1 -- 172.21.15.42:0/1634472429 shutdown_connections 2024-09-16T01:54:45.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f2543fff640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f254406ff10 con 0x7f254415ad80 2024-09-16T01:54:45.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f2543fff640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2544073b00 con 0x7f2544157ff0 2024-09-16T01:54:45.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7fb3a5255640 1 -- 172.21.15.42:0/1634472429 wait complete. 2024-09-16T01:54:45.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f4fc77fe640 1 -- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc815d4c0 msgr2=0x7f4fc80b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f4fc77fe640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc815d4c0 0x7f4fc80b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f4fc77fe640 1 -- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc806f820 msgr2=0x7f4fc81fc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f4fc77fe640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc806f820 0x7f4fc81fc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f4fc77fe640 1 -- 172.21.15.42:0/2547633389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc8141840 con 0x7f4fc80b2920 2024-09-16T01:54:45.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f2542ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544157ff0 0x7f2544154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f2542ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544157ff0 0x7f2544154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45650/0 (socket says 172.21.15.42:45650) 2024-09-16T01:54:45.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f2542ffd640 1 -- 172.21.15.42:0/190854144 learned_addr learned my addr 172.21.15.42:0/190854144 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f88ebfff640 1 -- 172.21.15.42:0/3974919282 >> v2:172.21.15.107:3300/0 conn(0x7f88f40b2190 msgr2=0x7f88f40b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:45.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f88ebfff640 1 --2- 172.21.15.42:0/3974919282 >> v2:172.21.15.107:3300/0 conn(0x7f88f40b2190 0x7f88f40b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f88ebfff640 1 -- 172.21.15.42:0/3974919282 >> v1:172.21.15.107:6789/0 conn(0x7f88f4162ad0 legacy=0x7f88f409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f88ebfff640 1 -- 172.21.15.42:0/3974919282 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f40b1c80 con 0x7f88f40c5370 2024-09-16T01:54:45.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f1aa159a640 1 -- 172.21.15.42:0/4200104121 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa40ad600 con 0x7f1a9c04eb60 2024-09-16T01:54:45.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.526+0000 7f1aa159a640 1 -- 172.21.15.42:0/4200104121 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40ad9f0 con 0x7f1a9c04eb60 2024-09-16T01:54:45.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f25437fe640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25441560a0 0x7f25441fbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f25427fc640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f254415ad80 0x7f25440b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f4fc77fe640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fc80b2920 0x7f4fc8144130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800b3e0 tx=0x7f4fb800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f4fc4ff9640 1 -- 172.21.15.42:0/2547633389 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8015020 con 0x7f4fc80b2920 2024-09-16T01:54:45.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f4fcd620640 1 -- 172.21.15.42:0/2547633389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc815a110 con 0x7f4fc80b2920 2024-09-16T01:54:45.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f25427fc640 1 -- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544157ff0 msgr2=0x7f2544154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f4fcd620640 1 -- 172.21.15.42:0/2547633389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc8141de0 con 0x7f4fc80b2920 2024-09-16T01:54:45.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f4fc4ff9640 1 -- 172.21.15.42:0/2547633389 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb8011830 con 0x7f4fc80b2920 2024-09-16T01:54:45.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f25427fc640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544157ff0 0x7f2544154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f25427fc640 1 -- 172.21.15.42:0/190854144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25441560a0 msgr2=0x7f25441fbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f25427fc640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25441560a0 0x7f25441fbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f25427fc640 1 -- 172.21.15.42:0/190854144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2544154330 con 0x7f254415ad80 2024-09-16T01:54:45.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f1aa359e640 1 -- 172.21.15.42:0/4200104121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a9c04eb60 msgr2=0x7f1a9c01d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f1aa359e640 1 --2- 172.21.15.42:0/4200104121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a9c04eb60 0x7f1a9c01d530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1aa406a6a0 tx=0x7f1aa40a63f0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f2542ffd640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544157ff0 0x7f2544154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f25437fe640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25441560a0 0x7f25441fbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f1aa359e640 1 -- 172.21.15.42:0/4200104121 shutdown_connections 2024-09-16T01:54:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f1aa359e640 1 --2- 172.21.15.42:0/4200104121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a9c04eb60 0x7f1a9c01d530 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f1aa359e640 1 --2- 172.21.15.42:0/4200104121 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a9c005a60 0x7f1a9c053f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f1aa359e640 1 -- 172.21.15.42:0/4200104121 >> 172.21.15.42:0/4200104121 conn(0x7f1a9c036090 msgr2=0x7f1a9c0364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.527+0000 7f8017eaf640 1 -- start start 2024-09-16T01:54:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f4fc4ff9640 1 -- 172.21.15.42:0/2547633389 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8015020 con 0x7f4fc80b2920 2024-09-16T01:54:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7fb3a5255640 1 Processor -- start 2024-09-16T01:54:45.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7fb3a5255640 1 -- start start 2024-09-16T01:54:45.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f88ebfff640 1 --2- 172.21.15.42:0/3974919282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88f40c5370 0x7f88f40c57b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f88f4073340 tx=0x7f88dc02a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba14adccdeecf052 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f635722b640 1 -- 172.21.15.42:0/3288511764 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6338005290 con 0x7f6348047c10 2024-09-16T01:54:45.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.529+0000 7f25427fc640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f254415ad80 0x7f25440b4f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f253400f7b0 tx=0x7f253400fc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.529+0000 7f6346ffd640 1 -- 172.21.15.42:0/3288511764 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f634c044070 con 0x7f6348047c10 2024-09-16T01:54:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.529+0000 7f88f27fc640 1 -- 172.21.15.42:0/3974919282 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc037070 con 0x7f88f40c5370 2024-09-16T01:54:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.529+0000 7f88f27fc640 1 -- 172.21.15.42:0/3974919282 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88dc02aca0 con 0x7f88f40c5370 2024-09-16T01:54:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.529+0000 7f88f27fc640 1 -- 172.21.15.42:0/3974919282 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc032660 con 0x7f88f40c5370 2024-09-16T01:54:45.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.529+0000 7f6346ffd640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f633406c380 0x7f633406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.528+0000 7f8017eaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80100b4d30 0x7f801013d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb3a5255640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a006c320 0x7fb3a00ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.529+0000 7f6346ffd640 1 -- 172.21.15.42:0/3288511764 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f634c0ac1f0 con 0x7f6348047c10 2024-09-16T01:54:45.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f4fcd620640 1 -- 172.21.15.42:0/2547633389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa8005290 con 0x7f4fc80b2920 2024-09-16T01:54:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f6356229640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f633406c380 0x7f633406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f88f97f8640 1 -- 172.21.15.42:0/3974919282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88f40c5370 msgr2=0x7f88f40c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f88f97f8640 1 --2- 172.21.15.42:0/3974919282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88f40c5370 0x7f88f40c57b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f88f4073340 tx=0x7f88dc02a010 comp rx=0 tx=0).stop 2024-09-16T01:54:45.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb3a5255640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a00ae030 0x7fb3a015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f8015c4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80100b4d30 0x7f801013d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f8015c4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80100b4d30 0x7f801013d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53530/0 (socket says 172.21.15.42:53530) 2024-09-16T01:54:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f8015c4b640 1 -- 172.21.15.42:0/1775757117 learned_addr learned my addr 172.21.15.42:0/1775757117 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb39ffff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a006c320 0x7fb3a00ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb39ffff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a006c320 0x7fb3a00ce4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:45654/0 (socket says 172.21.15.42:45654) 2024-09-16T01:54:45.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015a860 0x7f8010130650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb39ffff640 1 -- 172.21.15.42:0/919304413 learned_addr learned my addr 172.21.15.42:0/919304413 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f88f97f8640 1 -- 172.21.15.42:0/3974919282 shutdown_connections 2024-09-16T01:54:45.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f88f97f8640 1 --2- 172.21.15.42:0/3974919282 >> v2:172.21.15.107:3300/0 conn(0x7f88f40b2190 0x7f88f40b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f88f97f8640 1 --2- 172.21.15.42:0/3974919282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88f40c5370 0x7f88f40c57b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f88f97f8640 1 -- 172.21.15.42:0/3974919282 >> 172.21.15.42:0/3974919282 conn(0x7f88f40d23a0 msgr2=0x7f88f40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb3a5255640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a0162850 0x7fb3a0153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a00b23f0 con 0x7fb3a0162850 2024-09-16T01:54:45.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0162c30 con 0x7fb3a00ae030 2024-09-16T01:54:45.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a00b2570 con 0x7fb3a006c320 2024-09-16T01:54:45.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f801015ac40 0x7f80101405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f801544a640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015a860 0x7f8010130650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f801006ff20 con 0x7f80100b4d30 2024-09-16T01:54:45.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f801006fda0 con 0x7f801015ac40 2024-09-16T01:54:45.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f801006c320 con 0x7f801015a860 2024-09-16T01:54:45.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb3a4a54640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a0162850 0x7fb3a0153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7fb39f7fe640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a00ae030 0x7fb3a015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f1aa359e640 1 -- 172.21.15.42:0/4200104121 shutdown_connections 2024-09-16T01:54:45.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f1aa359e640 1 -- 172.21.15.42:0/4200104121 wait complete. 2024-09-16T01:54:45.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.530+0000 7f801644c640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f801015ac40 0x7f80101405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f252bfff640 1 -- 172.21.15.42:0/190854144 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534009c70 con 0x7f254415ad80 2024-09-16T01:54:45.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f6356229640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f633406c380 0x7f633406e840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6340001700 tx=0x7f6340009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f252bfff640 1 -- 172.21.15.42:0/190854144 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2534009e10 con 0x7f254415ad80 2024-09-16T01:54:45.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f2543fff640 1 -- 172.21.15.42:0/190854144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2544155000 con 0x7f254415ad80 2024-09-16T01:54:45.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f252bfff640 1 -- 172.21.15.42:0/190854144 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253401a680 con 0x7f254415ad80 2024-09-16T01:54:45.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f88f97f8640 1 -- 172.21.15.42:0/3974919282 shutdown_connections 2024-09-16T01:54:45.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7fb39ffff640 1 -- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a00ae030 msgr2=0x7fb3a015c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7fb39ffff640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a00ae030 0x7fb3a015c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7fb39ffff640 1 -- 172.21.15.42:0/919304413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a0162850 msgr2=0x7fb3a0153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7fb39ffff640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a0162850 0x7fb3a0153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7fb39ffff640 1 -- 172.21.15.42:0/919304413 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a00ced40 con 0x7fb3a006c320 2024-09-16T01:54:45.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f2543fff640 1 -- 172.21.15.42:0/190854144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25441555c0 con 0x7f254415ad80 2024-09-16T01:54:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7fb39ffff640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a006c320 0x7fb3a00ce4c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb39400e960 tx=0x7fb39400ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f801644c640 1 -- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015a860 msgr2=0x7f8010130650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f801644c640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015a860 0x7f8010130650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f801644c640 1 -- 172.21.15.42:0/1775757117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80100b4d30 msgr2=0x7f801013d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f801644c640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80100b4d30 0x7f801013d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f801644c640 1 -- 172.21.15.42:0/1775757117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8010130b90 con 0x7f801015ac40 2024-09-16T01:54:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f801544a640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015a860 0x7f8010130650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:45.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f4fc4ff9640 1 -- 172.21.15.42:0/2547633389 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4fb8018020 con 0x7f4fc80b2920 2024-09-16T01:54:45.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f8015c4b640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80100b4d30 0x7f801013d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:45.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f801644c640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f801015ac40 0x7f80101405c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f800800efc0 tx=0x7f800800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.531+0000 7f88f97f8640 1 -- 172.21.15.42:0/3974919282 wait complete. 2024-09-16T01:54:45.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.532+0000 7f4fc4ff9640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4fb406c6b0 0x7f4fb406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.532+0000 7f80067fc640 1 -- 172.21.15.42:0/1775757117 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008018020 con 0x7f801015ac40 2024-09-16T01:54:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.532+0000 7f80067fc640 1 -- 172.21.15.42:0/1775757117 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8008014480 con 0x7f801015ac40 2024-09-16T01:54:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.532+0000 7f80067fc640 1 -- 172.21.15.42:0/1775757117 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008014870 con 0x7f801015ac40 2024-09-16T01:54:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.532+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8010140ec0 con 0x7f801015ac40 2024-09-16T01:54:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.532+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80101e3670 con 0x7f801015ac40 2024-09-16T01:54:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.532+0000 7f4fc7fff640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4fb406c6b0 0x7f4fb406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.532+0000 7f2543fff640 1 -- 172.21.15.42:0/190854144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2544069730 con 0x7f254415ad80 2024-09-16T01:54:45.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.532+0000 7f4fc4ff9640 1 -- 172.21.15.42:0/2547633389 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4fb8011630 con 0x7f4fc80b2920 2024-09-16T01:54:45.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.533+0000 7f1aa359e640 1 Processor -- start 2024-09-16T01:54:45.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.533+0000 7f1aa359e640 1 -- start start 2024-09-16T01:54:45.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.533+0000 7f88f97f8640 1 Processor -- start 2024-09-16T01:54:45.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.533+0000 7f88f97f8640 1 -- start start 2024-09-16T01:54:45.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.533+0000 7f4fc7fff640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4fb406c6b0 0x7f4fb406eb70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc034000 tx=0x7f4fbc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80101e31a0 con 0x7f801015ac40 2024-09-16T01:54:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f252bfff640 1 -- 172.21.15.42:0/190854144 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f253401a820 con 0x7f254415ad80 2024-09-16T01:54:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f80067fc640 1 -- 172.21.15.42:0/1775757117 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8008005d10 con 0x7f801015ac40 2024-09-16T01:54:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f1aa359e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a9c005a60 0x7f1a9c038de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f88f97f8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88f40b2190 0x7f88f40c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f1aa359e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a9c04eb60 0x7f1a9c0dba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f1aa359e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a9c0e7120 0x7f1a9c0373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f1aa359e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c047b50 con 0x7f1a9c005a60 2024-09-16T01:54:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f1aa359e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c053a10 con 0x7f1a9c0e7120 2024-09-16T01:54:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f1aa359e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9c047cd0 con 0x7f1a9c04eb60 2024-09-16T01:54:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f80067fc640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ff406c300 0x7f7ff406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.534+0000 7f88f97f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88f4162ad0 0x7f88f4156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f80067fc640 1 -- 172.21.15.42:0/1775757117 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f800808c3f0 con 0x7f801015ac40 2024-09-16T01:54:45.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa2d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a9c0e7120 0x7f1a9c0373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f88f2ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88f40b2190 0x7f88f40c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f88f2ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88f40b2190 0x7f88f40c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51346/0 (socket says 172.21.15.42:51346) 2024-09-16T01:54:45.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa2d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a9c0e7120 0x7f1a9c0373d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:51360/0 (socket says 172.21.15.42:51360) 2024-09-16T01:54:45.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa2d9d640 1 -- 172.21.15.42:0/2816756742 learned_addr learned my addr 172.21.15.42:0/2816756742 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f88f2ffd640 1 -- 172.21.15.42:0/3459380968 learned_addr learned my addr 172.21.15.42:0/3459380968 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:45.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa1d9b640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a9c04eb60 0x7f1a9c0dba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f88f97f8640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88f40ce910 0x7f88f40c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f252bfff640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f253006c300 0x7f253006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f252bfff640 1 -- 172.21.15.42:0/190854144 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f253408bf40 con 0x7f254415ad80 2024-09-16T01:54:45.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f8015c4b640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ff406c300 0x7f7ff406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f88ebfff640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88f4162ad0 0x7f88f4156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88f409b990 con 0x7f88f4162ad0 2024-09-16T01:54:45.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f88f409b6b0 con 0x7f88f40b2190 2024-09-16T01:54:45.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f88f409bc70 con 0x7f88f40ce910 2024-09-16T01:54:45.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa259c640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a9c005a60 0x7f1a9c038de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa2d9d640 1 -- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a9c04eb60 msgr2=0x7f1a9c0dba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa2d9d640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a9c04eb60 0x7f1a9c0dba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f2542ffd640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f253006c300 0x7f253006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa2d9d640 1 -- 172.21.15.42:0/2816756742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a9c005a60 msgr2=0x7f1a9c038de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa2d9d640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a9c005a60 0x7f1a9c038de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa2d9d640 1 -- 172.21.15.42:0/2816756742 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c037d40 con 0x7f1a9c0e7120 2024-09-16T01:54:45.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f88f37fe640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88f40ce910 0x7f88f40c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.535+0000 7f1aa2d9d640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a9c0e7120 0x7f1a9c0373d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4051220 tx=0x7f1aa40699e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f8015c4b640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ff406c300 0x7f7ff406e7c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f800c009630 tx=0x7f800c012040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f2542ffd640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f253006c300 0x7f253006e7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f253c009990 tx=0x7f253c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88f37fe640 1 -- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88f40b2190 msgr2=0x7f88f40c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88f37fe640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88f40b2190 0x7f88f40c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88f37fe640 1 -- 172.21.15.42:0/3459380968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88f4162ad0 msgr2=0x7f88f4156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88f37fe640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88f4162ad0 0x7f88f4156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88f37fe640 1 -- 172.21.15.42:0/3459380968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f4160310 con 0x7f88f40ce910 2024-09-16T01:54:45.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88f2ffd640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88f40b2190 0x7f88f40c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:45.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88f37fe640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88f40ce910 0x7f88f40c5ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009d90 tx=0x7f88ec00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88eb7fe640 1 -- 172.21.15.42:0/3459380968 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00cd20 con 0x7f88f40ce910 2024-09-16T01:54:45.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7fb39cff9640 1 -- 172.21.15.42:0/919304413 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb394017070 con 0x7fb3a006c320 2024-09-16T01:54:45.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f41605f0 con 0x7f88f40ce910 2024-09-16T01:54:45.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88eb7fe640 1 -- 172.21.15.42:0/3459380968 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec003990 con 0x7f88f40ce910 2024-09-16T01:54:45.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.536+0000 7f88eb7fe640 1 -- 172.21.15.42:0/3459380968 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec003d40 con 0x7f88f40ce910 2024-09-16T01:54:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.537+0000 7fb39cff9640 1 -- 172.21.15.42:0/919304413 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39400ca00 con 0x7fb3a006c320 2024-09-16T01:54:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.537+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a015a5a0 con 0x7fb3a006c320 2024-09-16T01:54:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.537+0000 7f6346ffd640 1 -- 172.21.15.42:0/3288511764 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f634c07a160 con 0x7f6348047c10 2024-09-16T01:54:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.537+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f4156e50 con 0x7f88f40ce910 2024-09-16T01:54:45.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.537+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a015ab60 con 0x7fb3a006c320 2024-09-16T01:54:45.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.537+0000 7fb39cff9640 1 -- 172.21.15.42:0/919304413 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39400cdd0 con 0x7fb3a006c320 2024-09-16T01:54:45.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.538+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb380005290 con 0x7fb3a006c320 2024-09-16T01:54:45.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.538+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f41600a0 con 0x7f88f40ce910 2024-09-16T01:54:45.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.539+0000 7fb39cff9640 1 -- 172.21.15.42:0/919304413 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb39401a070 con 0x7fb3a006c320 2024-09-16T01:54:45.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.539+0000 7fb39cff9640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb38c06c2b0 0x7fb38c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.539+0000 7fb39f7fe640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb38c06c2b0 0x7fb38c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.540+0000 7fb39cff9640 1 -- 172.21.15.42:0/919304413 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb39408b960 con 0x7fb3a006c320 2024-09-16T01:54:45.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.540+0000 7f88eb7fe640 1 -- 172.21.15.42:0/3459380968 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f88ec005d10 con 0x7f88f40ce910 2024-09-16T01:54:45.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.540+0000 7fb39f7fe640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb38c06c2b0 0x7fb38c06e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00cf1d0 tx=0x7fb390009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.540+0000 7f88eb7fe640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88d406c2b0 0x7f88d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.540+0000 7f88eb7fe640 1 -- 172.21.15.42:0/3459380968 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f88ec08ca00 con 0x7f88f40ce910 2024-09-16T01:54:45.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.540+0000 7f88f2ffd640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88d406c2b0 0x7f88d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.541+0000 7f4fc4ff9640 1 -- 172.21.15.42:0/2547633389 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4fb801f020 con 0x7f4fc80b2920 2024-09-16T01:54:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.541+0000 7f88f2ffd640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88d406c2b0 0x7f88d406e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f88e40019e0 tx=0x7f88e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.542+0000 7f252bfff640 1 -- 172.21.15.42:0/190854144 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2544154330 con 0x7f254415ad80 2024-09-16T01:54:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.549+0000 7f88eb7fe640 1 -- 172.21.15.42:0/3459380968 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88ec010040 con 0x7f88f40ce910 2024-09-16T01:54:45.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.551+0000 7f1a92ffd640 1 -- 172.21.15.42:0/2816756742 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40b2040 con 0x7f1a9c0e7120 2024-09-16T01:54:45.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.552+0000 7f1a92ffd640 1 -- 172.21.15.42:0/2816756742 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa40ac860 con 0x7f1a9c0e7120 2024-09-16T01:54:45.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.552+0000 7f1a92ffd640 1 -- 172.21.15.42:0/2816756742 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40acc10 con 0x7f1a9c0e7120 2024-09-16T01:54:45.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.552+0000 7f1aa359e640 1 -- 172.21.15.42:0/2816756742 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9c038080 con 0x7f1a9c0e7120 2024-09-16T01:54:45.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.552+0000 7f1aa359e640 1 -- 172.21.15.42:0/2816756742 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a9c0388c0 con 0x7f1a9c0e7120 2024-09-16T01:54:45.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.552+0000 7f80067fc640 1 -- 172.21.15.42:0/1775757117 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8008022030 con 0x7f801015ac40 2024-09-16T01:54:45.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.553+0000 7f1aa359e640 1 -- 172.21.15.42:0/2816756742 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a9c038ac0 con 0x7f1a9c0e7120 2024-09-16T01:54:45.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.554+0000 7f1a92ffd640 1 -- 172.21.15.42:0/2816756742 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1aa40c1020 con 0x7f1a9c0e7120 2024-09-16T01:54:45.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.555+0000 7f1a92ffd640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1a8406c380 0x7f1a8406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:45.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.555+0000 7fb39cff9640 1 -- 172.21.15.42:0/919304413 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb394059730 con 0x7fb3a006c320 2024-09-16T01:54:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.555+0000 7f1a92ffd640 1 -- 172.21.15.42:0/2816756742 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1aa4127cd0 con 0x7f1a9c0e7120 2024-09-16T01:54:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.556+0000 7f1aa259c640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1a8406c380 0x7f1a8406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.556+0000 7f1aa259c640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1a8406c380 0x7f1a8406e840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c1801c0 tx=0x7f1a94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:45.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.559+0000 7f1a92ffd640 1 -- 172.21.15.42:0/2816756742 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a9c038ac0 con 0x7f1a9c0e7120 2024-09-16T01:54:45.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.854+0000 7efcdde5e640 1 -- 172.21.15.42:0/1290912215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7efcb8005850 con 0x7efcd8158980 2024-09-16T01:54:45.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.855+0000 7efcbffff640 1 -- 172.21.15.42:0/1290912215 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efcc807b6b0 con 0x7efcd8158980 2024-09-16T01:54:45.857 INFO:teuthology.orchestra.run.smithi042.stdout:55834574858 2024-09-16T01:54:45.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.858+0000 7efcbdffb640 1 -- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcc406c380 msgr2=0x7efcc406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.858+0000 7efcbdffb640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcc406c380 0x7efcc406e840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efcd806b190 tx=0x7efccc006f90 comp rx=0 tx=0).stop 2024-09-16T01:54:45.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.858+0000 7efcbdffb640 1 -- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd8158980 msgr2=0x7efcd81514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.858+0000 7efcbdffb640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd8158980 0x7efcd81514a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009fd0 tx=0x7efcc800b7a0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.859+0000 7efcbdffb640 1 -- 172.21.15.42:0/1290912215 shutdown_connections 2024-09-16T01:54:45.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.859+0000 7efcbdffb640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcc406c380 0x7efcc406e840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.859+0000 7efcbdffb640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcd80b2100 0x7efcd8152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.859+0000 7efcbdffb640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efcd8158d60 0x7efcd81519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.859+0000 7efcbdffb640 1 --2- 172.21.15.42:0/1290912215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efcd8158980 0x7efcd81514a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.859+0000 7efcbdffb640 1 -- 172.21.15.42:0/1290912215 >> 172.21.15.42:0/1290912215 conn(0x7efcd8067b30 msgr2=0x7efcd815b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.859+0000 7efcbdffb640 1 -- 172.21.15.42:0/1290912215 shutdown_connections 2024-09-16T01:54:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.859+0000 7efcbdffb640 1 -- 172.21.15.42:0/1290912215 wait complete. 2024-09-16T01:54:45.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-09-16T01:54:45.880 DEBUG:teuthology.parallel:result is None 2024-09-16T01:54:45.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.905+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f88f40d30c0 con 0x7f88f40ce910 2024-09-16T01:54:45.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.906+0000 7f88eb7fe640 1 -- 172.21.15.42:0/3459380968 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f88ec05ae30 con 0x7f88f40ce910 2024-09-16T01:54:45.908 INFO:teuthology.orchestra.run.smithi042.stdout:64424509450 2024-09-16T01:54:45.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88d406c2b0 msgr2=0x7f88d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88d406c2b0 0x7f88d406e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f88e40019e0 tx=0x7f88e4009040 comp rx=0 tx=0).stop 2024-09-16T01:54:45.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88f40ce910 msgr2=0x7f88f40c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88f40ce910 0x7f88f40c5ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009d90 tx=0x7f88ec00c490 comp rx=0 tx=0).stop 2024-09-16T01:54:45.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 shutdown_connections 2024-09-16T01:54:45.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88d406c2b0 0x7f88d406e770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88f40ce910 0x7f88f40c5ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88f4162ad0 0x7f88f4156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 --2- 172.21.15.42:0/3459380968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88f40b2190 0x7f88f40c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 >> 172.21.15.42:0/3459380968 conn(0x7f88f40d23a0 msgr2=0x7f88f40af990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 shutdown_connections 2024-09-16T01:54:45.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.908+0000 7f88f97f8640 1 -- 172.21.15.42:0/3459380968 wait complete. 2024-09-16T01:54:45.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-09-16T01:54:45.922 DEBUG:teuthology.parallel:result is None 2024-09-16T01:54:45.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.945+0000 7f2543fff640 1 -- 172.21.15.42:0/190854144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f25441598b0 con 0x7f254415ad80 2024-09-16T01:54:45.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.945+0000 7f252bfff640 1 -- 172.21.15.42:0/190854144 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2534059fb0 con 0x7f254415ad80 2024-09-16T01:54:45.948 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-09-16T01:54:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 -- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f253006c300 msgr2=0x7f253006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f253006c300 0x7f253006e7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f253c009990 tx=0x7f253c009000 comp rx=0 tx=0).stop 2024-09-16T01:54:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 -- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f254415ad80 msgr2=0x7f25440b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f254415ad80 0x7f25440b4f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f253400f7b0 tx=0x7f253400fc70 comp rx=0 tx=0).stop 2024-09-16T01:54:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 -- 172.21.15.42:0/190854144 shutdown_connections 2024-09-16T01:54:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f253006c300 0x7f253006e7c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25441560a0 0x7f25441fbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f254415ad80 0x7f25440b4f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 --2- 172.21.15.42:0/190854144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2544157ff0 0x7f2544154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 -- 172.21.15.42:0/190854144 >> 172.21.15.42:0/190854144 conn(0x7f254406f560 msgr2=0x7f254406dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 -- 172.21.15.42:0/190854144 shutdown_connections 2024-09-16T01:54:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.949+0000 7f2543fff640 1 -- 172.21.15.42:0/190854144 wait complete. 2024-09-16T01:54:45.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.953+0000 7f635722b640 1 -- 172.21.15.42:0/3288511764 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6338005580 con 0x7f6348047c10 2024-09-16T01:54:45.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.953+0000 7f6346ffd640 1 -- 172.21.15.42:0/3288511764 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f634c07e460 con 0x7f6348047c10 2024-09-16T01:54:45.955 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-09-16T01:54:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 -- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f633406c380 msgr2=0x7f633406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f633406c380 0x7f633406e840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6340001700 tx=0x7f6340009040 comp rx=0 tx=0).stop 2024-09-16T01:54:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 -- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6348047c10 msgr2=0x7f63480d9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6348047c10 0x7f63480d9a00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f634c009870 tx=0x7f634c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 -- 172.21.15.42:0/3288511764 shutdown_connections 2024-09-16T01:54:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f633406c380 0x7f633406e840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63480e6f80 0x7f6348050460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6348047c10 0x7f63480d9a00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 --2- 172.21.15.42:0/3288511764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6348033a00 0x7f634804fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 -- 172.21.15.42:0/3288511764 >> 172.21.15.42:0/3288511764 conn(0x7f634801d930 msgr2=0x7f6348006480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 -- 172.21.15.42:0/3288511764 shutdown_connections 2024-09-16T01:54:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.956+0000 7f635722b640 1 -- 172.21.15.42:0/3288511764 wait complete. 2024-09-16T01:54:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.957+0000 7f4fcd620640 1 -- 172.21.15.42:0/2547633389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4fa8005850 con 0x7f4fc80b2920 2024-09-16T01:54:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.958+0000 7f4fc4ff9640 1 -- 172.21.15.42:0/2547633389 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4fb8058ca0 con 0x7f4fc80b2920 2024-09-16T01:54:45.961 INFO:teuthology.orchestra.run.smithi042.stdout:64424509450 2024-09-16T01:54:45.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f801006ce20 con 0x7f801015ac40 2024-09-16T01:54:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 -- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4fb406c6b0 msgr2=0x7f4fb406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4fb406c6b0 0x7f4fb406eb70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc034000 tx=0x7f4fbc02e000 comp rx=0 tx=0).stop 2024-09-16T01:54:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 -- 172.21.15.42:0/2547633389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fc80b2920 msgr2=0x7f4fc8144130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fc80b2920 0x7f4fc8144130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800b3e0 tx=0x7f4fb800b8a0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 -- 172.21.15.42:0/2547633389 shutdown_connections 2024-09-16T01:54:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4fb406c6b0 0x7f4fb406eb70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4fc815d4c0 0x7f4fc80b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fc80b2920 0x7f4fc8144130 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 --2- 172.21.15.42:0/2547633389 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc806f820 0x7f4fc81fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 -- 172.21.15.42:0/2547633389 >> 172.21.15.42:0/2547633389 conn(0x7f4fc80b1e00 msgr2=0x7f4fc80b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 -- 172.21.15.42:0/2547633389 shutdown_connections 2024-09-16T01:54:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f4fcd620640 1 -- 172.21.15.42:0/2547633389 wait complete. 2024-09-16T01:54:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.961+0000 7f80067fc640 1 -- 172.21.15.42:0/1775757117 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8008010040 con 0x7f801015ac40 2024-09-16T01:54:45.965 INFO:teuthology.orchestra.run.smithi042.stdout:64424509450 2024-09-16T01:54:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.963+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb380005580 con 0x7fb3a006c320 2024-09-16T01:54:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.963+0000 7fb39cff9640 1 -- 172.21.15.42:0/919304413 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb39405da30 con 0x7fb3a006c320 2024-09-16T01:54:45.966 INFO:teuthology.orchestra.run.smithi042.stdout:64424509449 2024-09-16T01:54:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ff406c300 msgr2=0x7f7ff406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ff406c300 0x7f7ff406e7c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f800c009630 tx=0x7f800c012040 comp rx=0 tx=0).stop 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f801015ac40 msgr2=0x7f80101405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f801015ac40 0x7f80101405c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f800800efc0 tx=0x7f800800c490 comp rx=0 tx=0).stop 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 shutdown_connections 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7ff406c300 0x7f7ff406e7c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f801015ac40 0x7f80101405c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f801015a860 0x7f8010130650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 --2- 172.21.15.42:0/1775757117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80100b4d30 0x7f801013d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 >> 172.21.15.42:0/1775757117 conn(0x7f8010067d70 msgr2=0x7f80100b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 shutdown_connections 2024-09-16T01:54:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.965+0000 7f8017eaf640 1 -- 172.21.15.42:0/1775757117 wait complete. 2024-09-16T01:54:45.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2024-09-16T01:54:45.970 DEBUG:teuthology.parallel:result is None 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.967+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb38c06c2b0 msgr2=0x7fb38c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.967+0000 7fb3a5255640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb38c06c2b0 0x7fb38c06e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00cf1d0 tx=0x7fb390009040 comp rx=0 tx=0).stop 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.967+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a006c320 msgr2=0x7fb3a00ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.967+0000 7fb3a5255640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a006c320 0x7fb3a00ce4c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb39400e960 tx=0x7fb39400ee20 comp rx=0 tx=0).stop 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.967+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 shutdown_connections 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.967+0000 7fb3a5255640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb38c06c2b0 0x7fb38c06e770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.967+0000 7fb3a5255640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3a0162850 0x7fb3a0153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.967+0000 7fb3a5255640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb3a00ae030 0x7fb3a015c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.967+0000 7fb3a5255640 1 --2- 172.21.15.42:0/919304413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb3a006c320 0x7fb3a00ce4c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.967+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 >> 172.21.15.42:0/919304413 conn(0x7fb3a009aa30 msgr2=0x7fb3a006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.968+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 shutdown_connections 2024-09-16T01:54:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.968+0000 7fb3a5255640 1 -- 172.21.15.42:0/919304413 wait complete. 2024-09-16T01:54:45.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.969+0000 7f1aa359e640 1 -- 172.21.15.42:0/2816756742 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1a9c047600 con 0x7f1a9c0e7120 2024-09-16T01:54:45.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.970+0000 7f1a92ffd640 1 -- 172.21.15.42:0/2816756742 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1aa412d020 con 0x7f1a9c0e7120 2024-09-16T01:54:45.972 INFO:teuthology.orchestra.run.smithi042.stdout:55834574858 2024-09-16T01:54:45.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-16T01:54:45.976 DEBUG:teuthology.parallel:result is None 2024-09-16T01:54:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.973+0000 7f1aa359e640 1 -- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1a8406c380 msgr2=0x7f1a8406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.973+0000 7f1aa359e640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1a8406c380 0x7f1a8406e840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c1801c0 tx=0x7f1a94008040 comp rx=0 tx=0).stop 2024-09-16T01:54:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.973+0000 7f1aa359e640 1 -- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a9c0e7120 msgr2=0x7f1a9c0373d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.973+0000 7f1aa359e640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a9c0e7120 0x7f1a9c0373d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4051220 tx=0x7f1aa40699e0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.973+0000 7f1aa359e640 1 -- 172.21.15.42:0/2816756742 shutdown_connections 2024-09-16T01:54:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.973+0000 7f1aa359e640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1a8406c380 0x7f1a8406e840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.973+0000 7f1aa359e640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a9c0e7120 0x7f1a9c0373d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.973+0000 7f1aa359e640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a9c04eb60 0x7f1a9c0dba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.973+0000 7f1aa359e640 1 --2- 172.21.15.42:0/2816756742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a9c005a60 0x7f1a9c038de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.973+0000 7f1aa359e640 1 -- 172.21.15.42:0/2816756742 >> 172.21.15.42:0/2816756742 conn(0x7f1a9c036090 msgr2=0x7f1a9c031e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.974+0000 7f1aa359e640 1 -- 172.21.15.42:0/2816756742 shutdown_connections 2024-09-16T01:54:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:45.974+0000 7f1aa359e640 1 -- 172.21.15.42:0/2816756742 wait complete. 2024-09-16T01:54:45.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2024-09-16T01:54:45.984 DEBUG:teuthology.parallel:result is None 2024-09-16T01:54:45.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2024-09-16T01:54:45.984 DEBUG:teuthology.parallel:result is None 2024-09-16T01:54:45.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-16T01:54:45.989 DEBUG:teuthology.parallel:result is None 2024-09-16T01:54:45.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-09-16T01:54:45.989 DEBUG:teuthology.parallel:result is None 2024-09-16T01:54:45.989 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:54:45.989 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:54:46.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.129+0000 7fda803d6640 1 Processor -- start 2024-09-16T01:54:46.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.129+0000 7fda803d6640 1 -- start start 2024-09-16T01:54:46.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda803d6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fda78147360 0x7fda78070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda803d6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fda780d0bb0 0x7fda780ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda803d6640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda7806cb30 con 0x7fda78070dd0 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda803d6640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fda7806bfb0 con 0x7fda780d0bb0 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda803d6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fda7806c290 con 0x7fda78147360 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda7e973640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fda780d0bb0 0x7fda780ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda7d971640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fda78070dd0 0x7fda780d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45512/0 (socket says 172.21.15.42:45512) 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda7d971640 1 -- 172.21.15.42:0/743397378 learned_addr learned my addr 172.21.15.42:0/743397378 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda7e172640 1 --2- 172.21.15.42:0/743397378 >> v2:172.21.15.107:3300/0 conn(0x7fda78147360 0x7fda78070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda7e973640 1 -- 172.21.15.42:0/743397378 >> v2:172.21.15.107:3300/0 conn(0x7fda78147360 msgr2=0x7fda78070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda7e973640 1 --2- 172.21.15.42:0/743397378 >> v2:172.21.15.107:3300/0 conn(0x7fda78147360 0x7fda78070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda7e973640 1 -- 172.21.15.42:0/743397378 >> v1:172.21.15.42:6789/0 conn(0x7fda78070dd0 legacy=0x7fda780d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda7d170640 1 -- 172.21.15.42:0/743397378 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113580316 0 0) 0x7fda7806cb30 con 0x7fda78070dd0 2024-09-16T01:54:46.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda7e973640 1 -- 172.21.15.42:0/743397378 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7806c570 con 0x7fda780d0bb0 2024-09-16T01:54:46.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.130+0000 7fda7e172640 1 --2- 172.21.15.42:0/743397378 >> v2:172.21.15.107:3300/0 conn(0x7fda78147360 0x7fda78070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:46.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.131+0000 7fda7e973640 1 --2- 172.21.15.42:0/743397378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda780d0bb0 0x7fda780ae550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fda781483f0 tx=0x7fda7002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be785576a2aacd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:46.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.131+0000 7fda7d170640 1 -- 172.21.15.42:0/743397378 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda70037070 con 0x7fda780d0bb0 2024-09-16T01:54:46.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.131+0000 7fda7d170640 1 -- 172.21.15.42:0/743397378 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7002add0 con 0x7fda780d0bb0 2024-09-16T01:54:46.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.131+0000 7fda7d170640 1 -- 172.21.15.42:0/743397378 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda70032660 con 0x7fda780d0bb0 2024-09-16T01:54:46.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.132+0000 7fda803d6640 1 -- 172.21.15.42:0/743397378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda780d0bb0 msgr2=0x7fda780ae550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.132+0000 7fda803d6640 1 --2- 172.21.15.42:0/743397378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda780d0bb0 0x7fda780ae550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fda781483f0 tx=0x7fda7002a080 comp rx=0 tx=0).stop 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.132+0000 7fda803d6640 1 -- 172.21.15.42:0/743397378 shutdown_connections 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.132+0000 7fda803d6640 1 --2- 172.21.15.42:0/743397378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda780d0bb0 0x7fda780ae550 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.132+0000 7fda803d6640 1 --2- 172.21.15.42:0/743397378 >> v2:172.21.15.107:3300/0 conn(0x7fda78147360 0x7fda78070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.132+0000 7fda803d6640 1 -- 172.21.15.42:0/743397378 >> 172.21.15.42:0/743397378 conn(0x7fda780b2f40 msgr2=0x7fda780b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.132+0000 7fda803d6640 1 -- 172.21.15.42:0/743397378 shutdown_connections 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.132+0000 7fda803d6640 1 -- 172.21.15.42:0/743397378 wait complete. 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.133+0000 7fda803d6640 1 Processor -- start 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.133+0000 7fda803d6640 1 -- start start 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda803d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda78070dd0 0x7fda7815c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda803d6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda780d0bb0 0x7fda781415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda803d6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda78147360 0x7fda7815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda803d6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fda7806bd90 con 0x7fda78070dd0 2024-09-16T01:54:46.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda803d6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fda7806bc10 con 0x7fda780d0bb0 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda803d6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fda780aea90 con 0x7fda78147360 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda7e172640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda78070dd0 0x7fda7815c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda7e172640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda78070dd0 0x7fda7815c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53572/0 (socket says 172.21.15.42:53572) 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda7e172640 1 -- 172.21.15.42:0/2219200270 learned_addr learned my addr 172.21.15.42:0/2219200270 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda7e973640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda78147360 0x7fda7815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda7d971640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda780d0bb0 0x7fda781415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda7e172640 1 -- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda78147360 msgr2=0x7fda7815ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda7e172640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda78147360 0x7fda7815ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda7e172640 1 -- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda780d0bb0 msgr2=0x7fda781415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda7e172640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda780d0bb0 0x7fda781415b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.134+0000 7fda7e172640 1 -- 172.21.15.42:0/2219200270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7815c510 con 0x7fda78070dd0 2024-09-16T01:54:46.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.135+0000 7fda7e172640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda78070dd0 0x7fda7815c700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda74007f20 tx=0x7fda7400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:46.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.135+0000 7fda6effd640 1 -- 172.21.15.42:0/2219200270 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7401a070 con 0x7fda78070dd0 2024-09-16T01:54:46.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.135+0000 7fda6effd640 1 -- 172.21.15.42:0/2219200270 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda74003b90 con 0x7fda78070dd0 2024-09-16T01:54:46.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.135+0000 7fda6effd640 1 -- 172.21.15.42:0/2219200270 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74004030 con 0x7fda78070dd0 2024-09-16T01:54:46.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.135+0000 7fda803d6640 1 -- 172.21.15.42:0/2219200270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7815de00 con 0x7fda78070dd0 2024-09-16T01:54:46.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.135+0000 7fda803d6640 1 -- 172.21.15.42:0/2219200270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7815e3c0 con 0x7fda78070dd0 2024-09-16T01:54:46.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.136+0000 7fda803d6640 1 -- 172.21.15.42:0/2219200270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda780ae550 con 0x7fda78070dd0 2024-09-16T01:54:46.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.136+0000 7fda6effd640 1 -- 172.21.15.42:0/2219200270 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda7401d070 con 0x7fda78070dd0 2024-09-16T01:54:46.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.137+0000 7fda6effd640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fda5c06c2b0 0x7fda5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.137+0000 7fda6effd640 1 -- 172.21.15.42:0/2219200270 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fda7408b980 con 0x7fda78070dd0 2024-09-16T01:54:46.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.137+0000 7fda7d971640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fda5c06c2b0 0x7fda5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.137+0000 7fda7d971640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fda5c06c2b0 0x7fda5c06e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda78143b60 tx=0x7fda68007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:46.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.141+0000 7fda6effd640 1 -- 172.21.15.42:0/2219200270 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda74010070 con 0x7fda78070dd0 2024-09-16T01:54:46.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.313+0000 7fda803d6640 1 -- 172.21.15.42:0/2219200270 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda780b0eb0 con 0x7fda5c06c2b0 2024-09-16T01:54:46.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.321+0000 7fda6effd640 1 -- 172.21.15.42:0/2219200270 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fda780b0eb0 con 0x7fda5c06c2b0 2024-09-16T01:54:46.327 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:46.328 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:54:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 -- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fda5c06c2b0 msgr2=0x7fda5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fda5c06c2b0 0x7fda5c06e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda78143b60 tx=0x7fda68007b50 comp rx=0 tx=0).stop 2024-09-16T01:54:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 -- 172.21.15.42:0/2219200270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda78070dd0 msgr2=0x7fda7815c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda78070dd0 0x7fda7815c700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda74007f20 tx=0x7fda7400d560 comp rx=0 tx=0).stop 2024-09-16T01:54:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 -- 172.21.15.42:0/2219200270 shutdown_connections 2024-09-16T01:54:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fda5c06c2b0 0x7fda5c06e770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda78147360 0x7fda7815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda780d0bb0 0x7fda781415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 --2- 172.21.15.42:0/2219200270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda78070dd0 0x7fda7815c700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 -- 172.21.15.42:0/2219200270 >> 172.21.15.42:0/2219200270 conn(0x7fda780b2f40 msgr2=0x7fda780af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 -- 172.21.15.42:0/2219200270 shutdown_connections 2024-09-16T01:54:46.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.324+0000 7fda803d6640 1 -- 172.21.15.42:0/2219200270 wait complete. 2024-09-16T01:54:46.337 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-16T01:54:46.255344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236100,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738620,"statfs":{"total":773094113280,"available":772852346880,"internally_reserved":0,"allocated":3317760,"data_stored":2009724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003131"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145216+0000","last_change":"2024-09-16T01:54:20.860255+0000","last_active":"2024-09-16T01:54:28.145216+0000","last_peered":"2024-09-16T01:54:28.145216+0000","last_clean":"2024-09-16T01:54:28.145216+0000","last_became_active":"2024-09-16T01:54:20.859944+0000","last_became_peered":"2024-09-16T01:54:20.859944+0000","last_unstale":"2024-09-16T01:54:28.145216+0000","last_undegraded":"2024-09-16T01:54:28.145216+0000","last_fullsized":"2024-09-16T01:54:28.145216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:39.081955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899508+0000","last_change":"2024-09-16T01:54:21.859551+0000","last_active":"2024-09-16T01:54:26.899508+0000","last_peered":"2024-09-16T01:54:26.899508+0000","last_clean":"2024-09-16T01:54:26.899508+0000","last_became_active":"2024-09-16T01:54:21.858047+0000","last_became_peered":"2024-09-16T01:54:21.858047+0000","last_unstale":"2024-09-16T01:54:26.899508+0000","last_undegraded":"2024-09-16T01:54:26.899508+0000","last_fullsized":"2024-09-16T01:54:26.899508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:29.948383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898563+0000","last_change":"2024-09-16T01:54:25.964125+0000","last_active":"2024-09-16T01:54:26.898563+0000","last_peered":"2024-09-16T01:54:26.898563+0000","last_clean":"2024-09-16T01:54:26.898563+0000","last_became_active":"2024-09-16T01:54:25.963738+0000","last_became_peered":"2024-09-16T01:54:25.963738+0000","last_unstale":"2024-09-16T01:54:26.898563+0000","last_undegraded":"2024-09-16T01:54:26.898563+0000","last_fullsized":"2024-09-16T01:54:26.898563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:06.129448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899601+0000","last_change":"2024-09-16T01:54:20.861025+0000","last_active":"2024-09-16T01:54:26.899601+0000","last_peered":"2024-09-16T01:54:26.899601+0000","last_clean":"2024-09-16T01:54:26.899601+0000","last_became_active":"2024-09-16T01:54:20.858817+0000","last_became_peered":"2024-09-16T01:54:20.858817+0000","last_unstale":"2024-09-16T01:54:26.899601+0000","last_undegraded":"2024-09-16T01:54:26.899601+0000","last_fullsized":"2024-09-16T01:54:26.899601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144849+0000","last_change":"2024-09-16T01:54:21.867670+0000","last_active":"2024-09-16T01:54:28.144849+0000","last_peered":"2024-09-16T01:54:28.144849+0000","last_clean":"2024-09-16T01:54:28.144849+0000","last_became_active":"2024-09-16T01:54:21.866666+0000","last_became_peered":"2024-09-16T01:54:21.866666+0000","last_unstale":"2024-09-16T01:54:28.144849+0000","last_undegraded":"2024-09-16T01:54:28.144849+0000","last_fullsized":"2024-09-16T01:54:28.144849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899530+0000","last_change":"2024-09-16T01:54:25.877304+0000","last_active":"2024-09-16T01:54:26.899530+0000","last_peered":"2024-09-16T01:54:26.899530+0000","last_clean":"2024-09-16T01:54:26.899530+0000","last_became_active":"2024-09-16T01:54:25.876643+0000","last_became_peered":"2024-09-16T01:54:25.876643+0000","last_unstale":"2024-09-16T01:54:26.899530+0000","last_undegraded":"2024-09-16T01:54:26.899530+0000","last_fullsized":"2024-09-16T01:54:26.899530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:15.866095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145670+0000","last_change":"2024-09-16T01:54:20.860557+0000","last_active":"2024-09-16T01:54:28.145670+0000","last_peered":"2024-09-16T01:54:28.145670+0000","last_clean":"2024-09-16T01:54:28.145670+0000","last_became_active":"2024-09-16T01:54:20.860254+0000","last_became_peered":"2024-09-16T01:54:20.860254+0000","last_unstale":"2024-09-16T01:54:28.145670+0000","last_undegraded":"2024-09-16T01:54:28.145670+0000","last_fullsized":"2024-09-16T01:54:28.145670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:16.893601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678222+0000","last_change":"2024-09-16T01:54:21.860466+0000","last_active":"2024-09-16T01:54:27.678222+0000","last_peered":"2024-09-16T01:54:27.678222+0000","last_clean":"2024-09-16T01:54:27.678222+0000","last_became_active":"2024-09-16T01:54:21.860191+0000","last_became_peered":"2024-09-16T01:54:21.860191+0000","last_unstale":"2024-09-16T01:54:27.678222+0000","last_undegraded":"2024-09-16T01:54:27.678222+0000","last_fullsized":"2024-09-16T01:54:27.678222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:47.165464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899752+0000","last_change":"2024-09-16T01:54:25.877667+0000","last_active":"2024-09-16T01:54:26.899752+0000","last_peered":"2024-09-16T01:54:26.899752+0000","last_clean":"2024-09-16T01:54:26.899752+0000","last_became_active":"2024-09-16T01:54:25.876568+0000","last_became_peered":"2024-09-16T01:54:25.876568+0000","last_unstale":"2024-09-16T01:54:26.899752+0000","last_undegraded":"2024-09-16T01:54:26.899752+0000","last_fullsized":"2024-09-16T01:54:26.899752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:33.969016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145351+0000","last_change":"2024-09-16T01:54:20.862062+0000","last_active":"2024-09-16T01:54:28.145351+0000","last_peered":"2024-09-16T01:54:28.145351+0000","last_clean":"2024-09-16T01:54:28.145351+0000","last_became_active":"2024-09-16T01:54:20.861764+0000","last_became_peered":"2024-09-16T01:54:20.861764+0000","last_unstale":"2024-09-16T01:54:28.145351+0000","last_undegraded":"2024-09-16T01:54:28.145351+0000","last_fullsized":"2024-09-16T01:54:28.145351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:02.378815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678304+0000","last_change":"2024-09-16T01:54:21.857448+0000","last_active":"2024-09-16T01:54:27.678304+0000","last_peered":"2024-09-16T01:54:27.678304+0000","last_clean":"2024-09-16T01:54:27.678304+0000","last_became_active":"2024-09-16T01:54:21.857131+0000","last_became_peered":"2024-09-16T01:54:21.857131+0000","last_unstale":"2024-09-16T01:54:27.678304+0000","last_undegraded":"2024-09-16T01:54:27.678304+0000","last_fullsized":"2024-09-16T01:54:27.678304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:46.608693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899648+0000","last_change":"2024-09-16T01:54:25.873795+0000","last_active":"2024-09-16T01:54:26.899648+0000","last_peered":"2024-09-16T01:54:26.899648+0000","last_clean":"2024-09-16T01:54:26.899648+0000","last_became_active":"2024-09-16T01:54:25.873379+0000","last_became_peered":"2024-09-16T01:54:25.873379+0000","last_unstale":"2024-09-16T01:54:26.899648+0000","last_undegraded":"2024-09-16T01:54:26.899648+0000","last_fullsized":"2024-09-16T01:54:26.899648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:43.663709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144634+0000","last_change":"2024-09-16T01:54:21.858785+0000","last_active":"2024-09-16T01:54:28.144634+0000","last_peered":"2024-09-16T01:54:28.144634+0000","last_clean":"2024-09-16T01:54:28.144634+0000","last_became_active":"2024-09-16T01:54:21.858450+0000","last_became_peered":"2024-09-16T01:54:21.858450+0000","last_unstale":"2024-09-16T01:54:28.144634+0000","last_undegraded":"2024-09-16T01:54:28.144634+0000","last_fullsized":"2024-09-16T01:54:28.144634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145654+0000","last_change":"2024-09-16T01:54:20.859619+0000","last_active":"2024-09-16T01:54:28.145654+0000","last_peered":"2024-09-16T01:54:28.145654+0000","last_clean":"2024-09-16T01:54:28.145654+0000","last_became_active":"2024-09-16T01:54:20.859348+0000","last_became_peered":"2024-09-16T01:54:20.859348+0000","last_unstale":"2024-09-16T01:54:28.145654+0000","last_undegraded":"2024-09-16T01:54:28.145654+0000","last_fullsized":"2024-09-16T01:54:28.145654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:32.717638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899990+0000","last_change":"2024-09-16T01:54:25.876988+0000","last_active":"2024-09-16T01:54:26.899990+0000","last_peered":"2024-09-16T01:54:26.899990+0000","last_clean":"2024-09-16T01:54:26.899990+0000","last_became_active":"2024-09-16T01:54:25.876405+0000","last_became_peered":"2024-09-16T01:54:25.876405+0000","last_unstale":"2024-09-16T01:54:26.899990+0000","last_undegraded":"2024-09-16T01:54:26.899990+0000","last_fullsized":"2024-09-16T01:54:26.899990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:51.186097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898948+0000","last_change":"2024-09-16T01:54:21.866597+0000","last_active":"2024-09-16T01:54:26.898948+0000","last_peered":"2024-09-16T01:54:26.898948+0000","last_clean":"2024-09-16T01:54:26.898948+0000","last_became_active":"2024-09-16T01:54:21.866303+0000","last_became_peered":"2024-09-16T01:54:21.866303+0000","last_unstale":"2024-09-16T01:54:26.898948+0000","last_undegraded":"2024-09-16T01:54:26.898948+0000","last_fullsized":"2024-09-16T01:54:26.898948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:57.597318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644331+0000","last_change":"2024-09-16T01:54:20.851271+0000","last_active":"2024-09-16T01:54:27.644331+0000","last_peered":"2024-09-16T01:54:27.644331+0000","last_clean":"2024-09-16T01:54:27.644331+0000","last_became_active":"2024-09-16T01:54:20.850597+0000","last_became_peered":"2024-09-16T01:54:20.850597+0000","last_unstale":"2024-09-16T01:54:27.644331+0000","last_undegraded":"2024-09-16T01:54:27.644331+0000","last_fullsized":"2024-09-16T01:54:27.644331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900473+0000","last_change":"2024-09-16T01:54:25.876997+0000","last_active":"2024-09-16T01:54:26.900473+0000","last_peered":"2024-09-16T01:54:26.900473+0000","last_clean":"2024-09-16T01:54:26.900473+0000","last_became_active":"2024-09-16T01:54:25.876501+0000","last_became_peered":"2024-09-16T01:54:25.876501+0000","last_unstale":"2024-09-16T01:54:26.900473+0000","last_undegraded":"2024-09-16T01:54:26.900473+0000","last_fullsized":"2024-09-16T01:54:26.900473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899001+0000","last_change":"2024-09-16T01:54:21.852096+0000","last_active":"2024-09-16T01:54:26.899001+0000","last_peered":"2024-09-16T01:54:26.899001+0000","last_clean":"2024-09-16T01:54:26.899001+0000","last_became_active":"2024-09-16T01:54:21.848364+0000","last_became_peered":"2024-09-16T01:54:21.848364+0000","last_unstale":"2024-09-16T01:54:26.899001+0000","last_undegraded":"2024-09-16T01:54:26.899001+0000","last_fullsized":"2024-09-16T01:54:26.899001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643861+0000","last_change":"2024-09-16T01:54:20.852050+0000","last_active":"2024-09-16T01:54:27.643861+0000","last_peered":"2024-09-16T01:54:27.643861+0000","last_clean":"2024-09-16T01:54:27.643861+0000","last_became_active":"2024-09-16T01:54:20.851725+0000","last_became_peered":"2024-09-16T01:54:20.851725+0000","last_unstale":"2024-09-16T01:54:27.643861+0000","last_undegraded":"2024-09-16T01:54:27.643861+0000","last_fullsized":"2024-09-16T01:54:27.643861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644337+0000","last_change":"2024-09-16T01:54:25.962379+0000","last_active":"2024-09-16T01:54:27.644337+0000","last_peered":"2024-09-16T01:54:27.644337+0000","last_clean":"2024-09-16T01:54:27.644337+0000","last_became_active":"2024-09-16T01:54:25.961815+0000","last_became_peered":"2024-09-16T01:54:25.961815+0000","last_unstale":"2024-09-16T01:54:27.644337+0000","last_undegraded":"2024-09-16T01:54:27.644337+0000","last_fullsized":"2024-09-16T01:54:27.644337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:58.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900426+0000","last_change":"2024-09-16T01:54:21.846558+0000","last_active":"2024-09-16T01:54:26.900426+0000","last_peered":"2024-09-16T01:54:26.900426+0000","last_clean":"2024-09-16T01:54:26.900426+0000","last_became_active":"2024-09-16T01:54:21.846226+0000","last_became_peered":"2024-09-16T01:54:21.846226+0000","last_unstale":"2024-09-16T01:54:26.900426+0000","last_undegraded":"2024-09-16T01:54:26.900426+0000","last_fullsized":"2024-09-16T01:54:26.900426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:22.658145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144908+0000","last_change":"2024-09-16T01:54:20.857121+0000","last_active":"2024-09-16T01:54:28.144908+0000","last_peered":"2024-09-16T01:54:28.144908+0000","last_clean":"2024-09-16T01:54:28.144908+0000","last_became_active":"2024-09-16T01:54:20.856852+0000","last_became_peered":"2024-09-16T01:54:20.856852+0000","last_unstale":"2024-09-16T01:54:28.144908+0000","last_undegraded":"2024-09-16T01:54:28.144908+0000","last_fullsized":"2024-09-16T01:54:28.144908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:40.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899928+0000","last_change":"2024-09-16T01:54:25.883440+0000","last_active":"2024-09-16T01:54:26.899928+0000","last_peered":"2024-09-16T01:54:26.899928+0000","last_clean":"2024-09-16T01:54:26.899928+0000","last_became_active":"2024-09-16T01:54:25.883010+0000","last_became_peered":"2024-09-16T01:54:25.883010+0000","last_unstale":"2024-09-16T01:54:26.899928+0000","last_undegraded":"2024-09-16T01:54:26.899928+0000","last_fullsized":"2024-09-16T01:54:26.899928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:00:01.617950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145309+0000","last_change":"2024-09-16T01:54:21.851620+0000","last_active":"2024-09-16T01:54:28.145309+0000","last_peered":"2024-09-16T01:54:28.145309+0000","last_clean":"2024-09-16T01:54:28.145309+0000","last_became_active":"2024-09-16T01:54:21.851295+0000","last_became_peered":"2024-09-16T01:54:21.851295+0000","last_unstale":"2024-09-16T01:54:28.145309+0000","last_undegraded":"2024-09-16T01:54:28.145309+0000","last_fullsized":"2024-09-16T01:54:28.145309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.146152+0000","last_change":"2024-09-16T01:54:20.852819+0000","last_active":"2024-09-16T01:54:28.146152+0000","last_peered":"2024-09-16T01:54:28.146152+0000","last_clean":"2024-09-16T01:54:28.146152+0000","last_became_active":"2024-09-16T01:54:20.852524+0000","last_became_peered":"2024-09-16T01:54:20.852524+0000","last_unstale":"2024-09-16T01:54:28.146152+0000","last_undegraded":"2024-09-16T01:54:28.146152+0000","last_fullsized":"2024-09-16T01:54:28.146152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899618+0000","last_change":"2024-09-16T01:54:25.964272+0000","last_active":"2024-09-16T01:54:26.899618+0000","last_peered":"2024-09-16T01:54:26.899618+0000","last_clean":"2024-09-16T01:54:26.899618+0000","last_became_active":"2024-09-16T01:54:25.963859+0000","last_became_peered":"2024-09-16T01:54:25.963859+0000","last_unstale":"2024-09-16T01:54:26.899618+0000","last_undegraded":"2024-09-16T01:54:26.899618+0000","last_fullsized":"2024-09-16T01:54:26.899618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:46.344559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899722+0000","last_change":"2024-09-16T01:54:21.857608+0000","last_active":"2024-09-16T01:54:26.899722+0000","last_peered":"2024-09-16T01:54:26.899722+0000","last_clean":"2024-09-16T01:54:26.899722+0000","last_became_active":"2024-09-16T01:54:21.857318+0000","last_became_peered":"2024-09-16T01:54:21.857318+0000","last_unstale":"2024-09-16T01:54:26.899722+0000","last_undegraded":"2024-09-16T01:54:26.899722+0000","last_fullsized":"2024-09-16T01:54:26.899722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644409+0000","last_change":"2024-09-16T01:54:20.852273+0000","last_active":"2024-09-16T01:54:27.644409+0000","last_peered":"2024-09-16T01:54:27.644409+0000","last_clean":"2024-09-16T01:54:27.644409+0000","last_became_active":"2024-09-16T01:54:20.850797+0000","last_became_peered":"2024-09-16T01:54:20.850797+0000","last_unstale":"2024-09-16T01:54:27.644409+0000","last_undegraded":"2024-09-16T01:54:27.644409+0000","last_fullsized":"2024-09-16T01:54:27.644409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898502+0000","last_change":"2024-09-16T01:54:25.962387+0000","last_active":"2024-09-16T01:54:26.898502+0000","last_peered":"2024-09-16T01:54:26.898502+0000","last_clean":"2024-09-16T01:54:26.898502+0000","last_became_active":"2024-09-16T01:54:25.961663+0000","last_became_peered":"2024-09-16T01:54:25.961663+0000","last_unstale":"2024-09-16T01:54:26.898502+0000","last_undegraded":"2024-09-16T01:54:26.898502+0000","last_fullsized":"2024-09-16T01:54:26.898502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:47:57.197478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644408+0000","last_change":"2024-09-16T01:54:21.847291+0000","last_active":"2024-09-16T01:54:27.644408+0000","last_peered":"2024-09-16T01:54:27.644408+0000","last_clean":"2024-09-16T01:54:27.644408+0000","last_became_active":"2024-09-16T01:54:21.847040+0000","last_became_peered":"2024-09-16T01:54:21.847040+0000","last_unstale":"2024-09-16T01:54:27.644408+0000","last_undegraded":"2024-09-16T01:54:27.644408+0000","last_fullsized":"2024-09-16T01:54:27.644408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145796+0000","last_change":"2024-09-16T01:54:20.858004+0000","last_active":"2024-09-16T01:54:28.145796+0000","last_peered":"2024-09-16T01:54:28.145796+0000","last_clean":"2024-09-16T01:54:28.145796+0000","last_became_active":"2024-09-16T01:54:20.857658+0000","last_became_peered":"2024-09-16T01:54:20.857658+0000","last_unstale":"2024-09-16T01:54:28.145796+0000","last_undegraded":"2024-09-16T01:54:28.145796+0000","last_fullsized":"2024-09-16T01:54:28.145796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:30.831030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144709+0000","last_change":"2024-09-16T01:54:25.962169+0000","last_active":"2024-09-16T01:54:28.144709+0000","last_peered":"2024-09-16T01:54:28.144709+0000","last_clean":"2024-09-16T01:54:28.144709+0000","last_became_active":"2024-09-16T01:54:25.961782+0000","last_became_peered":"2024-09-16T01:54:25.961782+0000","last_unstale":"2024-09-16T01:54:28.144709+0000","last_undegraded":"2024-09-16T01:54:28.144709+0000","last_fullsized":"2024-09-16T01:54:28.144709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:33.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678479+0000","last_change":"2024-09-16T01:54:21.867456+0000","last_active":"2024-09-16T01:54:27.678479+0000","last_peered":"2024-09-16T01:54:27.678479+0000","last_clean":"2024-09-16T01:54:27.678479+0000","last_became_active":"2024-09-16T01:54:21.867216+0000","last_became_peered":"2024-09-16T01:54:21.867216+0000","last_unstale":"2024-09-16T01:54:27.678479+0000","last_undegraded":"2024-09-16T01:54:27.678479+0000","last_fullsized":"2024-09-16T01:54:27.678479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:35.318988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644449+0000","last_change":"2024-09-16T01:54:20.859065+0000","last_active":"2024-09-16T01:54:27.644449+0000","last_peered":"2024-09-16T01:54:27.644449+0000","last_clean":"2024-09-16T01:54:27.644449+0000","last_became_active":"2024-09-16T01:54:20.858786+0000","last_became_peered":"2024-09-16T01:54:20.858786+0000","last_unstale":"2024-09-16T01:54:27.644449+0000","last_undegraded":"2024-09-16T01:54:27.644449+0000","last_fullsized":"2024-09-16T01:54:27.644449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643956+0000","last_change":"2024-09-16T01:54:25.879436+0000","last_active":"2024-09-16T01:54:27.643956+0000","last_peered":"2024-09-16T01:54:27.643956+0000","last_clean":"2024-09-16T01:54:27.643956+0000","last_became_active":"2024-09-16T01:54:25.878984+0000","last_became_peered":"2024-09-16T01:54:25.878984+0000","last_unstale":"2024-09-16T01:54:27.643956+0000","last_undegraded":"2024-09-16T01:54:27.643956+0000","last_fullsized":"2024-09-16T01:54:27.643956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900343+0000","last_change":"2024-09-16T01:54:21.860170+0000","last_active":"2024-09-16T01:54:26.900343+0000","last_peered":"2024-09-16T01:54:26.900343+0000","last_clean":"2024-09-16T01:54:26.900343+0000","last_became_active":"2024-09-16T01:54:21.859874+0000","last_became_peered":"2024-09-16T01:54:21.859874+0000","last_unstale":"2024-09-16T01:54:26.900343+0000","last_undegraded":"2024-09-16T01:54:26.900343+0000","last_fullsized":"2024-09-16T01:54:26.900343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:59.832590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678402+0000","last_change":"2024-09-16T01:54:20.857370+0000","last_active":"2024-09-16T01:54:27.678402+0000","last_peered":"2024-09-16T01:54:27.678402+0000","last_clean":"2024-09-16T01:54:27.678402+0000","last_became_active":"2024-09-16T01:54:20.856000+0000","last_became_peered":"2024-09-16T01:54:20.856000+0000","last_unstale":"2024-09-16T01:54:27.678402+0000","last_undegraded":"2024-09-16T01:54:27.678402+0000","last_fullsized":"2024-09-16T01:54:27.678402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644309+0000","last_change":"2024-09-16T01:54:25.880804+0000","last_active":"2024-09-16T01:54:27.644309+0000","last_peered":"2024-09-16T01:54:27.644309+0000","last_clean":"2024-09-16T01:54:27.644309+0000","last_became_active":"2024-09-16T01:54:25.880417+0000","last_became_peered":"2024-09-16T01:54:25.880417+0000","last_unstale":"2024-09-16T01:54:27.644309+0000","last_undegraded":"2024-09-16T01:54:27.644309+0000","last_fullsized":"2024-09-16T01:54:27.644309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:33.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643890+0000","last_change":"2024-09-16T01:54:21.845793+0000","last_active":"2024-09-16T01:54:27.643890+0000","last_peered":"2024-09-16T01:54:27.643890+0000","last_clean":"2024-09-16T01:54:27.643890+0000","last_became_active":"2024-09-16T01:54:21.845499+0000","last_became_peered":"2024-09-16T01:54:21.845499+0000","last_unstale":"2024-09-16T01:54:27.643890+0000","last_undegraded":"2024-09-16T01:54:27.643890+0000","last_fullsized":"2024-09-16T01:54:27.643890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144310+0000","last_change":"2024-09-16T01:54:20.858565+0000","last_active":"2024-09-16T01:54:28.144310+0000","last_peered":"2024-09-16T01:54:28.144310+0000","last_clean":"2024-09-16T01:54:28.144310+0000","last_became_active":"2024-09-16T01:54:20.858190+0000","last_became_peered":"2024-09-16T01:54:20.858190+0000","last_unstale":"2024-09-16T01:54:28.144310+0000","last_undegraded":"2024-09-16T01:54:28.144310+0000","last_fullsized":"2024-09-16T01:54:28.144310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:08.777600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644440+0000","last_change":"2024-09-16T01:54:25.880758+0000","last_active":"2024-09-16T01:54:27.644440+0000","last_peered":"2024-09-16T01:54:27.644440+0000","last_clean":"2024-09-16T01:54:27.644440+0000","last_became_active":"2024-09-16T01:54:25.879929+0000","last_became_peered":"2024-09-16T01:54:25.879929+0000","last_unstale":"2024-09-16T01:54:27.644440+0000","last_undegraded":"2024-09-16T01:54:27.644440+0000","last_fullsized":"2024-09-16T01:54:27.644440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:40:09.544682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144567+0000","last_change":"2024-09-16T01:54:21.859563+0000","last_active":"2024-09-16T01:54:28.144567+0000","last_peered":"2024-09-16T01:54:28.144567+0000","last_clean":"2024-09-16T01:54:28.144567+0000","last_became_active":"2024-09-16T01:54:21.859284+0000","last_became_peered":"2024-09-16T01:54:21.859284+0000","last_unstale":"2024-09-16T01:54:28.144567+0000","last_undegraded":"2024-09-16T01:54:28.144567+0000","last_fullsized":"2024-09-16T01:54:28.144567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:28.740307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145101+0000","last_change":"2024-09-16T01:54:20.860054+0000","last_active":"2024-09-16T01:54:28.145101+0000","last_peered":"2024-09-16T01:54:28.145101+0000","last_clean":"2024-09-16T01:54:28.145101+0000","last_became_active":"2024-09-16T01:54:20.859714+0000","last_became_peered":"2024-09-16T01:54:20.859714+0000","last_unstale":"2024-09-16T01:54:28.145101+0000","last_undegraded":"2024-09-16T01:54:28.145101+0000","last_fullsized":"2024-09-16T01:54:28.145101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:25.346654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145185+0000","last_change":"2024-09-16T01:54:25.963523+0000","last_active":"2024-09-16T01:54:28.145185+0000","last_peered":"2024-09-16T01:54:28.145185+0000","last_clean":"2024-09-16T01:54:28.145185+0000","last_became_active":"2024-09-16T01:54:25.963160+0000","last_became_peered":"2024-09-16T01:54:25.963160+0000","last_unstale":"2024-09-16T01:54:28.145185+0000","last_undegraded":"2024-09-16T01:54:28.145185+0000","last_fullsized":"2024-09-16T01:54:28.145185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:12.650374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898701+0000","last_change":"2024-09-16T01:54:21.859137+0000","last_active":"2024-09-16T01:54:26.898701+0000","last_peered":"2024-09-16T01:54:26.898701+0000","last_clean":"2024-09-16T01:54:26.898701+0000","last_became_active":"2024-09-16T01:54:21.858467+0000","last_became_peered":"2024-09-16T01:54:21.858467+0000","last_unstale":"2024-09-16T01:54:26.898701+0000","last_undegraded":"2024-09-16T01:54:26.898701+0000","last_fullsized":"2024-09-16T01:54:26.898701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678105+0000","last_change":"2024-09-16T01:54:20.855557+0000","last_active":"2024-09-16T01:54:27.678105+0000","last_peered":"2024-09-16T01:54:27.678105+0000","last_clean":"2024-09-16T01:54:27.678105+0000","last_became_active":"2024-09-16T01:54:20.855024+0000","last_became_peered":"2024-09-16T01:54:20.855024+0000","last_unstale":"2024-09-16T01:54:27.678105+0000","last_undegraded":"2024-09-16T01:54:27.678105+0000","last_fullsized":"2024-09-16T01:54:27.678105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145216+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:54:28.145216+0000","last_peered":"2024-09-16T01:54:28.145216+0000","last_clean":"2024-09-16T01:54:28.145216+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:54:28.145216+0000","last_undegraded":"2024-09-16T01:54:28.145216+0000","last_fullsized":"2024-09-16T01:54:28.145216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145100+0000","last_change":"2024-09-16T01:54:25.963720+0000","last_active":"2024-09-16T01:54:28.145100+0000","last_peered":"2024-09-16T01:54:28.145100+0000","last_clean":"2024-09-16T01:54:28.145100+0000","last_became_active":"2024-09-16T01:54:25.963290+0000","last_became_peered":"2024-09-16T01:54:25.963290+0000","last_unstale":"2024-09-16T01:54:28.145100+0000","last_undegraded":"2024-09-16T01:54:28.145100+0000","last_fullsized":"2024-09-16T01:54:28.145100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145565+0000","last_change":"2024-09-16T01:54:21.863989+0000","last_active":"2024-09-16T01:54:28.145565+0000","last_peered":"2024-09-16T01:54:28.145565+0000","last_clean":"2024-09-16T01:54:28.145565+0000","last_became_active":"2024-09-16T01:54:21.863683+0000","last_became_peered":"2024-09-16T01:54:21.863683+0000","last_unstale":"2024-09-16T01:54:28.145565+0000","last_undegraded":"2024-09-16T01:54:28.145565+0000","last_fullsized":"2024-09-16T01:54:28.145565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:31.678241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144985+0000","last_change":"2024-09-16T01:54:20.856924+0000","last_active":"2024-09-16T01:54:28.144985+0000","last_peered":"2024-09-16T01:54:28.144985+0000","last_clean":"2024-09-16T01:54:28.144985+0000","last_became_active":"2024-09-16T01:54:20.856528+0000","last_became_peered":"2024-09-16T01:54:20.856528+0000","last_unstale":"2024-09-16T01:54:28.144985+0000","last_undegraded":"2024-09-16T01:54:28.144985+0000","last_fullsized":"2024-09-16T01:54:28.144985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:47.012037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144803+0000","last_change":"2024-09-16T01:54:25.962300+0000","last_active":"2024-09-16T01:54:28.144803+0000","last_peered":"2024-09-16T01:54:28.144803+0000","last_clean":"2024-09-16T01:54:28.144803+0000","last_became_active":"2024-09-16T01:54:25.961846+0000","last_became_peered":"2024-09-16T01:54:25.961846+0000","last_unstale":"2024-09-16T01:54:28.144803+0000","last_undegraded":"2024-09-16T01:54:28.144803+0000","last_fullsized":"2024-09-16T01:54:28.144803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.629326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678252+0000","last_change":"2024-09-16T01:54:21.867183+0000","last_active":"2024-09-16T01:54:27.678252+0000","last_peered":"2024-09-16T01:54:27.678252+0000","last_clean":"2024-09-16T01:54:27.678252+0000","last_became_active":"2024-09-16T01:54:21.866359+0000","last_became_peered":"2024-09-16T01:54:21.866359+0000","last_unstale":"2024-09-16T01:54:27.678252+0000","last_undegraded":"2024-09-16T01:54:27.678252+0000","last_fullsized":"2024-09-16T01:54:27.678252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:10.597570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644565+0000","last_change":"2024-09-16T01:54:20.848769+0000","last_active":"2024-09-16T01:54:27.644565+0000","last_peered":"2024-09-16T01:54:27.644565+0000","last_clean":"2024-09-16T01:54:27.644565+0000","last_became_active":"2024-09-16T01:54:20.846526+0000","last_became_peered":"2024-09-16T01:54:20.846526+0000","last_unstale":"2024-09-16T01:54:27.644565+0000","last_undegraded":"2024-09-16T01:54:27.644565+0000","last_fullsized":"2024-09-16T01:54:27.644565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145456+0000","last_change":"2024-09-16T01:54:25.874322+0000","last_active":"2024-09-16T01:54:28.145456+0000","last_peered":"2024-09-16T01:54:28.145456+0000","last_clean":"2024-09-16T01:54:28.145456+0000","last_became_active":"2024-09-16T01:54:25.873916+0000","last_became_peered":"2024-09-16T01:54:25.873916+0000","last_unstale":"2024-09-16T01:54:28.145456+0000","last_undegraded":"2024-09-16T01:54:28.145456+0000","last_fullsized":"2024-09-16T01:54:28.145456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:58.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145950+0000","last_change":"2024-09-16T01:54:21.870995+0000","last_active":"2024-09-16T01:54:28.145950+0000","last_peered":"2024-09-16T01:54:28.145950+0000","last_clean":"2024-09-16T01:54:28.145950+0000","last_became_active":"2024-09-16T01:54:21.870452+0000","last_became_peered":"2024-09-16T01:54:21.870452+0000","last_unstale":"2024-09-16T01:54:28.145950+0000","last_undegraded":"2024-09-16T01:54:28.145950+0000","last_fullsized":"2024-09-16T01:54:28.145950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:04.838662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145304+0000","last_change":"2024-09-16T01:54:20.857994+0000","last_active":"2024-09-16T01:54:28.145304+0000","last_peered":"2024-09-16T01:54:28.145304+0000","last_clean":"2024-09-16T01:54:28.145304+0000","last_became_active":"2024-09-16T01:54:20.857622+0000","last_became_peered":"2024-09-16T01:54:20.857622+0000","last_unstale":"2024-09-16T01:54:28.145304+0000","last_undegraded":"2024-09-16T01:54:28.145304+0000","last_fullsized":"2024-09-16T01:54:28.145304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:45.730567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677827+0000","last_change":"2024-09-16T01:54:25.964331+0000","last_active":"2024-09-16T01:54:27.677827+0000","last_peered":"2024-09-16T01:54:27.677827+0000","last_clean":"2024-09-16T01:54:27.677827+0000","last_became_active":"2024-09-16T01:54:25.963969+0000","last_became_peered":"2024-09-16T01:54:25.963969+0000","last_unstale":"2024-09-16T01:54:27.677827+0000","last_undegraded":"2024-09-16T01:54:27.677827+0000","last_fullsized":"2024-09-16T01:54:27.677827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:06.129448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145804+0000","last_change":"2024-09-16T01:54:21.870195+0000","last_active":"2024-09-16T01:54:28.145804+0000","last_peered":"2024-09-16T01:54:28.145804+0000","last_clean":"2024-09-16T01:54:28.145804+0000","last_became_active":"2024-09-16T01:54:21.869739+0000","last_became_peered":"2024-09-16T01:54:21.869739+0000","last_unstale":"2024-09-16T01:54:28.145804+0000","last_undegraded":"2024-09-16T01:54:28.145804+0000","last_fullsized":"2024-09-16T01:54:28.145804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:16.366906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900025+0000","last_change":"2024-09-16T01:54:20.859086+0000","last_active":"2024-09-16T01:54:26.900025+0000","last_peered":"2024-09-16T01:54:26.900025+0000","last_clean":"2024-09-16T01:54:26.900025+0000","last_became_active":"2024-09-16T01:54:20.858783+0000","last_became_peered":"2024-09-16T01:54:20.858783+0000","last_unstale":"2024-09-16T01:54:26.900025+0000","last_undegraded":"2024-09-16T01:54:26.900025+0000","last_fullsized":"2024-09-16T01:54:26.900025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:39.081955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900245+0000","last_change":"2024-09-16T01:54:25.877090+0000","last_active":"2024-09-16T01:54:26.900245+0000","last_peered":"2024-09-16T01:54:26.900245+0000","last_clean":"2024-09-16T01:54:26.900245+0000","last_became_active":"2024-09-16T01:54:25.876626+0000","last_became_peered":"2024-09-16T01:54:25.876626+0000","last_unstale":"2024-09-16T01:54:26.900245+0000","last_undegraded":"2024-09-16T01:54:26.900245+0000","last_fullsized":"2024-09-16T01:54:26.900245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145343+0000","last_change":"2024-09-16T01:54:21.870018+0000","last_active":"2024-09-16T01:54:28.145343+0000","last_peered":"2024-09-16T01:54:28.145343+0000","last_clean":"2024-09-16T01:54:28.145343+0000","last_became_active":"2024-09-16T01:54:21.869334+0000","last_became_peered":"2024-09-16T01:54:21.869334+0000","last_unstale":"2024-09-16T01:54:28.145343+0000","last_undegraded":"2024-09-16T01:54:28.145343+0000","last_fullsized":"2024-09-16T01:54:28.145343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:18:36.899153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144191+0000","last_change":"2024-09-16T01:54:20.850043+0000","last_active":"2024-09-16T01:54:28.144191+0000","last_peered":"2024-09-16T01:54:28.144191+0000","last_clean":"2024-09-16T01:54:28.144191+0000","last_became_active":"2024-09-16T01:54:20.849690+0000","last_became_peered":"2024-09-16T01:54:20.849690+0000","last_unstale":"2024-09-16T01:54:28.144191+0000","last_undegraded":"2024-09-16T01:54:28.144191+0000","last_fullsized":"2024-09-16T01:54:28.144191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:20.932038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145156+0000","last_change":"2024-09-16T01:54:25.876135+0000","last_active":"2024-09-16T01:54:28.145156+0000","last_peered":"2024-09-16T01:54:28.145156+0000","last_clean":"2024-09-16T01:54:28.145156+0000","last_became_active":"2024-09-16T01:54:25.875631+0000","last_became_peered":"2024-09-16T01:54:25.875631+0000","last_unstale":"2024-09-16T01:54:28.145156+0000","last_undegraded":"2024-09-16T01:54:28.145156+0000","last_fullsized":"2024-09-16T01:54:28.145156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144759+0000","last_change":"2024-09-16T01:54:21.865673+0000","last_active":"2024-09-16T01:54:28.144759+0000","last_peered":"2024-09-16T01:54:28.144759+0000","last_clean":"2024-09-16T01:54:28.144759+0000","last_became_active":"2024-09-16T01:54:21.865342+0000","last_became_peered":"2024-09-16T01:54:21.865342+0000","last_unstale":"2024-09-16T01:54:28.144759+0000","last_undegraded":"2024-09-16T01:54:28.144759+0000","last_fullsized":"2024-09-16T01:54:28.144759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144766+0000","last_change":"2024-09-16T01:54:20.846994+0000","last_active":"2024-09-16T01:54:28.144766+0000","last_peered":"2024-09-16T01:54:28.144766+0000","last_clean":"2024-09-16T01:54:28.144766+0000","last_became_active":"2024-09-16T01:54:20.846665+0000","last_became_peered":"2024-09-16T01:54:20.846665+0000","last_unstale":"2024-09-16T01:54:28.144766+0000","last_undegraded":"2024-09-16T01:54:28.144766+0000","last_fullsized":"2024-09-16T01:54:28.144766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899670+0000","last_change":"2024-09-16T01:54:25.966412+0000","last_active":"2024-09-16T01:54:26.899670+0000","last_peered":"2024-09-16T01:54:26.899670+0000","last_clean":"2024-09-16T01:54:26.899670+0000","last_became_active":"2024-09-16T01:54:25.965845+0000","last_became_peered":"2024-09-16T01:54:25.965845+0000","last_unstale":"2024-09-16T01:54:26.899670+0000","last_undegraded":"2024-09-16T01:54:26.899670+0000","last_fullsized":"2024-09-16T01:54:26.899670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:35.279620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145627+0000","last_change":"2024-09-16T01:54:21.871992+0000","last_active":"2024-09-16T01:54:28.145627+0000","last_peered":"2024-09-16T01:54:28.145627+0000","last_clean":"2024-09-16T01:54:28.145627+0000","last_became_active":"2024-09-16T01:54:21.871674+0000","last_became_peered":"2024-09-16T01:54:21.871674+0000","last_unstale":"2024-09-16T01:54:28.145627+0000","last_undegraded":"2024-09-16T01:54:28.145627+0000","last_fullsized":"2024-09-16T01:54:28.145627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:27.694450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678279+0000","last_change":"2024-09-16T01:54:20.858600+0000","last_active":"2024-09-16T01:54:27.678279+0000","last_peered":"2024-09-16T01:54:27.678279+0000","last_clean":"2024-09-16T01:54:27.678279+0000","last_became_active":"2024-09-16T01:54:20.858244+0000","last_became_peered":"2024-09-16T01:54:20.858244+0000","last_unstale":"2024-09-16T01:54:27.678279+0000","last_undegraded":"2024-09-16T01:54:27.678279+0000","last_fullsized":"2024-09-16T01:54:27.678279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899103+0000","last_change":"2024-09-16T01:54:25.962396+0000","last_active":"2024-09-16T01:54:26.899103+0000","last_peered":"2024-09-16T01:54:26.899103+0000","last_clean":"2024-09-16T01:54:26.899103+0000","last_became_active":"2024-09-16T01:54:25.961648+0000","last_became_peered":"2024-09-16T01:54:25.961648+0000","last_unstale":"2024-09-16T01:54:26.899103+0000","last_undegraded":"2024-09-16T01:54:26.899103+0000","last_fullsized":"2024-09-16T01:54:26.899103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:45.131656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144942+0000","last_change":"2024-09-16T01:54:21.864888+0000","last_active":"2024-09-16T01:54:28.144942+0000","last_peered":"2024-09-16T01:54:28.144942+0000","last_clean":"2024-09-16T01:54:28.144942+0000","last_became_active":"2024-09-16T01:54:21.864577+0000","last_became_peered":"2024-09-16T01:54:21.864577+0000","last_unstale":"2024-09-16T01:54:28.144942+0000","last_undegraded":"2024-09-16T01:54:28.144942+0000","last_fullsized":"2024-09-16T01:54:28.144942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145550+0000","last_change":"2024-09-16T01:54:20.856921+0000","last_active":"2024-09-16T01:54:28.145550+0000","last_peered":"2024-09-16T01:54:28.145550+0000","last_clean":"2024-09-16T01:54:28.145550+0000","last_became_active":"2024-09-16T01:54:20.856618+0000","last_became_peered":"2024-09-16T01:54:20.856618+0000","last_unstale":"2024-09-16T01:54:28.145550+0000","last_undegraded":"2024-09-16T01:54:28.145550+0000","last_fullsized":"2024-09-16T01:54:28.145550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678404+0000","last_change":"2024-09-16T01:54:25.962306+0000","last_active":"2024-09-16T01:54:27.678404+0000","last_peered":"2024-09-16T01:54:27.678404+0000","last_clean":"2024-09-16T01:54:27.678404+0000","last_became_active":"2024-09-16T01:54:25.961904+0000","last_became_peered":"2024-09-16T01:54:25.961904+0000","last_unstale":"2024-09-16T01:54:27.678404+0000","last_undegraded":"2024-09-16T01:54:27.678404+0000","last_fullsized":"2024-09-16T01:54:27.678404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:21.665659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145442+0000","last_change":"2024-09-16T01:54:21.868099+0000","last_active":"2024-09-16T01:54:28.145442+0000","last_peered":"2024-09-16T01:54:28.145442+0000","last_clean":"2024-09-16T01:54:28.145442+0000","last_became_active":"2024-09-16T01:54:21.866809+0000","last_became_peered":"2024-09-16T01:54:21.866809+0000","last_unstale":"2024-09-16T01:54:28.145442+0000","last_undegraded":"2024-09-16T01:54:28.145442+0000","last_fullsized":"2024-09-16T01:54:28.145442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:54.265355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:31.368525+0000","last_change":"2024-09-16T01:54:20.858623+0000","last_active":"2024-09-16T01:54:31.368525+0000","last_peered":"2024-09-16T01:54:31.368525+0000","last_clean":"2024-09-16T01:54:31.368525+0000","last_became_active":"2024-09-16T01:54:20.858247+0000","last_became_peered":"2024-09-16T01:54:20.858247+0000","last_unstale":"2024-09-16T01:54:31.368525+0000","last_undegraded":"2024-09-16T01:54:31.368525+0000","last_fullsized":"2024-09-16T01:54:31.368525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644208+0000","last_change":"2024-09-16T01:54:25.877219+0000","last_active":"2024-09-16T01:54:27.644208+0000","last_peered":"2024-09-16T01:54:27.644208+0000","last_clean":"2024-09-16T01:54:27.644208+0000","last_became_active":"2024-09-16T01:54:25.876551+0000","last_became_peered":"2024-09-16T01:54:25.876551+0000","last_unstale":"2024-09-16T01:54:27.644208+0000","last_undegraded":"2024-09-16T01:54:27.644208+0000","last_fullsized":"2024-09-16T01:54:27.644208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:12.650374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900540+0000","last_change":"2024-09-16T01:54:21.869260+0000","last_active":"2024-09-16T01:54:26.900540+0000","last_peered":"2024-09-16T01:54:26.900540+0000","last_clean":"2024-09-16T01:54:26.900540+0000","last_became_active":"2024-09-16T01:54:21.868827+0000","last_became_peered":"2024-09-16T01:54:21.868827+0000","last_unstale":"2024-09-16T01:54:26.900540+0000","last_undegraded":"2024-09-16T01:54:26.900540+0000","last_fullsized":"2024-09-16T01:54:26.900540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:13.856305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644517+0000","last_change":"2024-09-16T01:54:20.857069+0000","last_active":"2024-09-16T01:54:27.644517+0000","last_peered":"2024-09-16T01:54:27.644517+0000","last_clean":"2024-09-16T01:54:27.644517+0000","last_became_active":"2024-09-16T01:54:20.856716+0000","last_became_peered":"2024-09-16T01:54:20.856716+0000","last_unstale":"2024-09-16T01:54:27.644517+0000","last_undegraded":"2024-09-16T01:54:27.644517+0000","last_fullsized":"2024-09-16T01:54:27.644517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900263+0000","last_change":"2024-09-16T01:54:25.877903+0000","last_active":"2024-09-16T01:54:26.900263+0000","last_peered":"2024-09-16T01:54:26.900263+0000","last_clean":"2024-09-16T01:54:26.900263+0000","last_became_active":"2024-09-16T01:54:25.877044+0000","last_became_peered":"2024-09-16T01:54:25.877044+0000","last_unstale":"2024-09-16T01:54:26.900263+0000","last_undegraded":"2024-09-16T01:54:26.900263+0000","last_fullsized":"2024-09-16T01:54:26.900263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.629326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145039+0000","last_change":"2024-09-16T01:54:21.867905+0000","last_active":"2024-09-16T01:54:28.145039+0000","last_peered":"2024-09-16T01:54:28.145039+0000","last_clean":"2024-09-16T01:54:28.145039+0000","last_became_active":"2024-09-16T01:54:21.867528+0000","last_became_peered":"2024-09-16T01:54:21.867528+0000","last_unstale":"2024-09-16T01:54:28.145039+0000","last_undegraded":"2024-09-16T01:54:28.145039+0000","last_fullsized":"2024-09-16T01:54:28.145039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678486+0000","last_change":"2024-09-16T01:54:20.857608+0000","last_active":"2024-09-16T01:54:27.678486+0000","last_peered":"2024-09-16T01:54:27.678486+0000","last_clean":"2024-09-16T01:54:27.678486+0000","last_became_active":"2024-09-16T01:54:20.857274+0000","last_became_peered":"2024-09-16T01:54:20.857274+0000","last_unstale":"2024-09-16T01:54:27.678486+0000","last_undegraded":"2024-09-16T01:54:27.678486+0000","last_fullsized":"2024-09-16T01:54:27.678486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898742+0000","last_change":"2024-09-16T01:54:25.882374+0000","last_active":"2024-09-16T01:54:26.898742+0000","last_peered":"2024-09-16T01:54:26.898742+0000","last_clean":"2024-09-16T01:54:26.898742+0000","last_became_active":"2024-09-16T01:54:25.881866+0000","last_became_peered":"2024-09-16T01:54:25.881866+0000","last_unstale":"2024-09-16T01:54:26.898742+0000","last_undegraded":"2024-09-16T01:54:26.898742+0000","last_fullsized":"2024-09-16T01:54:26.898742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:57.763504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678472+0000","last_change":"2024-09-16T01:54:21.867006+0000","last_active":"2024-09-16T01:54:27.678472+0000","last_peered":"2024-09-16T01:54:27.678472+0000","last_clean":"2024-09-16T01:54:27.678472+0000","last_became_active":"2024-09-16T01:54:21.866494+0000","last_became_peered":"2024-09-16T01:54:21.866494+0000","last_unstale":"2024-09-16T01:54:27.678472+0000","last_undegraded":"2024-09-16T01:54:27.678472+0000","last_fullsized":"2024-09-16T01:54:27.678472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:08.629741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145496+0000","last_change":"2024-09-16T01:54:20.856791+0000","last_active":"2024-09-16T01:54:28.145496+0000","last_peered":"2024-09-16T01:54:28.145496+0000","last_clean":"2024-09-16T01:54:28.145496+0000","last_became_active":"2024-09-16T01:54:20.856438+0000","last_became_peered":"2024-09-16T01:54:20.856438+0000","last_unstale":"2024-09-16T01:54:28.145496+0000","last_undegraded":"2024-09-16T01:54:28.145496+0000","last_fullsized":"2024-09-16T01:54:28.145496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898630+0000","last_change":"2024-09-16T01:54:25.965028+0000","last_active":"2024-09-16T01:54:26.898630+0000","last_peered":"2024-09-16T01:54:26.898630+0000","last_clean":"2024-09-16T01:54:26.898630+0000","last_became_active":"2024-09-16T01:54:25.964627+0000","last_became_peered":"2024-09-16T01:54:25.964627+0000","last_unstale":"2024-09-16T01:54:26.898630+0000","last_undegraded":"2024-09-16T01:54:26.898630+0000","last_fullsized":"2024-09-16T01:54:26.898630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:21.665659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144989+0000","last_change":"2024-09-16T01:54:25.964421+0000","last_active":"2024-09-16T01:54:28.144989+0000","last_peered":"2024-09-16T01:54:28.144989+0000","last_clean":"2024-09-16T01:54:28.144989+0000","last_became_active":"2024-09-16T01:54:25.964043+0000","last_became_peered":"2024-09-16T01:54:25.964043+0000","last_unstale":"2024-09-16T01:54:28.144989+0000","last_undegraded":"2024-09-16T01:54:28.144989+0000","last_fullsized":"2024-09-16T01:54:28.144989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643734+0000","last_change":"2024-09-16T01:54:21.854748+0000","last_active":"2024-09-16T01:54:27.643734+0000","last_peered":"2024-09-16T01:54:27.643734+0000","last_clean":"2024-09-16T01:54:27.643734+0000","last_became_active":"2024-09-16T01:54:21.854442+0000","last_became_peered":"2024-09-16T01:54:21.854442+0000","last_unstale":"2024-09-16T01:54:27.643734+0000","last_undegraded":"2024-09-16T01:54:27.643734+0000","last_fullsized":"2024-09-16T01:54:27.643734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678022+0000","last_change":"2024-09-16T01:54:20.857120+0000","last_active":"2024-09-16T01:54:27.678022+0000","last_peered":"2024-09-16T01:54:27.678022+0000","last_clean":"2024-09-16T01:54:27.678022+0000","last_became_active":"2024-09-16T01:54:20.855928+0000","last_became_peered":"2024-09-16T01:54:20.855928+0000","last_unstale":"2024-09-16T01:54:27.678022+0000","last_undegraded":"2024-09-16T01:54:27.678022+0000","last_fullsized":"2024-09-16T01:54:27.678022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145929+0000","last_change":"2024-09-16T01:54:25.881758+0000","last_active":"2024-09-16T01:54:28.145929+0000","last_peered":"2024-09-16T01:54:28.145929+0000","last_clean":"2024-09-16T01:54:28.145929+0000","last_became_active":"2024-09-16T01:54:25.881332+0000","last_became_peered":"2024-09-16T01:54:25.881332+0000","last_unstale":"2024-09-16T01:54:28.145929+0000","last_undegraded":"2024-09-16T01:54:28.145929+0000","last_fullsized":"2024-09-16T01:54:28.145929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898882+0000","last_change":"2024-09-16T01:54:21.862116+0000","last_active":"2024-09-16T01:54:26.898882+0000","last_peered":"2024-09-16T01:54:26.898882+0000","last_clean":"2024-09-16T01:54:26.898882+0000","last_became_active":"2024-09-16T01:54:21.861751+0000","last_became_peered":"2024-09-16T01:54:21.861751+0000","last_unstale":"2024-09-16T01:54:26.898882+0000","last_undegraded":"2024-09-16T01:54:26.898882+0000","last_fullsized":"2024-09-16T01:54:26.898882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898921+0000","last_change":"2024-09-16T01:54:20.851739+0000","last_active":"2024-09-16T01:54:26.898921+0000","last_peered":"2024-09-16T01:54:26.898921+0000","last_clean":"2024-09-16T01:54:26.898921+0000","last_became_active":"2024-09-16T01:54:20.851438+0000","last_became_peered":"2024-09-16T01:54:20.851438+0000","last_unstale":"2024-09-16T01:54:26.898921+0000","last_undegraded":"2024-09-16T01:54:26.898921+0000","last_fullsized":"2024-09-16T01:54:26.898921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:34:38.620678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145055+0000","last_change":"2024-09-16T01:54:20.850823+0000","last_active":"2024-09-16T01:54:28.145055+0000","last_peered":"2024-09-16T01:54:28.145055+0000","last_clean":"2024-09-16T01:54:28.145055+0000","last_became_active":"2024-09-16T01:54:20.850498+0000","last_became_peered":"2024-09-16T01:54:20.850498+0000","last_unstale":"2024-09-16T01:54:28.145055+0000","last_undegraded":"2024-09-16T01:54:28.145055+0000","last_fullsized":"2024-09-16T01:54:28.145055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145506+0000","last_change":"2024-09-16T01:54:21.864867+0000","last_active":"2024-09-16T01:54:28.145506+0000","last_peered":"2024-09-16T01:54:28.145506+0000","last_clean":"2024-09-16T01:54:28.145506+0000","last_became_active":"2024-09-16T01:54:21.863988+0000","last_became_peered":"2024-09-16T01:54:21.863988+0000","last_unstale":"2024-09-16T01:54:28.145506+0000","last_undegraded":"2024-09-16T01:54:28.145506+0000","last_fullsized":"2024-09-16T01:54:28.145506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144751+0000","last_change":"2024-09-16T01:54:25.883288+0000","last_active":"2024-09-16T01:54:28.144751+0000","last_peered":"2024-09-16T01:54:28.144751+0000","last_clean":"2024-09-16T01:54:28.144751+0000","last_became_active":"2024-09-16T01:54:25.882928+0000","last_became_peered":"2024-09-16T01:54:25.882928+0000","last_unstale":"2024-09-16T01:54:28.144751+0000","last_undegraded":"2024-09-16T01:54:28.144751+0000","last_fullsized":"2024-09-16T01:54:28.144751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:04.515824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899096+0000","last_change":"2024-09-16T01:54:20.852534+0000","last_active":"2024-09-16T01:54:26.899096+0000","last_peered":"2024-09-16T01:54:26.899096+0000","last_clean":"2024-09-16T01:54:26.899096+0000","last_became_active":"2024-09-16T01:54:20.852219+0000","last_became_peered":"2024-09-16T01:54:20.852219+0000","last_unstale":"2024-09-16T01:54:26.899096+0000","last_undegraded":"2024-09-16T01:54:26.899096+0000","last_fullsized":"2024-09-16T01:54:26.899096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899937+0000","last_change":"2024-09-16T01:54:21.850135+0000","last_active":"2024-09-16T01:54:26.899937+0000","last_peered":"2024-09-16T01:54:26.899937+0000","last_clean":"2024-09-16T01:54:26.899937+0000","last_became_active":"2024-09-16T01:54:21.849806+0000","last_became_peered":"2024-09-16T01:54:21.849806+0000","last_unstale":"2024-09-16T01:54:26.899937+0000","last_undegraded":"2024-09-16T01:54:26.899937+0000","last_fullsized":"2024-09-16T01:54:26.899937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:21.396408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899361+0000","last_change":"2024-09-16T01:54:25.881823+0000","last_active":"2024-09-16T01:54:26.899361+0000","last_peered":"2024-09-16T01:54:26.899361+0000","last_clean":"2024-09-16T01:54:26.899361+0000","last_became_active":"2024-09-16T01:54:25.881327+0000","last_became_peered":"2024-09-16T01:54:25.881327+0000","last_unstale":"2024-09-16T01:54:26.899361+0000","last_undegraded":"2024-09-16T01:54:26.899361+0000","last_fullsized":"2024-09-16T01:54:26.899361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:23.493442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144596+0000","last_change":"2024-09-16T01:54:21.865704+0000","last_active":"2024-09-16T01:54:28.144596+0000","last_peered":"2024-09-16T01:54:28.144596+0000","last_clean":"2024-09-16T01:54:28.144596+0000","last_became_active":"2024-09-16T01:54:21.865364+0000","last_became_peered":"2024-09-16T01:54:21.865364+0000","last_unstale":"2024-09-16T01:54:28.144596+0000","last_undegraded":"2024-09-16T01:54:28.144596+0000","last_fullsized":"2024-09-16T01:54:28.144596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144292+0000","last_change":"2024-09-16T01:54:21.856984+0000","last_active":"2024-09-16T01:54:28.144292+0000","last_peered":"2024-09-16T01:54:28.144292+0000","last_clean":"2024-09-16T01:54:28.144292+0000","last_became_active":"2024-09-16T01:54:21.856689+0000","last_became_peered":"2024-09-16T01:54:21.856689+0000","last_unstale":"2024-09-16T01:54:28.144292+0000","last_undegraded":"2024-09-16T01:54:28.144292+0000","last_fullsized":"2024-09-16T01:54:28.144292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:31.836291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678206+0000","last_change":"2024-09-16T01:54:21.857661+0000","last_active":"2024-09-16T01:54:27.678206+0000","last_peered":"2024-09-16T01:54:27.678206+0000","last_clean":"2024-09-16T01:54:27.678206+0000","last_became_active":"2024-09-16T01:54:21.857393+0000","last_became_peered":"2024-09-16T01:54:21.857393+0000","last_unstale":"2024-09-16T01:54:27.678206+0000","last_undegraded":"2024-09-16T01:54:27.678206+0000","last_fullsized":"2024-09-16T01:54:27.678206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:57.597318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145421+0000","last_change":"2024-09-16T01:54:21.864966+0000","last_active":"2024-09-16T01:54:28.145421+0000","last_peered":"2024-09-16T01:54:28.145421+0000","last_clean":"2024-09-16T01:54:28.145421+0000","last_became_active":"2024-09-16T01:54:21.864561+0000","last_became_peered":"2024-09-16T01:54:21.864561+0000","last_unstale":"2024-09-16T01:54:28.145421+0000","last_undegraded":"2024-09-16T01:54:28.145421+0000","last_fullsized":"2024-09-16T01:54:28.145421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899348+0000","last_change":"2024-09-16T01:54:21.870271+0000","last_active":"2024-09-16T01:54:26.899348+0000","last_peered":"2024-09-16T01:54:26.899348+0000","last_clean":"2024-09-16T01:54:26.899348+0000","last_became_active":"2024-09-16T01:54:21.869900+0000","last_became_peered":"2024-09-16T01:54:21.869900+0000","last_unstale":"2024-09-16T01:54:26.899348+0000","last_undegraded":"2024-09-16T01:54:26.899348+0000","last_fullsized":"2024-09-16T01:54:26.899348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644063+0000","last_change":"2024-09-16T01:54:21.855065+0000","last_active":"2024-09-16T01:54:27.644063+0000","last_peered":"2024-09-16T01:54:27.644063+0000","last_clean":"2024-09-16T01:54:27.644063+0000","last_became_active":"2024-09-16T01:54:21.854785+0000","last_became_peered":"2024-09-16T01:54:21.854785+0000","last_unstale":"2024-09-16T01:54:27.644063+0000","last_undegraded":"2024-09-16T01:54:27.644063+0000","last_fullsized":"2024-09-16T01:54:27.644063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.146008+0000","last_change":"2024-09-16T01:54:21.856250+0000","last_active":"2024-09-16T01:54:28.146008+0000","last_peered":"2024-09-16T01:54:28.146008+0000","last_clean":"2024-09-16T01:54:28.146008+0000","last_became_active":"2024-09-16T01:54:21.855867+0000","last_became_peered":"2024-09-16T01:54:21.855867+0000","last_unstale":"2024-09-16T01:54:28.146008+0000","last_undegraded":"2024-09-16T01:54:28.146008+0000","last_fullsized":"2024-09-16T01:54:28.146008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899585+0000","last_change":"2024-09-16T01:54:21.869651+0000","last_active":"2024-09-16T01:54:26.899585+0000","last_peered":"2024-09-16T01:54:26.899585+0000","last_clean":"2024-09-16T01:54:26.899585+0000","last_became_active":"2024-09-16T01:54:21.869363+0000","last_became_peered":"2024-09-16T01:54:21.869363+0000","last_unstale":"2024-09-16T01:54:26.899585+0000","last_undegraded":"2024-09-16T01:54:26.899585+0000","last_fullsized":"2024-09-16T01:54:26.899585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677969+0000","last_change":"2024-09-16T01:54:21.857499+0000","last_active":"2024-09-16T01:54:27.677969+0000","last_peered":"2024-09-16T01:54:27.677969+0000","last_clean":"2024-09-16T01:54:27.677969+0000","last_became_active":"2024-09-16T01:54:21.857215+0000","last_became_peered":"2024-09-16T01:54:21.857215+0000","last_unstale":"2024-09-16T01:54:27.677969+0000","last_undegraded":"2024-09-16T01:54:27.677969+0000","last_fullsized":"2024-09-16T01:54:27.677969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898805+0000","last_change":"2024-09-16T01:54:21.853265+0000","last_active":"2024-09-16T01:54:26.898805+0000","last_peered":"2024-09-16T01:54:26.898805+0000","last_clean":"2024-09-16T01:54:26.898805+0000","last_became_active":"2024-09-16T01:54:21.852863+0000","last_became_peered":"2024-09-16T01:54:21.852863+0000","last_unstale":"2024-09-16T01:54:26.898805+0000","last_undegraded":"2024-09-16T01:54:26.898805+0000","last_fullsized":"2024-09-16T01:54:26.898805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678154+0000","last_change":"2024-09-16T01:54:21.856726+0000","last_active":"2024-09-16T01:54:27.678154+0000","last_peered":"2024-09-16T01:54:27.678154+0000","last_clean":"2024-09-16T01:54:27.678154+0000","last_became_active":"2024-09-16T01:54:21.856432+0000","last_became_peered":"2024-09-16T01:54:21.856432+0000","last_unstale":"2024-09-16T01:54:27.678154+0000","last_undegraded":"2024-09-16T01:54:27.678154+0000","last_fullsized":"2024-09-16T01:54:27.678154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:29.948383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145040+0000","last_change":"2024-09-16T01:54:21.867340+0000","last_active":"2024-09-16T01:54:28.145040+0000","last_peered":"2024-09-16T01:54:28.145040+0000","last_clean":"2024-09-16T01:54:28.145040+0000","last_became_active":"2024-09-16T01:54:21.866029+0000","last_became_peered":"2024-09-16T01:54:21.866029+0000","last_unstale":"2024-09-16T01:54:28.145040+0000","last_undegraded":"2024-09-16T01:54:28.145040+0000","last_fullsized":"2024-09-16T01:54:28.145040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:33.360622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145155+0000","last_change":"2024-09-16T01:54:21.861066+0000","last_active":"2024-09-16T01:54:28.145155+0000","last_peered":"2024-09-16T01:54:28.145155+0000","last_clean":"2024-09-16T01:54:28.145155+0000","last_became_active":"2024-09-16T01:54:21.860305+0000","last_became_peered":"2024-09-16T01:54:21.860305+0000","last_unstale":"2024-09-16T01:54:28.145155+0000","last_undegraded":"2024-09-16T01:54:28.145155+0000","last_fullsized":"2024-09-16T01:54:28.145155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145799+0000","last_change":"2024-09-16T01:54:21.863878+0000","last_active":"2024-09-16T01:54:28.145799+0000","last_peered":"2024-09-16T01:54:28.145799+0000","last_clean":"2024-09-16T01:54:28.145799+0000","last_became_active":"2024-09-16T01:54:21.863277+0000","last_became_peered":"2024-09-16T01:54:21.863277+0000","last_unstale":"2024-09-16T01:54:28.145799+0000","last_undegraded":"2024-09-16T01:54:28.145799+0000","last_fullsized":"2024-09-16T01:54:28.145799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:38.741991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145254+0000","last_change":"2024-09-16T01:54:21.852758+0000","last_active":"2024-09-16T01:54:28.145254+0000","last_peered":"2024-09-16T01:54:28.145254+0000","last_clean":"2024-09-16T01:54:28.145254+0000","last_became_active":"2024-09-16T01:54:21.852429+0000","last_became_peered":"2024-09-16T01:54:21.852429+0000","last_unstale":"2024-09-16T01:54:28.145254+0000","last_undegraded":"2024-09-16T01:54:28.145254+0000","last_fullsized":"2024-09-16T01:54:28.145254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:33.722900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678582+0000","last_change":"2024-09-16T01:54:21.871495+0000","last_active":"2024-09-16T01:54:27.678582+0000","last_peered":"2024-09-16T01:54:27.678582+0000","last_clean":"2024-09-16T01:54:27.678582+0000","last_became_active":"2024-09-16T01:54:21.871213+0000","last_became_peered":"2024-09-16T01:54:21.871213+0000","last_unstale":"2024-09-16T01:54:27.678582+0000","last_undegraded":"2024-09-16T01:54:27.678582+0000","last_fullsized":"2024-09-16T01:54:27.678582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:29.854384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677857+0000","last_change":"2024-09-16T01:54:21.863733+0000","last_active":"2024-09-16T01:54:27.677857+0000","last_peered":"2024-09-16T01:54:27.677857+0000","last_clean":"2024-09-16T01:54:27.677857+0000","last_became_active":"2024-09-16T01:54:21.863426+0000","last_became_peered":"2024-09-16T01:54:21.863426+0000","last_unstale":"2024-09-16T01:54:27.677857+0000","last_undegraded":"2024-09-16T01:54:27.677857+0000","last_fullsized":"2024-09-16T01:54:27.677857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643815+0000","last_change":"2024-09-16T01:54:21.845049+0000","last_active":"2024-09-16T01:54:27.643815+0000","last_peered":"2024-09-16T01:54:27.643815+0000","last_clean":"2024-09-16T01:54:27.643815+0000","last_became_active":"2024-09-16T01:54:21.844746+0000","last_became_peered":"2024-09-16T01:54:21.844746+0000","last_unstale":"2024-09-16T01:54:27.643815+0000","last_undegraded":"2024-09-16T01:54:27.643815+0000","last_fullsized":"2024-09-16T01:54:27.643815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144803+0000","last_change":"2024-09-16T01:54:21.863916+0000","last_active":"2024-09-16T01:54:28.144803+0000","last_peered":"2024-09-16T01:54:28.144803+0000","last_clean":"2024-09-16T01:54:28.144803+0000","last_became_active":"2024-09-16T01:54:21.858949+0000","last_became_peered":"2024-09-16T01:54:21.858949+0000","last_unstale":"2024-09-16T01:54:28.144803+0000","last_undegraded":"2024-09-16T01:54:28.144803+0000","last_fullsized":"2024-09-16T01:54:28.144803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:06.850801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898941+0000","last_change":"2024-09-16T01:54:21.856929+0000","last_active":"2024-09-16T01:54:26.898941+0000","last_peered":"2024-09-16T01:54:26.898941+0000","last_clean":"2024-09-16T01:54:26.898941+0000","last_became_active":"2024-09-16T01:54:21.856610+0000","last_became_peered":"2024-09-16T01:54:21.856610+0000","last_unstale":"2024-09-16T01:54:26.898941+0000","last_undegraded":"2024-09-16T01:54:26.898941+0000","last_fullsized":"2024-09-16T01:54:26.898941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900438+0000","last_change":"2024-09-16T01:54:21.853558+0000","last_active":"2024-09-16T01:54:26.900438+0000","last_peered":"2024-09-16T01:54:26.900438+0000","last_clean":"2024-09-16T01:54:26.900438+0000","last_became_active":"2024-09-16T01:54:21.853234+0000","last_became_peered":"2024-09-16T01:54:21.853234+0000","last_unstale":"2024-09-16T01:54:26.900438+0000","last_undegraded":"2024-09-16T01:54:26.900438+0000","last_fullsized":"2024-09-16T01:54:26.900438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:58.346519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145294+0000","last_change":"2024-09-16T01:54:21.864089+0000","last_active":"2024-09-16T01:54:28.145294+0000","last_peered":"2024-09-16T01:54:28.145294+0000","last_clean":"2024-09-16T01:54:28.145294+0000","last_became_active":"2024-09-16T01:54:21.863778+0000","last_became_peered":"2024-09-16T01:54:21.863778+0000","last_unstale":"2024-09-16T01:54:28.145294+0000","last_undegraded":"2024-09-16T01:54:28.145294+0000","last_fullsized":"2024-09-16T01:54:28.145294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145937+0000","last_change":"2024-09-16T01:54:21.860265+0000","last_active":"2024-09-16T01:54:28.145937+0000","last_peered":"2024-09-16T01:54:28.145937+0000","last_clean":"2024-09-16T01:54:28.145937+0000","last_became_active":"2024-09-16T01:54:21.859906+0000","last_became_peered":"2024-09-16T01:54:21.859906+0000","last_unstale":"2024-09-16T01:54:28.145937+0000","last_undegraded":"2024-09-16T01:54:28.145937+0000","last_fullsized":"2024-09-16T01:54:28.145937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145883+0000","last_change":"2024-09-16T01:54:21.867977+0000","last_active":"2024-09-16T01:54:28.145883+0000","last_peered":"2024-09-16T01:54:28.145883+0000","last_clean":"2024-09-16T01:54:28.145883+0000","last_became_active":"2024-09-16T01:54:21.867663+0000","last_became_peered":"2024-09-16T01:54:21.867663+0000","last_unstale":"2024-09-16T01:54:28.145883+0000","last_undegraded":"2024-09-16T01:54:28.145883+0000","last_fullsized":"2024-09-16T01:54:28.145883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:17.473803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898589+0000","last_change":"2024-09-16T01:54:21.858992+0000","last_active":"2024-09-16T01:54:26.898589+0000","last_peered":"2024-09-16T01:54:26.898589+0000","last_clean":"2024-09-16T01:54:26.898589+0000","last_became_active":"2024-09-16T01:54:21.858478+0000","last_became_peered":"2024-09-16T01:54:21.858478+0000","last_unstale":"2024-09-16T01:54:26.898589+0000","last_undegraded":"2024-09-16T01:54:26.898589+0000","last_fullsized":"2024-09-16T01:54:26.898589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145247+0000","last_change":"2024-09-16T01:54:21.866468+0000","last_active":"2024-09-16T01:54:28.145247+0000","last_peered":"2024-09-16T01:54:28.145247+0000","last_clean":"2024-09-16T01:54:28.145247+0000","last_became_active":"2024-09-16T01:54:21.866127+0000","last_became_peered":"2024-09-16T01:54:21.866127+0000","last_unstale":"2024-09-16T01:54:28.145247+0000","last_undegraded":"2024-09-16T01:54:28.145247+0000","last_fullsized":"2024-09-16T01:54:28.145247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:15.758941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678085+0000","last_change":"2024-09-16T01:54:21.863734+0000","last_active":"2024-09-16T01:54:27.678085+0000","last_peered":"2024-09-16T01:54:27.678085+0000","last_clean":"2024-09-16T01:54:27.678085+0000","last_became_active":"2024-09-16T01:54:21.863440+0000","last_became_peered":"2024-09-16T01:54:21.863440+0000","last_unstale":"2024-09-16T01:54:27.678085+0000","last_undegraded":"2024-09-16T01:54:27.678085+0000","last_fullsized":"2024-09-16T01:54:27.678085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145475+0000","last_change":"2024-09-16T01:54:21.862517+0000","last_active":"2024-09-16T01:54:28.145475+0000","last_peered":"2024-09-16T01:54:28.145475+0000","last_clean":"2024-09-16T01:54:28.145475+0000","last_became_active":"2024-09-16T01:54:21.862211+0000","last_became_peered":"2024-09-16T01:54:21.862211+0000","last_unstale":"2024-09-16T01:54:28.145475+0000","last_undegraded":"2024-09-16T01:54:28.145475+0000","last_fullsized":"2024-09-16T01:54:28.145475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:12:08.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678116+0000","last_change":"2024-09-16T01:54:21.866825+0000","last_active":"2024-09-16T01:54:27.678116+0000","last_peered":"2024-09-16T01:54:27.678116+0000","last_clean":"2024-09-16T01:54:27.678116+0000","last_became_active":"2024-09-16T01:54:21.866552+0000","last_became_peered":"2024-09-16T01:54:21.866552+0000","last_unstale":"2024-09-16T01:54:27.678116+0000","last_undegraded":"2024-09-16T01:54:27.678116+0000","last_fullsized":"2024-09-16T01:54:27.678116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144763+0000","last_change":"2024-09-16T01:54:21.864915+0000","last_active":"2024-09-16T01:54:28.144763+0000","last_peered":"2024-09-16T01:54:28.144763+0000","last_clean":"2024-09-16T01:54:28.144763+0000","last_became_active":"2024-09-16T01:54:21.864522+0000","last_became_peered":"2024-09-16T01:54:21.864522+0000","last_unstale":"2024-09-16T01:54:28.144763+0000","last_undegraded":"2024-09-16T01:54:28.144763+0000","last_fullsized":"2024-09-16T01:54:28.144763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644314+0000","last_change":"2024-09-16T01:54:21.863988+0000","last_active":"2024-09-16T01:54:27.644314+0000","last_peered":"2024-09-16T01:54:27.644314+0000","last_clean":"2024-09-16T01:54:27.644314+0000","last_became_active":"2024-09-16T01:54:21.863692+0000","last_became_peered":"2024-09-16T01:54:21.863692+0000","last_unstale":"2024-09-16T01:54:27.644314+0000","last_undegraded":"2024-09-16T01:54:27.644314+0000","last_fullsized":"2024-09-16T01:54:27.644314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145865+0000","last_change":"2024-09-16T01:54:21.862642+0000","last_active":"2024-09-16T01:54:28.145865+0000","last_peered":"2024-09-16T01:54:28.145865+0000","last_clean":"2024-09-16T01:54:28.145865+0000","last_became_active":"2024-09-16T01:54:21.862364+0000","last_became_peered":"2024-09-16T01:54:21.862364+0000","last_unstale":"2024-09-16T01:54:28.145865+0000","last_undegraded":"2024-09-16T01:54:28.145865+0000","last_fullsized":"2024-09-16T01:54:28.145865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:37.651766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":106307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":102623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":693469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":102463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:54:46.343 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:54:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.478+0000 7f2e50ac9640 1 Processor -- start 2024-09-16T01:54:46.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.478+0000 7f2e50ac9640 1 -- start start 2024-09-16T01:54:46.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e50ac9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0d04a0 0x7f2e4c0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e50ac9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4c06cb30 con 0x7f2e4c147360 2024-09-16T01:54:46.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e50ac9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4c06bfb0 con 0x7f2e4c0ae550 2024-09-16T01:54:46.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e50ac9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4c06c290 con 0x7f2e4c0d04a0 2024-09-16T01:54:46.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4a59c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2e4c147360 0x7f2e4c070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45524/0 (socket says 172.21.15.42:45524) 2024-09-16T01:54:46.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4a59c640 1 -- 172.21.15.42:0/1578852732 learned_addr learned my addr 172.21.15.42:0/1578852732 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:46.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e49d9b640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0d04a0 0x7f2e4c0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1867174647 0 0) 0x7f2e4c06cb30 con 0x7f2e4c147360 2024-09-16T01:54:46.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e34003520 con 0x7f2e4c147360 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2416980478 0 0) 0x7f2e34003520 con 0x7f2e4c147360 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0d04a0 msgr2=0x7f2e4c0d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4959a640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0d04a0 0x7f2e4c0d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 >> v1:172.21.15.107:6789/0 conn(0x7f2e4c0ae550 legacy=0x7f2e4c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4c06c570 con 0x7f2e4c147360 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f2e3c001670 con 0x7f2e4c147360 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.479+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 >> v1:172.21.15.42:6789/0 conn(0x7f2e4c147360 legacy=0x7f2e4c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e4959a640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0d04a0 0x7f2e340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e4959a640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 0x7f2e34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e4959a640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e34004d40 0x7f2e340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4c06c290 con 0x7f2e34003f20 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3400bad0 con 0x7f2e34004d40 2024-09-16T01:54:46.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3400bcd0 con 0x7f2e4c0d04a0 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e49d9b640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 0x7f2e34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e4a59c640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0d04a0 0x7f2e340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e4ad9d640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e34004d40 0x7f2e340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e49d9b640 1 -- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0d04a0 msgr2=0x7f2e340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e49d9b640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0d04a0 0x7f2e340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e49d9b640 1 -- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e34004d40 msgr2=0x7f2e340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e49d9b640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e34004d40 0x7f2e340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.480+0000 7f2e49d9b640 1 -- 172.21.15.42:0/1578852732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e34003520 con 0x7f2e34003f20 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.481+0000 7f2e49d9b640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 0x7f2e34004800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009ac0 tx=0x7f2e34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9b9eab53300a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.481+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40036070 con 0x7f2e34003f20 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.481+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e40031400 con 0x7f2e34003f20 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.481+0000 7f2e4959a640 1 -- 172.21.15.42:0/1578852732 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40009690 con 0x7f2e34003f20 2024-09-16T01:54:46.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.481+0000 7f2e50ac9640 1 -- 172.21.15.42:0/1578852732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 msgr2=0x7f2e34004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.481+0000 7f2e50ac9640 1 --2- 172.21.15.42:0/1578852732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 0x7f2e34004800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009ac0 tx=0x7f2e34005830 comp rx=0 tx=0).stop 2024-09-16T01:54:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.481+0000 7f2e4ad9d640 1 -- 172.21.15.42:0/1578852732 reap_dead start 2024-09-16T01:54:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.481+0000 7f2e50ac9640 1 -- 172.21.15.42:0/1578852732 shutdown_connections 2024-09-16T01:54:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.481+0000 7f2e50ac9640 1 -- 172.21.15.42:0/1578852732 >> 172.21.15.42:0/1578852732 conn(0x7f2e4c0b2f40 msgr2=0x7f2e4c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.482+0000 7f2e50ac9640 1 -- 172.21.15.42:0/1578852732 shutdown_connections 2024-09-16T01:54:46.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.482+0000 7f2e50ac9640 1 -- 172.21.15.42:0/1578852732 wait complete. 2024-09-16T01:54:46.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.483+0000 7f2e50ac9640 1 Processor -- start 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.483+0000 7f2e50ac9640 1 -- start start 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e50ac9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 0x7f2e4c09d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e50ac9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0b6aa0 0x7f2e4c1f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e50ac9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e4c0b6f20 0x7f2e4c1f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e50ac9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4c06bc10 con 0x7f2e34003f20 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e50ac9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4c070fa0 con 0x7f2e4c0b6f20 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e50ac9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4c06bd90 con 0x7f2e4c0b6aa0 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e4a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 0x7f2e4c09d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e4a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 0x7f2e4c09d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53600/0 (socket says 172.21.15.42:53600) 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e4a59c640 1 -- 172.21.15.42:0/4138820799 learned_addr learned my addr 172.21.15.42:0/4138820799 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e49d9b640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0b6aa0 0x7f2e4c1f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e4ad9d640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e4c0b6f20 0x7f2e4c1f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e4a59c640 1 -- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0b6aa0 msgr2=0x7f2e4c1f78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e4a59c640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0b6aa0 0x7f2e4c1f78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e4a59c640 1 -- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e4c0b6f20 msgr2=0x7f2e4c1f7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e4a59c640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e4c0b6f20 0x7f2e4c1f7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e4a59c640 1 -- 172.21.15.42:0/4138820799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4c0cd060 con 0x7f2e34003f20 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e4a59c640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 0x7f2e4c09d2e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0072c0 tx=0x7f2e3c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.484+0000 7f2e3affd640 1 -- 172.21.15.42:0/4138820799 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00f860 con 0x7f2e34003f20 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.485+0000 7f2e3affd640 1 -- 172.21.15.42:0/4138820799 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e3c018070 con 0x7f2e34003f20 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.485+0000 7f2e50ac9640 1 -- 172.21.15.42:0/4138820799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e4c0ca8a0 con 0x7f2e34003f20 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.485+0000 7f2e3affd640 1 -- 172.21.15.42:0/4138820799 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00fc80 con 0x7f2e34003f20 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.485+0000 7f2e50ac9640 1 -- 172.21.15.42:0/4138820799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e4c0cd2d0 con 0x7f2e34003f20 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.486+0000 7f2e50ac9640 1 -- 172.21.15.42:0/4138820799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e4c068c60 con 0x7f2e34003f20 2024-09-16T01:54:46.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.486+0000 7f2e3affd640 1 -- 172.21.15.42:0/4138820799 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e3c01d460 con 0x7f2e34003f20 2024-09-16T01:54:46.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.487+0000 7f2e3affd640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2e2c06c2e0 0x7f2e2c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.487+0000 7f2e3affd640 1 -- 172.21.15.42:0/4138820799 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2e3c08b5c0 con 0x7f2e34003f20 2024-09-16T01:54:46.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.487+0000 7f2e49d9b640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2e2c06c2e0 0x7f2e2c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.487+0000 7f2e49d9b640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2e2c06c2e0 0x7f2e2c06e7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2e40033000 tx=0x7f2e40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:46.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.491+0000 7f2e3affd640 1 -- 172.21.15.42:0/4138820799 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e4c068c60 con 0x7f2e34003f20 2024-09-16T01:54:46.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.662+0000 7f2e50ac9640 1 -- 172.21.15.42:0/4138820799 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e4c0cf170 con 0x7f2e2c06c2e0 2024-09-16T01:54:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.670+0000 7f2e3affd640 1 -- 172.21.15.42:0/4138820799 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f2e4c0cf170 con 0x7f2e2c06c2e0 2024-09-16T01:54:46.676 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:46.678 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:54:46.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.673+0000 7f2e50ac9640 1 -- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2e2c06c2e0 msgr2=0x7f2e2c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.673+0000 7f2e50ac9640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2e2c06c2e0 0x7f2e2c06e7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2e40033000 tx=0x7f2e40008030 comp rx=0 tx=0).stop 2024-09-16T01:54:46.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.673+0000 7f2e50ac9640 1 -- 172.21.15.42:0/4138820799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 msgr2=0x7f2e4c09d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.673+0000 7f2e50ac9640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 0x7f2e4c09d2e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0072c0 tx=0x7f2e3c007780 comp rx=0 tx=0).stop 2024-09-16T01:54:46.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.673+0000 7f2e50ac9640 1 -- 172.21.15.42:0/4138820799 shutdown_connections 2024-09-16T01:54:46.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.673+0000 7f2e50ac9640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2e2c06c2e0 0x7f2e2c06e7a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.673+0000 7f2e50ac9640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e4c0b6f20 0x7f2e4c1f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.673+0000 7f2e50ac9640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2e4c0b6aa0 0x7f2e4c1f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.673+0000 7f2e50ac9640 1 --2- 172.21.15.42:0/4138820799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e34003f20 0x7f2e4c09d2e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.673+0000 7f2e50ac9640 1 -- 172.21.15.42:0/4138820799 >> 172.21.15.42:0/4138820799 conn(0x7f2e4c0b2f40 msgr2=0x7f2e4c0b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:46.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.674+0000 7f2e50ac9640 1 -- 172.21.15.42:0/4138820799 shutdown_connections 2024-09-16T01:54:46.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.674+0000 7f2e50ac9640 1 -- 172.21.15.42:0/4138820799 wait complete. 2024-09-16T01:54:46.687 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-16T01:54:46.255344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236100,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738620,"statfs":{"total":773094113280,"available":772852346880,"internally_reserved":0,"allocated":3317760,"data_stored":2009724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003131"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145216+0000","last_change":"2024-09-16T01:54:20.860255+0000","last_active":"2024-09-16T01:54:28.145216+0000","last_peered":"2024-09-16T01:54:28.145216+0000","last_clean":"2024-09-16T01:54:28.145216+0000","last_became_active":"2024-09-16T01:54:20.859944+0000","last_became_peered":"2024-09-16T01:54:20.859944+0000","last_unstale":"2024-09-16T01:54:28.145216+0000","last_undegraded":"2024-09-16T01:54:28.145216+0000","last_fullsized":"2024-09-16T01:54:28.145216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:39.081955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899508+0000","last_change":"2024-09-16T01:54:21.859551+0000","last_active":"2024-09-16T01:54:26.899508+0000","last_peered":"2024-09-16T01:54:26.899508+0000","last_clean":"2024-09-16T01:54:26.899508+0000","last_became_active":"2024-09-16T01:54:21.858047+0000","last_became_peered":"2024-09-16T01:54:21.858047+0000","last_unstale":"2024-09-16T01:54:26.899508+0000","last_undegraded":"2024-09-16T01:54:26.899508+0000","last_fullsized":"2024-09-16T01:54:26.899508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:29.948383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898563+0000","last_change":"2024-09-16T01:54:25.964125+0000","last_active":"2024-09-16T01:54:26.898563+0000","last_peered":"2024-09-16T01:54:26.898563+0000","last_clean":"2024-09-16T01:54:26.898563+0000","last_became_active":"2024-09-16T01:54:25.963738+0000","last_became_peered":"2024-09-16T01:54:25.963738+0000","last_unstale":"2024-09-16T01:54:26.898563+0000","last_undegraded":"2024-09-16T01:54:26.898563+0000","last_fullsized":"2024-09-16T01:54:26.898563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:06.129448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899601+0000","last_change":"2024-09-16T01:54:20.861025+0000","last_active":"2024-09-16T01:54:26.899601+0000","last_peered":"2024-09-16T01:54:26.899601+0000","last_clean":"2024-09-16T01:54:26.899601+0000","last_became_active":"2024-09-16T01:54:20.858817+0000","last_became_peered":"2024-09-16T01:54:20.858817+0000","last_unstale":"2024-09-16T01:54:26.899601+0000","last_undegraded":"2024-09-16T01:54:26.899601+0000","last_fullsized":"2024-09-16T01:54:26.899601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144849+0000","last_change":"2024-09-16T01:54:21.867670+0000","last_active":"2024-09-16T01:54:28.144849+0000","last_peered":"2024-09-16T01:54:28.144849+0000","last_clean":"2024-09-16T01:54:28.144849+0000","last_became_active":"2024-09-16T01:54:21.866666+0000","last_became_peered":"2024-09-16T01:54:21.866666+0000","last_unstale":"2024-09-16T01:54:28.144849+0000","last_undegraded":"2024-09-16T01:54:28.144849+0000","last_fullsized":"2024-09-16T01:54:28.144849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899530+0000","last_change":"2024-09-16T01:54:25.877304+0000","last_active":"2024-09-16T01:54:26.899530+0000","last_peered":"2024-09-16T01:54:26.899530+0000","last_clean":"2024-09-16T01:54:26.899530+0000","last_became_active":"2024-09-16T01:54:25.876643+0000","last_became_peered":"2024-09-16T01:54:25.876643+0000","last_unstale":"2024-09-16T01:54:26.899530+0000","last_undegraded":"2024-09-16T01:54:26.899530+0000","last_fullsized":"2024-09-16T01:54:26.899530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:15.866095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145670+0000","last_change":"2024-09-16T01:54:20.860557+0000","last_active":"2024-09-16T01:54:28.145670+0000","last_peered":"2024-09-16T01:54:28.145670+0000","last_clean":"2024-09-16T01:54:28.145670+0000","last_became_active":"2024-09-16T01:54:20.860254+0000","last_became_peered":"2024-09-16T01:54:20.860254+0000","last_unstale":"2024-09-16T01:54:28.145670+0000","last_undegraded":"2024-09-16T01:54:28.145670+0000","last_fullsized":"2024-09-16T01:54:28.145670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:16.893601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678222+0000","last_change":"2024-09-16T01:54:21.860466+0000","last_active":"2024-09-16T01:54:27.678222+0000","last_peered":"2024-09-16T01:54:27.678222+0000","last_clean":"2024-09-16T01:54:27.678222+0000","last_became_active":"2024-09-16T01:54:21.860191+0000","last_became_peered":"2024-09-16T01:54:21.860191+0000","last_unstale":"2024-09-16T01:54:27.678222+0000","last_undegraded":"2024-09-16T01:54:27.678222+0000","last_fullsized":"2024-09-16T01:54:27.678222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:47.165464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899752+0000","last_change":"2024-09-16T01:54:25.877667+0000","last_active":"2024-09-16T01:54:26.899752+0000","last_peered":"2024-09-16T01:54:26.899752+0000","last_clean":"2024-09-16T01:54:26.899752+0000","last_became_active":"2024-09-16T01:54:25.876568+0000","last_became_peered":"2024-09-16T01:54:25.876568+0000","last_unstale":"2024-09-16T01:54:26.899752+0000","last_undegraded":"2024-09-16T01:54:26.899752+0000","last_fullsized":"2024-09-16T01:54:26.899752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:33.969016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145351+0000","last_change":"2024-09-16T01:54:20.862062+0000","last_active":"2024-09-16T01:54:28.145351+0000","last_peered":"2024-09-16T01:54:28.145351+0000","last_clean":"2024-09-16T01:54:28.145351+0000","last_became_active":"2024-09-16T01:54:20.861764+0000","last_became_peered":"2024-09-16T01:54:20.861764+0000","last_unstale":"2024-09-16T01:54:28.145351+0000","last_undegraded":"2024-09-16T01:54:28.145351+0000","last_fullsized":"2024-09-16T01:54:28.145351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:02.378815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678304+0000","last_change":"2024-09-16T01:54:21.857448+0000","last_active":"2024-09-16T01:54:27.678304+0000","last_peered":"2024-09-16T01:54:27.678304+0000","last_clean":"2024-09-16T01:54:27.678304+0000","last_became_active":"2024-09-16T01:54:21.857131+0000","last_became_peered":"2024-09-16T01:54:21.857131+0000","last_unstale":"2024-09-16T01:54:27.678304+0000","last_undegraded":"2024-09-16T01:54:27.678304+0000","last_fullsized":"2024-09-16T01:54:27.678304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:46.608693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899648+0000","last_change":"2024-09-16T01:54:25.873795+0000","last_active":"2024-09-16T01:54:26.899648+0000","last_peered":"2024-09-16T01:54:26.899648+0000","last_clean":"2024-09-16T01:54:26.899648+0000","last_became_active":"2024-09-16T01:54:25.873379+0000","last_became_peered":"2024-09-16T01:54:25.873379+0000","last_unstale":"2024-09-16T01:54:26.899648+0000","last_undegraded":"2024-09-16T01:54:26.899648+0000","last_fullsized":"2024-09-16T01:54:26.899648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:43.663709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144634+0000","last_change":"2024-09-16T01:54:21.858785+0000","last_active":"2024-09-16T01:54:28.144634+0000","last_peered":"2024-09-16T01:54:28.144634+0000","last_clean":"2024-09-16T01:54:28.144634+0000","last_became_active":"2024-09-16T01:54:21.858450+0000","last_became_peered":"2024-09-16T01:54:21.858450+0000","last_unstale":"2024-09-16T01:54:28.144634+0000","last_undegraded":"2024-09-16T01:54:28.144634+0000","last_fullsized":"2024-09-16T01:54:28.144634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145654+0000","last_change":"2024-09-16T01:54:20.859619+0000","last_active":"2024-09-16T01:54:28.145654+0000","last_peered":"2024-09-16T01:54:28.145654+0000","last_clean":"2024-09-16T01:54:28.145654+0000","last_became_active":"2024-09-16T01:54:20.859348+0000","last_became_peered":"2024-09-16T01:54:20.859348+0000","last_unstale":"2024-09-16T01:54:28.145654+0000","last_undegraded":"2024-09-16T01:54:28.145654+0000","last_fullsized":"2024-09-16T01:54:28.145654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:32.717638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899990+0000","last_change":"2024-09-16T01:54:25.876988+0000","last_active":"2024-09-16T01:54:26.899990+0000","last_peered":"2024-09-16T01:54:26.899990+0000","last_clean":"2024-09-16T01:54:26.899990+0000","last_became_active":"2024-09-16T01:54:25.876405+0000","last_became_peered":"2024-09-16T01:54:25.876405+0000","last_unstale":"2024-09-16T01:54:26.899990+0000","last_undegraded":"2024-09-16T01:54:26.899990+0000","last_fullsized":"2024-09-16T01:54:26.899990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:51.186097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898948+0000","last_change":"2024-09-16T01:54:21.866597+0000","last_active":"2024-09-16T01:54:26.898948+0000","last_peered":"2024-09-16T01:54:26.898948+0000","last_clean":"2024-09-16T01:54:26.898948+0000","last_became_active":"2024-09-16T01:54:21.866303+0000","last_became_peered":"2024-09-16T01:54:21.866303+0000","last_unstale":"2024-09-16T01:54:26.898948+0000","last_undegraded":"2024-09-16T01:54:26.898948+0000","last_fullsized":"2024-09-16T01:54:26.898948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:57.597318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644331+0000","last_change":"2024-09-16T01:54:20.851271+0000","last_active":"2024-09-16T01:54:27.644331+0000","last_peered":"2024-09-16T01:54:27.644331+0000","last_clean":"2024-09-16T01:54:27.644331+0000","last_became_active":"2024-09-16T01:54:20.850597+0000","last_became_peered":"2024-09-16T01:54:20.850597+0000","last_unstale":"2024-09-16T01:54:27.644331+0000","last_undegraded":"2024-09-16T01:54:27.644331+0000","last_fullsized":"2024-09-16T01:54:27.644331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900473+0000","last_change":"2024-09-16T01:54:25.876997+0000","last_active":"2024-09-16T01:54:26.900473+0000","last_peered":"2024-09-16T01:54:26.900473+0000","last_clean":"2024-09-16T01:54:26.900473+0000","last_became_active":"2024-09-16T01:54:25.876501+0000","last_became_peered":"2024-09-16T01:54:25.876501+0000","last_unstale":"2024-09-16T01:54:26.900473+0000","last_undegraded":"2024-09-16T01:54:26.900473+0000","last_fullsized":"2024-09-16T01:54:26.900473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899001+0000","last_change":"2024-09-16T01:54:21.852096+0000","last_active":"2024-09-16T01:54:26.899001+0000","last_peered":"2024-09-16T01:54:26.899001+0000","last_clean":"2024-09-16T01:54:26.899001+0000","last_became_active":"2024-09-16T01:54:21.848364+0000","last_became_peered":"2024-09-16T01:54:21.848364+0000","last_unstale":"2024-09-16T01:54:26.899001+0000","last_undegraded":"2024-09-16T01:54:26.899001+0000","last_fullsized":"2024-09-16T01:54:26.899001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643861+0000","last_change":"2024-09-16T01:54:20.852050+0000","last_active":"2024-09-16T01:54:27.643861+0000","last_peered":"2024-09-16T01:54:27.643861+0000","last_clean":"2024-09-16T01:54:27.643861+0000","last_became_active":"2024-09-16T01:54:20.851725+0000","last_became_peered":"2024-09-16T01:54:20.851725+0000","last_unstale":"2024-09-16T01:54:27.643861+0000","last_undegraded":"2024-09-16T01:54:27.643861+0000","last_fullsized":"2024-09-16T01:54:27.643861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644337+0000","last_change":"2024-09-16T01:54:25.962379+0000","last_active":"2024-09-16T01:54:27.644337+0000","last_peered":"2024-09-16T01:54:27.644337+0000","last_clean":"2024-09-16T01:54:27.644337+0000","last_became_active":"2024-09-16T01:54:25.961815+0000","last_became_peered":"2024-09-16T01:54:25.961815+0000","last_unstale":"2024-09-16T01:54:27.644337+0000","last_undegraded":"2024-09-16T01:54:27.644337+0000","last_fullsized":"2024-09-16T01:54:27.644337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:58.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900426+0000","last_change":"2024-09-16T01:54:21.846558+0000","last_active":"2024-09-16T01:54:26.900426+0000","last_peered":"2024-09-16T01:54:26.900426+0000","last_clean":"2024-09-16T01:54:26.900426+0000","last_became_active":"2024-09-16T01:54:21.846226+0000","last_became_peered":"2024-09-16T01:54:21.846226+0000","last_unstale":"2024-09-16T01:54:26.900426+0000","last_undegraded":"2024-09-16T01:54:26.900426+0000","last_fullsized":"2024-09-16T01:54:26.900426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:22.658145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144908+0000","last_change":"2024-09-16T01:54:20.857121+0000","last_active":"2024-09-16T01:54:28.144908+0000","last_peered":"2024-09-16T01:54:28.144908+0000","last_clean":"2024-09-16T01:54:28.144908+0000","last_became_active":"2024-09-16T01:54:20.856852+0000","last_became_peered":"2024-09-16T01:54:20.856852+0000","last_unstale":"2024-09-16T01:54:28.144908+0000","last_undegraded":"2024-09-16T01:54:28.144908+0000","last_fullsized":"2024-09-16T01:54:28.144908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:40.354708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899928+0000","last_change":"2024-09-16T01:54:25.883440+0000","last_active":"2024-09-16T01:54:26.899928+0000","last_peered":"2024-09-16T01:54:26.899928+0000","last_clean":"2024-09-16T01:54:26.899928+0000","last_became_active":"2024-09-16T01:54:25.883010+0000","last_became_peered":"2024-09-16T01:54:25.883010+0000","last_unstale":"2024-09-16T01:54:26.899928+0000","last_undegraded":"2024-09-16T01:54:26.899928+0000","last_fullsized":"2024-09-16T01:54:26.899928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:00:01.617950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145309+0000","last_change":"2024-09-16T01:54:21.851620+0000","last_active":"2024-09-16T01:54:28.145309+0000","last_peered":"2024-09-16T01:54:28.145309+0000","last_clean":"2024-09-16T01:54:28.145309+0000","last_became_active":"2024-09-16T01:54:21.851295+0000","last_became_peered":"2024-09-16T01:54:21.851295+0000","last_unstale":"2024-09-16T01:54:28.145309+0000","last_undegraded":"2024-09-16T01:54:28.145309+0000","last_fullsized":"2024-09-16T01:54:28.145309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.146152+0000","last_change":"2024-09-16T01:54:20.852819+0000","last_active":"2024-09-16T01:54:28.146152+0000","last_peered":"2024-09-16T01:54:28.146152+0000","last_clean":"2024-09-16T01:54:28.146152+0000","last_became_active":"2024-09-16T01:54:20.852524+0000","last_became_peered":"2024-09-16T01:54:20.852524+0000","last_unstale":"2024-09-16T01:54:28.146152+0000","last_undegraded":"2024-09-16T01:54:28.146152+0000","last_fullsized":"2024-09-16T01:54:28.146152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899618+0000","last_change":"2024-09-16T01:54:25.964272+0000","last_active":"2024-09-16T01:54:26.899618+0000","last_peered":"2024-09-16T01:54:26.899618+0000","last_clean":"2024-09-16T01:54:26.899618+0000","last_became_active":"2024-09-16T01:54:25.963859+0000","last_became_peered":"2024-09-16T01:54:25.963859+0000","last_unstale":"2024-09-16T01:54:26.899618+0000","last_undegraded":"2024-09-16T01:54:26.899618+0000","last_fullsized":"2024-09-16T01:54:26.899618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:46.344559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899722+0000","last_change":"2024-09-16T01:54:21.857608+0000","last_active":"2024-09-16T01:54:26.899722+0000","last_peered":"2024-09-16T01:54:26.899722+0000","last_clean":"2024-09-16T01:54:26.899722+0000","last_became_active":"2024-09-16T01:54:21.857318+0000","last_became_peered":"2024-09-16T01:54:21.857318+0000","last_unstale":"2024-09-16T01:54:26.899722+0000","last_undegraded":"2024-09-16T01:54:26.899722+0000","last_fullsized":"2024-09-16T01:54:26.899722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644409+0000","last_change":"2024-09-16T01:54:20.852273+0000","last_active":"2024-09-16T01:54:27.644409+0000","last_peered":"2024-09-16T01:54:27.644409+0000","last_clean":"2024-09-16T01:54:27.644409+0000","last_became_active":"2024-09-16T01:54:20.850797+0000","last_became_peered":"2024-09-16T01:54:20.850797+0000","last_unstale":"2024-09-16T01:54:27.644409+0000","last_undegraded":"2024-09-16T01:54:27.644409+0000","last_fullsized":"2024-09-16T01:54:27.644409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898502+0000","last_change":"2024-09-16T01:54:25.962387+0000","last_active":"2024-09-16T01:54:26.898502+0000","last_peered":"2024-09-16T01:54:26.898502+0000","last_clean":"2024-09-16T01:54:26.898502+0000","last_became_active":"2024-09-16T01:54:25.961663+0000","last_became_peered":"2024-09-16T01:54:25.961663+0000","last_unstale":"2024-09-16T01:54:26.898502+0000","last_undegraded":"2024-09-16T01:54:26.898502+0000","last_fullsized":"2024-09-16T01:54:26.898502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:47:57.197478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644408+0000","last_change":"2024-09-16T01:54:21.847291+0000","last_active":"2024-09-16T01:54:27.644408+0000","last_peered":"2024-09-16T01:54:27.644408+0000","last_clean":"2024-09-16T01:54:27.644408+0000","last_became_active":"2024-09-16T01:54:21.847040+0000","last_became_peered":"2024-09-16T01:54:21.847040+0000","last_unstale":"2024-09-16T01:54:27.644408+0000","last_undegraded":"2024-09-16T01:54:27.644408+0000","last_fullsized":"2024-09-16T01:54:27.644408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145796+0000","last_change":"2024-09-16T01:54:20.858004+0000","last_active":"2024-09-16T01:54:28.145796+0000","last_peered":"2024-09-16T01:54:28.145796+0000","last_clean":"2024-09-16T01:54:28.145796+0000","last_became_active":"2024-09-16T01:54:20.857658+0000","last_became_peered":"2024-09-16T01:54:20.857658+0000","last_unstale":"2024-09-16T01:54:28.145796+0000","last_undegraded":"2024-09-16T01:54:28.145796+0000","last_fullsized":"2024-09-16T01:54:28.145796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:30.831030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144709+0000","last_change":"2024-09-16T01:54:25.962169+0000","last_active":"2024-09-16T01:54:28.144709+0000","last_peered":"2024-09-16T01:54:28.144709+0000","last_clean":"2024-09-16T01:54:28.144709+0000","last_became_active":"2024-09-16T01:54:25.961782+0000","last_became_peered":"2024-09-16T01:54:25.961782+0000","last_unstale":"2024-09-16T01:54:28.144709+0000","last_undegraded":"2024-09-16T01:54:28.144709+0000","last_fullsized":"2024-09-16T01:54:28.144709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:33.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678479+0000","last_change":"2024-09-16T01:54:21.867456+0000","last_active":"2024-09-16T01:54:27.678479+0000","last_peered":"2024-09-16T01:54:27.678479+0000","last_clean":"2024-09-16T01:54:27.678479+0000","last_became_active":"2024-09-16T01:54:21.867216+0000","last_became_peered":"2024-09-16T01:54:21.867216+0000","last_unstale":"2024-09-16T01:54:27.678479+0000","last_undegraded":"2024-09-16T01:54:27.678479+0000","last_fullsized":"2024-09-16T01:54:27.678479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:35.318988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644449+0000","last_change":"2024-09-16T01:54:20.859065+0000","last_active":"2024-09-16T01:54:27.644449+0000","last_peered":"2024-09-16T01:54:27.644449+0000","last_clean":"2024-09-16T01:54:27.644449+0000","last_became_active":"2024-09-16T01:54:20.858786+0000","last_became_peered":"2024-09-16T01:54:20.858786+0000","last_unstale":"2024-09-16T01:54:27.644449+0000","last_undegraded":"2024-09-16T01:54:27.644449+0000","last_fullsized":"2024-09-16T01:54:27.644449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643956+0000","last_change":"2024-09-16T01:54:25.879436+0000","last_active":"2024-09-16T01:54:27.643956+0000","last_peered":"2024-09-16T01:54:27.643956+0000","last_clean":"2024-09-16T01:54:27.643956+0000","last_became_active":"2024-09-16T01:54:25.878984+0000","last_became_peered":"2024-09-16T01:54:25.878984+0000","last_unstale":"2024-09-16T01:54:27.643956+0000","last_undegraded":"2024-09-16T01:54:27.643956+0000","last_fullsized":"2024-09-16T01:54:27.643956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900343+0000","last_change":"2024-09-16T01:54:21.860170+0000","last_active":"2024-09-16T01:54:26.900343+0000","last_peered":"2024-09-16T01:54:26.900343+0000","last_clean":"2024-09-16T01:54:26.900343+0000","last_became_active":"2024-09-16T01:54:21.859874+0000","last_became_peered":"2024-09-16T01:54:21.859874+0000","last_unstale":"2024-09-16T01:54:26.900343+0000","last_undegraded":"2024-09-16T01:54:26.900343+0000","last_fullsized":"2024-09-16T01:54:26.900343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:59.832590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678402+0000","last_change":"2024-09-16T01:54:20.857370+0000","last_active":"2024-09-16T01:54:27.678402+0000","last_peered":"2024-09-16T01:54:27.678402+0000","last_clean":"2024-09-16T01:54:27.678402+0000","last_became_active":"2024-09-16T01:54:20.856000+0000","last_became_peered":"2024-09-16T01:54:20.856000+0000","last_unstale":"2024-09-16T01:54:27.678402+0000","last_undegraded":"2024-09-16T01:54:27.678402+0000","last_fullsized":"2024-09-16T01:54:27.678402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:58.827329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644309+0000","last_change":"2024-09-16T01:54:25.880804+0000","last_active":"2024-09-16T01:54:27.644309+0000","last_peered":"2024-09-16T01:54:27.644309+0000","last_clean":"2024-09-16T01:54:27.644309+0000","last_became_active":"2024-09-16T01:54:25.880417+0000","last_became_peered":"2024-09-16T01:54:25.880417+0000","last_unstale":"2024-09-16T01:54:27.644309+0000","last_undegraded":"2024-09-16T01:54:27.644309+0000","last_fullsized":"2024-09-16T01:54:27.644309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:33.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643890+0000","last_change":"2024-09-16T01:54:21.845793+0000","last_active":"2024-09-16T01:54:27.643890+0000","last_peered":"2024-09-16T01:54:27.643890+0000","last_clean":"2024-09-16T01:54:27.643890+0000","last_became_active":"2024-09-16T01:54:21.845499+0000","last_became_peered":"2024-09-16T01:54:21.845499+0000","last_unstale":"2024-09-16T01:54:27.643890+0000","last_undegraded":"2024-09-16T01:54:27.643890+0000","last_fullsized":"2024-09-16T01:54:27.643890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144310+0000","last_change":"2024-09-16T01:54:20.858565+0000","last_active":"2024-09-16T01:54:28.144310+0000","last_peered":"2024-09-16T01:54:28.144310+0000","last_clean":"2024-09-16T01:54:28.144310+0000","last_became_active":"2024-09-16T01:54:20.858190+0000","last_became_peered":"2024-09-16T01:54:20.858190+0000","last_unstale":"2024-09-16T01:54:28.144310+0000","last_undegraded":"2024-09-16T01:54:28.144310+0000","last_fullsized":"2024-09-16T01:54:28.144310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:08.777600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644440+0000","last_change":"2024-09-16T01:54:25.880758+0000","last_active":"2024-09-16T01:54:27.644440+0000","last_peered":"2024-09-16T01:54:27.644440+0000","last_clean":"2024-09-16T01:54:27.644440+0000","last_became_active":"2024-09-16T01:54:25.879929+0000","last_became_peered":"2024-09-16T01:54:25.879929+0000","last_unstale":"2024-09-16T01:54:27.644440+0000","last_undegraded":"2024-09-16T01:54:27.644440+0000","last_fullsized":"2024-09-16T01:54:27.644440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:40:09.544682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144567+0000","last_change":"2024-09-16T01:54:21.859563+0000","last_active":"2024-09-16T01:54:28.144567+0000","last_peered":"2024-09-16T01:54:28.144567+0000","last_clean":"2024-09-16T01:54:28.144567+0000","last_became_active":"2024-09-16T01:54:21.859284+0000","last_became_peered":"2024-09-16T01:54:21.859284+0000","last_unstale":"2024-09-16T01:54:28.144567+0000","last_undegraded":"2024-09-16T01:54:28.144567+0000","last_fullsized":"2024-09-16T01:54:28.144567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:28.740307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145101+0000","last_change":"2024-09-16T01:54:20.860054+0000","last_active":"2024-09-16T01:54:28.145101+0000","last_peered":"2024-09-16T01:54:28.145101+0000","last_clean":"2024-09-16T01:54:28.145101+0000","last_became_active":"2024-09-16T01:54:20.859714+0000","last_became_peered":"2024-09-16T01:54:20.859714+0000","last_unstale":"2024-09-16T01:54:28.145101+0000","last_undegraded":"2024-09-16T01:54:28.145101+0000","last_fullsized":"2024-09-16T01:54:28.145101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:25.346654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145185+0000","last_change":"2024-09-16T01:54:25.963523+0000","last_active":"2024-09-16T01:54:28.145185+0000","last_peered":"2024-09-16T01:54:28.145185+0000","last_clean":"2024-09-16T01:54:28.145185+0000","last_became_active":"2024-09-16T01:54:25.963160+0000","last_became_peered":"2024-09-16T01:54:25.963160+0000","last_unstale":"2024-09-16T01:54:28.145185+0000","last_undegraded":"2024-09-16T01:54:28.145185+0000","last_fullsized":"2024-09-16T01:54:28.145185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:12.650374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898701+0000","last_change":"2024-09-16T01:54:21.859137+0000","last_active":"2024-09-16T01:54:26.898701+0000","last_peered":"2024-09-16T01:54:26.898701+0000","last_clean":"2024-09-16T01:54:26.898701+0000","last_became_active":"2024-09-16T01:54:21.858467+0000","last_became_peered":"2024-09-16T01:54:21.858467+0000","last_unstale":"2024-09-16T01:54:26.898701+0000","last_undegraded":"2024-09-16T01:54:26.898701+0000","last_fullsized":"2024-09-16T01:54:26.898701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678105+0000","last_change":"2024-09-16T01:54:20.855557+0000","last_active":"2024-09-16T01:54:27.678105+0000","last_peered":"2024-09-16T01:54:27.678105+0000","last_clean":"2024-09-16T01:54:27.678105+0000","last_became_active":"2024-09-16T01:54:20.855024+0000","last_became_peered":"2024-09-16T01:54:20.855024+0000","last_unstale":"2024-09-16T01:54:27.678105+0000","last_undegraded":"2024-09-16T01:54:27.678105+0000","last_fullsized":"2024-09-16T01:54:27.678105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145216+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:54:28.145216+0000","last_peered":"2024-09-16T01:54:28.145216+0000","last_clean":"2024-09-16T01:54:28.145216+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:54:28.145216+0000","last_undegraded":"2024-09-16T01:54:28.145216+0000","last_fullsized":"2024-09-16T01:54:28.145216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145100+0000","last_change":"2024-09-16T01:54:25.963720+0000","last_active":"2024-09-16T01:54:28.145100+0000","last_peered":"2024-09-16T01:54:28.145100+0000","last_clean":"2024-09-16T01:54:28.145100+0000","last_became_active":"2024-09-16T01:54:25.963290+0000","last_became_peered":"2024-09-16T01:54:25.963290+0000","last_unstale":"2024-09-16T01:54:28.145100+0000","last_undegraded":"2024-09-16T01:54:28.145100+0000","last_fullsized":"2024-09-16T01:54:28.145100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145565+0000","last_change":"2024-09-16T01:54:21.863989+0000","last_active":"2024-09-16T01:54:28.145565+0000","last_peered":"2024-09-16T01:54:28.145565+0000","last_clean":"2024-09-16T01:54:28.145565+0000","last_became_active":"2024-09-16T01:54:21.863683+0000","last_became_peered":"2024-09-16T01:54:21.863683+0000","last_unstale":"2024-09-16T01:54:28.145565+0000","last_undegraded":"2024-09-16T01:54:28.145565+0000","last_fullsized":"2024-09-16T01:54:28.145565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:31.678241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144985+0000","last_change":"2024-09-16T01:54:20.856924+0000","last_active":"2024-09-16T01:54:28.144985+0000","last_peered":"2024-09-16T01:54:28.144985+0000","last_clean":"2024-09-16T01:54:28.144985+0000","last_became_active":"2024-09-16T01:54:20.856528+0000","last_became_peered":"2024-09-16T01:54:20.856528+0000","last_unstale":"2024-09-16T01:54:28.144985+0000","last_undegraded":"2024-09-16T01:54:28.144985+0000","last_fullsized":"2024-09-16T01:54:28.144985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:47.012037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144803+0000","last_change":"2024-09-16T01:54:25.962300+0000","last_active":"2024-09-16T01:54:28.144803+0000","last_peered":"2024-09-16T01:54:28.144803+0000","last_clean":"2024-09-16T01:54:28.144803+0000","last_became_active":"2024-09-16T01:54:25.961846+0000","last_became_peered":"2024-09-16T01:54:25.961846+0000","last_unstale":"2024-09-16T01:54:28.144803+0000","last_undegraded":"2024-09-16T01:54:28.144803+0000","last_fullsized":"2024-09-16T01:54:28.144803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.629326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678252+0000","last_change":"2024-09-16T01:54:21.867183+0000","last_active":"2024-09-16T01:54:27.678252+0000","last_peered":"2024-09-16T01:54:27.678252+0000","last_clean":"2024-09-16T01:54:27.678252+0000","last_became_active":"2024-09-16T01:54:21.866359+0000","last_became_peered":"2024-09-16T01:54:21.866359+0000","last_unstale":"2024-09-16T01:54:27.678252+0000","last_undegraded":"2024-09-16T01:54:27.678252+0000","last_fullsized":"2024-09-16T01:54:27.678252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:10.597570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644565+0000","last_change":"2024-09-16T01:54:20.848769+0000","last_active":"2024-09-16T01:54:27.644565+0000","last_peered":"2024-09-16T01:54:27.644565+0000","last_clean":"2024-09-16T01:54:27.644565+0000","last_became_active":"2024-09-16T01:54:20.846526+0000","last_became_peered":"2024-09-16T01:54:20.846526+0000","last_unstale":"2024-09-16T01:54:27.644565+0000","last_undegraded":"2024-09-16T01:54:27.644565+0000","last_fullsized":"2024-09-16T01:54:27.644565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145456+0000","last_change":"2024-09-16T01:54:25.874322+0000","last_active":"2024-09-16T01:54:28.145456+0000","last_peered":"2024-09-16T01:54:28.145456+0000","last_clean":"2024-09-16T01:54:28.145456+0000","last_became_active":"2024-09-16T01:54:25.873916+0000","last_became_peered":"2024-09-16T01:54:25.873916+0000","last_unstale":"2024-09-16T01:54:28.145456+0000","last_undegraded":"2024-09-16T01:54:28.145456+0000","last_fullsized":"2024-09-16T01:54:28.145456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:58.135177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145950+0000","last_change":"2024-09-16T01:54:21.870995+0000","last_active":"2024-09-16T01:54:28.145950+0000","last_peered":"2024-09-16T01:54:28.145950+0000","last_clean":"2024-09-16T01:54:28.145950+0000","last_became_active":"2024-09-16T01:54:21.870452+0000","last_became_peered":"2024-09-16T01:54:21.870452+0000","last_unstale":"2024-09-16T01:54:28.145950+0000","last_undegraded":"2024-09-16T01:54:28.145950+0000","last_fullsized":"2024-09-16T01:54:28.145950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:04.838662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145304+0000","last_change":"2024-09-16T01:54:20.857994+0000","last_active":"2024-09-16T01:54:28.145304+0000","last_peered":"2024-09-16T01:54:28.145304+0000","last_clean":"2024-09-16T01:54:28.145304+0000","last_became_active":"2024-09-16T01:54:20.857622+0000","last_became_peered":"2024-09-16T01:54:20.857622+0000","last_unstale":"2024-09-16T01:54:28.145304+0000","last_undegraded":"2024-09-16T01:54:28.145304+0000","last_fullsized":"2024-09-16T01:54:28.145304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:45.730567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677827+0000","last_change":"2024-09-16T01:54:25.964331+0000","last_active":"2024-09-16T01:54:27.677827+0000","last_peered":"2024-09-16T01:54:27.677827+0000","last_clean":"2024-09-16T01:54:27.677827+0000","last_became_active":"2024-09-16T01:54:25.963969+0000","last_became_peered":"2024-09-16T01:54:25.963969+0000","last_unstale":"2024-09-16T01:54:27.677827+0000","last_undegraded":"2024-09-16T01:54:27.677827+0000","last_fullsized":"2024-09-16T01:54:27.677827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:06.129448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145804+0000","last_change":"2024-09-16T01:54:21.870195+0000","last_active":"2024-09-16T01:54:28.145804+0000","last_peered":"2024-09-16T01:54:28.145804+0000","last_clean":"2024-09-16T01:54:28.145804+0000","last_became_active":"2024-09-16T01:54:21.869739+0000","last_became_peered":"2024-09-16T01:54:21.869739+0000","last_unstale":"2024-09-16T01:54:28.145804+0000","last_undegraded":"2024-09-16T01:54:28.145804+0000","last_fullsized":"2024-09-16T01:54:28.145804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:16.366906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900025+0000","last_change":"2024-09-16T01:54:20.859086+0000","last_active":"2024-09-16T01:54:26.900025+0000","last_peered":"2024-09-16T01:54:26.900025+0000","last_clean":"2024-09-16T01:54:26.900025+0000","last_became_active":"2024-09-16T01:54:20.858783+0000","last_became_peered":"2024-09-16T01:54:20.858783+0000","last_unstale":"2024-09-16T01:54:26.900025+0000","last_undegraded":"2024-09-16T01:54:26.900025+0000","last_fullsized":"2024-09-16T01:54:26.900025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:39.081955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900245+0000","last_change":"2024-09-16T01:54:25.877090+0000","last_active":"2024-09-16T01:54:26.900245+0000","last_peered":"2024-09-16T01:54:26.900245+0000","last_clean":"2024-09-16T01:54:26.900245+0000","last_became_active":"2024-09-16T01:54:25.876626+0000","last_became_peered":"2024-09-16T01:54:25.876626+0000","last_unstale":"2024-09-16T01:54:26.900245+0000","last_undegraded":"2024-09-16T01:54:26.900245+0000","last_fullsized":"2024-09-16T01:54:26.900245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145343+0000","last_change":"2024-09-16T01:54:21.870018+0000","last_active":"2024-09-16T01:54:28.145343+0000","last_peered":"2024-09-16T01:54:28.145343+0000","last_clean":"2024-09-16T01:54:28.145343+0000","last_became_active":"2024-09-16T01:54:21.869334+0000","last_became_peered":"2024-09-16T01:54:21.869334+0000","last_unstale":"2024-09-16T01:54:28.145343+0000","last_undegraded":"2024-09-16T01:54:28.145343+0000","last_fullsized":"2024-09-16T01:54:28.145343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:18:36.899153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144191+0000","last_change":"2024-09-16T01:54:20.850043+0000","last_active":"2024-09-16T01:54:28.144191+0000","last_peered":"2024-09-16T01:54:28.144191+0000","last_clean":"2024-09-16T01:54:28.144191+0000","last_became_active":"2024-09-16T01:54:20.849690+0000","last_became_peered":"2024-09-16T01:54:20.849690+0000","last_unstale":"2024-09-16T01:54:28.144191+0000","last_undegraded":"2024-09-16T01:54:28.144191+0000","last_fullsized":"2024-09-16T01:54:28.144191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:20.932038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145156+0000","last_change":"2024-09-16T01:54:25.876135+0000","last_active":"2024-09-16T01:54:28.145156+0000","last_peered":"2024-09-16T01:54:28.145156+0000","last_clean":"2024-09-16T01:54:28.145156+0000","last_became_active":"2024-09-16T01:54:25.875631+0000","last_became_peered":"2024-09-16T01:54:25.875631+0000","last_unstale":"2024-09-16T01:54:28.145156+0000","last_undegraded":"2024-09-16T01:54:28.145156+0000","last_fullsized":"2024-09-16T01:54:28.145156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144759+0000","last_change":"2024-09-16T01:54:21.865673+0000","last_active":"2024-09-16T01:54:28.144759+0000","last_peered":"2024-09-16T01:54:28.144759+0000","last_clean":"2024-09-16T01:54:28.144759+0000","last_became_active":"2024-09-16T01:54:21.865342+0000","last_became_peered":"2024-09-16T01:54:21.865342+0000","last_unstale":"2024-09-16T01:54:28.144759+0000","last_undegraded":"2024-09-16T01:54:28.144759+0000","last_fullsized":"2024-09-16T01:54:28.144759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144766+0000","last_change":"2024-09-16T01:54:20.846994+0000","last_active":"2024-09-16T01:54:28.144766+0000","last_peered":"2024-09-16T01:54:28.144766+0000","last_clean":"2024-09-16T01:54:28.144766+0000","last_became_active":"2024-09-16T01:54:20.846665+0000","last_became_peered":"2024-09-16T01:54:20.846665+0000","last_unstale":"2024-09-16T01:54:28.144766+0000","last_undegraded":"2024-09-16T01:54:28.144766+0000","last_fullsized":"2024-09-16T01:54:28.144766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899670+0000","last_change":"2024-09-16T01:54:25.966412+0000","last_active":"2024-09-16T01:54:26.899670+0000","last_peered":"2024-09-16T01:54:26.899670+0000","last_clean":"2024-09-16T01:54:26.899670+0000","last_became_active":"2024-09-16T01:54:25.965845+0000","last_became_peered":"2024-09-16T01:54:25.965845+0000","last_unstale":"2024-09-16T01:54:26.899670+0000","last_undegraded":"2024-09-16T01:54:26.899670+0000","last_fullsized":"2024-09-16T01:54:26.899670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:35.279620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145627+0000","last_change":"2024-09-16T01:54:21.871992+0000","last_active":"2024-09-16T01:54:28.145627+0000","last_peered":"2024-09-16T01:54:28.145627+0000","last_clean":"2024-09-16T01:54:28.145627+0000","last_became_active":"2024-09-16T01:54:21.871674+0000","last_became_peered":"2024-09-16T01:54:21.871674+0000","last_unstale":"2024-09-16T01:54:28.145627+0000","last_undegraded":"2024-09-16T01:54:28.145627+0000","last_fullsized":"2024-09-16T01:54:28.145627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:27.694450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678279+0000","last_change":"2024-09-16T01:54:20.858600+0000","last_active":"2024-09-16T01:54:27.678279+0000","last_peered":"2024-09-16T01:54:27.678279+0000","last_clean":"2024-09-16T01:54:27.678279+0000","last_became_active":"2024-09-16T01:54:20.858244+0000","last_became_peered":"2024-09-16T01:54:20.858244+0000","last_unstale":"2024-09-16T01:54:27.678279+0000","last_undegraded":"2024-09-16T01:54:27.678279+0000","last_fullsized":"2024-09-16T01:54:27.678279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899103+0000","last_change":"2024-09-16T01:54:25.962396+0000","last_active":"2024-09-16T01:54:26.899103+0000","last_peered":"2024-09-16T01:54:26.899103+0000","last_clean":"2024-09-16T01:54:26.899103+0000","last_became_active":"2024-09-16T01:54:25.961648+0000","last_became_peered":"2024-09-16T01:54:25.961648+0000","last_unstale":"2024-09-16T01:54:26.899103+0000","last_undegraded":"2024-09-16T01:54:26.899103+0000","last_fullsized":"2024-09-16T01:54:26.899103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:45.131656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144942+0000","last_change":"2024-09-16T01:54:21.864888+0000","last_active":"2024-09-16T01:54:28.144942+0000","last_peered":"2024-09-16T01:54:28.144942+0000","last_clean":"2024-09-16T01:54:28.144942+0000","last_became_active":"2024-09-16T01:54:21.864577+0000","last_became_peered":"2024-09-16T01:54:21.864577+0000","last_unstale":"2024-09-16T01:54:28.144942+0000","last_undegraded":"2024-09-16T01:54:28.144942+0000","last_fullsized":"2024-09-16T01:54:28.144942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145550+0000","last_change":"2024-09-16T01:54:20.856921+0000","last_active":"2024-09-16T01:54:28.145550+0000","last_peered":"2024-09-16T01:54:28.145550+0000","last_clean":"2024-09-16T01:54:28.145550+0000","last_became_active":"2024-09-16T01:54:20.856618+0000","last_became_peered":"2024-09-16T01:54:20.856618+0000","last_unstale":"2024-09-16T01:54:28.145550+0000","last_undegraded":"2024-09-16T01:54:28.145550+0000","last_fullsized":"2024-09-16T01:54:28.145550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678404+0000","last_change":"2024-09-16T01:54:25.962306+0000","last_active":"2024-09-16T01:54:27.678404+0000","last_peered":"2024-09-16T01:54:27.678404+0000","last_clean":"2024-09-16T01:54:27.678404+0000","last_became_active":"2024-09-16T01:54:25.961904+0000","last_became_peered":"2024-09-16T01:54:25.961904+0000","last_unstale":"2024-09-16T01:54:27.678404+0000","last_undegraded":"2024-09-16T01:54:27.678404+0000","last_fullsized":"2024-09-16T01:54:27.678404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:21.665659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145442+0000","last_change":"2024-09-16T01:54:21.868099+0000","last_active":"2024-09-16T01:54:28.145442+0000","last_peered":"2024-09-16T01:54:28.145442+0000","last_clean":"2024-09-16T01:54:28.145442+0000","last_became_active":"2024-09-16T01:54:21.866809+0000","last_became_peered":"2024-09-16T01:54:21.866809+0000","last_unstale":"2024-09-16T01:54:28.145442+0000","last_undegraded":"2024-09-16T01:54:28.145442+0000","last_fullsized":"2024-09-16T01:54:28.145442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:54.265355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:31.368525+0000","last_change":"2024-09-16T01:54:20.858623+0000","last_active":"2024-09-16T01:54:31.368525+0000","last_peered":"2024-09-16T01:54:31.368525+0000","last_clean":"2024-09-16T01:54:31.368525+0000","last_became_active":"2024-09-16T01:54:20.858247+0000","last_became_peered":"2024-09-16T01:54:20.858247+0000","last_unstale":"2024-09-16T01:54:31.368525+0000","last_undegraded":"2024-09-16T01:54:31.368525+0000","last_fullsized":"2024-09-16T01:54:31.368525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644208+0000","last_change":"2024-09-16T01:54:25.877219+0000","last_active":"2024-09-16T01:54:27.644208+0000","last_peered":"2024-09-16T01:54:27.644208+0000","last_clean":"2024-09-16T01:54:27.644208+0000","last_became_active":"2024-09-16T01:54:25.876551+0000","last_became_peered":"2024-09-16T01:54:25.876551+0000","last_unstale":"2024-09-16T01:54:27.644208+0000","last_undegraded":"2024-09-16T01:54:27.644208+0000","last_fullsized":"2024-09-16T01:54:27.644208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:12.650374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900540+0000","last_change":"2024-09-16T01:54:21.869260+0000","last_active":"2024-09-16T01:54:26.900540+0000","last_peered":"2024-09-16T01:54:26.900540+0000","last_clean":"2024-09-16T01:54:26.900540+0000","last_became_active":"2024-09-16T01:54:21.868827+0000","last_became_peered":"2024-09-16T01:54:21.868827+0000","last_unstale":"2024-09-16T01:54:26.900540+0000","last_undegraded":"2024-09-16T01:54:26.900540+0000","last_fullsized":"2024-09-16T01:54:26.900540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:13.856305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644517+0000","last_change":"2024-09-16T01:54:20.857069+0000","last_active":"2024-09-16T01:54:27.644517+0000","last_peered":"2024-09-16T01:54:27.644517+0000","last_clean":"2024-09-16T01:54:27.644517+0000","last_became_active":"2024-09-16T01:54:20.856716+0000","last_became_peered":"2024-09-16T01:54:20.856716+0000","last_unstale":"2024-09-16T01:54:27.644517+0000","last_undegraded":"2024-09-16T01:54:27.644517+0000","last_fullsized":"2024-09-16T01:54:27.644517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900263+0000","last_change":"2024-09-16T01:54:25.877903+0000","last_active":"2024-09-16T01:54:26.900263+0000","last_peered":"2024-09-16T01:54:26.900263+0000","last_clean":"2024-09-16T01:54:26.900263+0000","last_became_active":"2024-09-16T01:54:25.877044+0000","last_became_peered":"2024-09-16T01:54:25.877044+0000","last_unstale":"2024-09-16T01:54:26.900263+0000","last_undegraded":"2024-09-16T01:54:26.900263+0000","last_fullsized":"2024-09-16T01:54:26.900263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.629326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145039+0000","last_change":"2024-09-16T01:54:21.867905+0000","last_active":"2024-09-16T01:54:28.145039+0000","last_peered":"2024-09-16T01:54:28.145039+0000","last_clean":"2024-09-16T01:54:28.145039+0000","last_became_active":"2024-09-16T01:54:21.867528+0000","last_became_peered":"2024-09-16T01:54:21.867528+0000","last_unstale":"2024-09-16T01:54:28.145039+0000","last_undegraded":"2024-09-16T01:54:28.145039+0000","last_fullsized":"2024-09-16T01:54:28.145039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678486+0000","last_change":"2024-09-16T01:54:20.857608+0000","last_active":"2024-09-16T01:54:27.678486+0000","last_peered":"2024-09-16T01:54:27.678486+0000","last_clean":"2024-09-16T01:54:27.678486+0000","last_became_active":"2024-09-16T01:54:20.857274+0000","last_became_peered":"2024-09-16T01:54:20.857274+0000","last_unstale":"2024-09-16T01:54:27.678486+0000","last_undegraded":"2024-09-16T01:54:27.678486+0000","last_fullsized":"2024-09-16T01:54:27.678486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:31.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898742+0000","last_change":"2024-09-16T01:54:25.882374+0000","last_active":"2024-09-16T01:54:26.898742+0000","last_peered":"2024-09-16T01:54:26.898742+0000","last_clean":"2024-09-16T01:54:26.898742+0000","last_became_active":"2024-09-16T01:54:25.881866+0000","last_became_peered":"2024-09-16T01:54:25.881866+0000","last_unstale":"2024-09-16T01:54:26.898742+0000","last_undegraded":"2024-09-16T01:54:26.898742+0000","last_fullsized":"2024-09-16T01:54:26.898742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:57.763504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678472+0000","last_change":"2024-09-16T01:54:21.867006+0000","last_active":"2024-09-16T01:54:27.678472+0000","last_peered":"2024-09-16T01:54:27.678472+0000","last_clean":"2024-09-16T01:54:27.678472+0000","last_became_active":"2024-09-16T01:54:21.866494+0000","last_became_peered":"2024-09-16T01:54:21.866494+0000","last_unstale":"2024-09-16T01:54:27.678472+0000","last_undegraded":"2024-09-16T01:54:27.678472+0000","last_fullsized":"2024-09-16T01:54:27.678472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:08.629741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145496+0000","last_change":"2024-09-16T01:54:20.856791+0000","last_active":"2024-09-16T01:54:28.145496+0000","last_peered":"2024-09-16T01:54:28.145496+0000","last_clean":"2024-09-16T01:54:28.145496+0000","last_became_active":"2024-09-16T01:54:20.856438+0000","last_became_peered":"2024-09-16T01:54:20.856438+0000","last_unstale":"2024-09-16T01:54:28.145496+0000","last_undegraded":"2024-09-16T01:54:28.145496+0000","last_fullsized":"2024-09-16T01:54:28.145496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:20.391146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898630+0000","last_change":"2024-09-16T01:54:25.965028+0000","last_active":"2024-09-16T01:54:26.898630+0000","last_peered":"2024-09-16T01:54:26.898630+0000","last_clean":"2024-09-16T01:54:26.898630+0000","last_became_active":"2024-09-16T01:54:25.964627+0000","last_became_peered":"2024-09-16T01:54:25.964627+0000","last_unstale":"2024-09-16T01:54:26.898630+0000","last_undegraded":"2024-09-16T01:54:26.898630+0000","last_fullsized":"2024-09-16T01:54:26.898630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:21.665659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144989+0000","last_change":"2024-09-16T01:54:25.964421+0000","last_active":"2024-09-16T01:54:28.144989+0000","last_peered":"2024-09-16T01:54:28.144989+0000","last_clean":"2024-09-16T01:54:28.144989+0000","last_became_active":"2024-09-16T01:54:25.964043+0000","last_became_peered":"2024-09-16T01:54:25.964043+0000","last_unstale":"2024-09-16T01:54:28.144989+0000","last_undegraded":"2024-09-16T01:54:28.144989+0000","last_fullsized":"2024-09-16T01:54:28.144989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:36:14.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643734+0000","last_change":"2024-09-16T01:54:21.854748+0000","last_active":"2024-09-16T01:54:27.643734+0000","last_peered":"2024-09-16T01:54:27.643734+0000","last_clean":"2024-09-16T01:54:27.643734+0000","last_became_active":"2024-09-16T01:54:21.854442+0000","last_became_peered":"2024-09-16T01:54:21.854442+0000","last_unstale":"2024-09-16T01:54:27.643734+0000","last_undegraded":"2024-09-16T01:54:27.643734+0000","last_fullsized":"2024-09-16T01:54:27.643734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678022+0000","last_change":"2024-09-16T01:54:20.857120+0000","last_active":"2024-09-16T01:54:27.678022+0000","last_peered":"2024-09-16T01:54:27.678022+0000","last_clean":"2024-09-16T01:54:27.678022+0000","last_became_active":"2024-09-16T01:54:20.855928+0000","last_became_peered":"2024-09-16T01:54:20.855928+0000","last_unstale":"2024-09-16T01:54:27.678022+0000","last_undegraded":"2024-09-16T01:54:27.678022+0000","last_fullsized":"2024-09-16T01:54:27.678022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:43.147582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145929+0000","last_change":"2024-09-16T01:54:25.881758+0000","last_active":"2024-09-16T01:54:28.145929+0000","last_peered":"2024-09-16T01:54:28.145929+0000","last_clean":"2024-09-16T01:54:28.145929+0000","last_became_active":"2024-09-16T01:54:25.881332+0000","last_became_peered":"2024-09-16T01:54:25.881332+0000","last_unstale":"2024-09-16T01:54:28.145929+0000","last_undegraded":"2024-09-16T01:54:28.145929+0000","last_fullsized":"2024-09-16T01:54:28.145929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:39.339620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898882+0000","last_change":"2024-09-16T01:54:21.862116+0000","last_active":"2024-09-16T01:54:26.898882+0000","last_peered":"2024-09-16T01:54:26.898882+0000","last_clean":"2024-09-16T01:54:26.898882+0000","last_became_active":"2024-09-16T01:54:21.861751+0000","last_became_peered":"2024-09-16T01:54:21.861751+0000","last_unstale":"2024-09-16T01:54:26.898882+0000","last_undegraded":"2024-09-16T01:54:26.898882+0000","last_fullsized":"2024-09-16T01:54:26.898882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:38.600829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898921+0000","last_change":"2024-09-16T01:54:20.851739+0000","last_active":"2024-09-16T01:54:26.898921+0000","last_peered":"2024-09-16T01:54:26.898921+0000","last_clean":"2024-09-16T01:54:26.898921+0000","last_became_active":"2024-09-16T01:54:20.851438+0000","last_became_peered":"2024-09-16T01:54:20.851438+0000","last_unstale":"2024-09-16T01:54:26.898921+0000","last_undegraded":"2024-09-16T01:54:26.898921+0000","last_fullsized":"2024-09-16T01:54:26.898921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:34:38.620678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145055+0000","last_change":"2024-09-16T01:54:20.850823+0000","last_active":"2024-09-16T01:54:28.145055+0000","last_peered":"2024-09-16T01:54:28.145055+0000","last_clean":"2024-09-16T01:54:28.145055+0000","last_became_active":"2024-09-16T01:54:20.850498+0000","last_became_peered":"2024-09-16T01:54:20.850498+0000","last_unstale":"2024-09-16T01:54:28.145055+0000","last_undegraded":"2024-09-16T01:54:28.145055+0000","last_fullsized":"2024-09-16T01:54:28.145055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:27.819412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145506+0000","last_change":"2024-09-16T01:54:21.864867+0000","last_active":"2024-09-16T01:54:28.145506+0000","last_peered":"2024-09-16T01:54:28.145506+0000","last_clean":"2024-09-16T01:54:28.145506+0000","last_became_active":"2024-09-16T01:54:21.863988+0000","last_became_peered":"2024-09-16T01:54:21.863988+0000","last_unstale":"2024-09-16T01:54:28.145506+0000","last_undegraded":"2024-09-16T01:54:28.145506+0000","last_fullsized":"2024-09-16T01:54:28.145506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144751+0000","last_change":"2024-09-16T01:54:25.883288+0000","last_active":"2024-09-16T01:54:28.144751+0000","last_peered":"2024-09-16T01:54:28.144751+0000","last_clean":"2024-09-16T01:54:28.144751+0000","last_became_active":"2024-09-16T01:54:25.882928+0000","last_became_peered":"2024-09-16T01:54:25.882928+0000","last_unstale":"2024-09-16T01:54:28.144751+0000","last_undegraded":"2024-09-16T01:54:28.144751+0000","last_fullsized":"2024-09-16T01:54:28.144751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:04.515824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899096+0000","last_change":"2024-09-16T01:54:20.852534+0000","last_active":"2024-09-16T01:54:26.899096+0000","last_peered":"2024-09-16T01:54:26.899096+0000","last_clean":"2024-09-16T01:54:26.899096+0000","last_became_active":"2024-09-16T01:54:20.852219+0000","last_became_peered":"2024-09-16T01:54:20.852219+0000","last_unstale":"2024-09-16T01:54:26.899096+0000","last_undegraded":"2024-09-16T01:54:26.899096+0000","last_fullsized":"2024-09-16T01:54:26.899096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:19.825121+0000","last_clean_scrub_stamp":"2024-09-16T01:54:19.825121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:16.719429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899937+0000","last_change":"2024-09-16T01:54:21.850135+0000","last_active":"2024-09-16T01:54:26.899937+0000","last_peered":"2024-09-16T01:54:26.899937+0000","last_clean":"2024-09-16T01:54:26.899937+0000","last_became_active":"2024-09-16T01:54:21.849806+0000","last_became_peered":"2024-09-16T01:54:21.849806+0000","last_unstale":"2024-09-16T01:54:26.899937+0000","last_undegraded":"2024-09-16T01:54:26.899937+0000","last_fullsized":"2024-09-16T01:54:26.899937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:21.396408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899361+0000","last_change":"2024-09-16T01:54:25.881823+0000","last_active":"2024-09-16T01:54:26.899361+0000","last_peered":"2024-09-16T01:54:26.899361+0000","last_clean":"2024-09-16T01:54:26.899361+0000","last_became_active":"2024-09-16T01:54:25.881327+0000","last_became_peered":"2024-09-16T01:54:25.881327+0000","last_unstale":"2024-09-16T01:54:26.899361+0000","last_undegraded":"2024-09-16T01:54:26.899361+0000","last_fullsized":"2024-09-16T01:54:26.899361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:24.851015+0000","last_clean_scrub_stamp":"2024-09-16T01:54:24.851015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:23.493442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144596+0000","last_change":"2024-09-16T01:54:21.865704+0000","last_active":"2024-09-16T01:54:28.144596+0000","last_peered":"2024-09-16T01:54:28.144596+0000","last_clean":"2024-09-16T01:54:28.144596+0000","last_became_active":"2024-09-16T01:54:21.865364+0000","last_became_peered":"2024-09-16T01:54:21.865364+0000","last_unstale":"2024-09-16T01:54:28.144596+0000","last_undegraded":"2024-09-16T01:54:28.144596+0000","last_fullsized":"2024-09-16T01:54:28.144596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144292+0000","last_change":"2024-09-16T01:54:21.856984+0000","last_active":"2024-09-16T01:54:28.144292+0000","last_peered":"2024-09-16T01:54:28.144292+0000","last_clean":"2024-09-16T01:54:28.144292+0000","last_became_active":"2024-09-16T01:54:21.856689+0000","last_became_peered":"2024-09-16T01:54:21.856689+0000","last_unstale":"2024-09-16T01:54:28.144292+0000","last_undegraded":"2024-09-16T01:54:28.144292+0000","last_fullsized":"2024-09-16T01:54:28.144292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:31.836291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678206+0000","last_change":"2024-09-16T01:54:21.857661+0000","last_active":"2024-09-16T01:54:27.678206+0000","last_peered":"2024-09-16T01:54:27.678206+0000","last_clean":"2024-09-16T01:54:27.678206+0000","last_became_active":"2024-09-16T01:54:21.857393+0000","last_became_peered":"2024-09-16T01:54:21.857393+0000","last_unstale":"2024-09-16T01:54:27.678206+0000","last_undegraded":"2024-09-16T01:54:27.678206+0000","last_fullsized":"2024-09-16T01:54:27.678206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:57.597318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145421+0000","last_change":"2024-09-16T01:54:21.864966+0000","last_active":"2024-09-16T01:54:28.145421+0000","last_peered":"2024-09-16T01:54:28.145421+0000","last_clean":"2024-09-16T01:54:28.145421+0000","last_became_active":"2024-09-16T01:54:21.864561+0000","last_became_peered":"2024-09-16T01:54:21.864561+0000","last_unstale":"2024-09-16T01:54:28.145421+0000","last_undegraded":"2024-09-16T01:54:28.145421+0000","last_fullsized":"2024-09-16T01:54:28.145421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:45.328486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899348+0000","last_change":"2024-09-16T01:54:21.870271+0000","last_active":"2024-09-16T01:54:26.899348+0000","last_peered":"2024-09-16T01:54:26.899348+0000","last_clean":"2024-09-16T01:54:26.899348+0000","last_became_active":"2024-09-16T01:54:21.869900+0000","last_became_peered":"2024-09-16T01:54:21.869900+0000","last_unstale":"2024-09-16T01:54:26.899348+0000","last_undegraded":"2024-09-16T01:54:26.899348+0000","last_fullsized":"2024-09-16T01:54:26.899348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644063+0000","last_change":"2024-09-16T01:54:21.855065+0000","last_active":"2024-09-16T01:54:27.644063+0000","last_peered":"2024-09-16T01:54:27.644063+0000","last_clean":"2024-09-16T01:54:27.644063+0000","last_became_active":"2024-09-16T01:54:21.854785+0000","last_became_peered":"2024-09-16T01:54:21.854785+0000","last_unstale":"2024-09-16T01:54:27.644063+0000","last_undegraded":"2024-09-16T01:54:27.644063+0000","last_fullsized":"2024-09-16T01:54:27.644063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.146008+0000","last_change":"2024-09-16T01:54:21.856250+0000","last_active":"2024-09-16T01:54:28.146008+0000","last_peered":"2024-09-16T01:54:28.146008+0000","last_clean":"2024-09-16T01:54:28.146008+0000","last_became_active":"2024-09-16T01:54:21.855867+0000","last_became_peered":"2024-09-16T01:54:21.855867+0000","last_unstale":"2024-09-16T01:54:28.146008+0000","last_undegraded":"2024-09-16T01:54:28.146008+0000","last_fullsized":"2024-09-16T01:54:28.146008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.899585+0000","last_change":"2024-09-16T01:54:21.869651+0000","last_active":"2024-09-16T01:54:26.899585+0000","last_peered":"2024-09-16T01:54:26.899585+0000","last_clean":"2024-09-16T01:54:26.899585+0000","last_became_active":"2024-09-16T01:54:21.869363+0000","last_became_peered":"2024-09-16T01:54:21.869363+0000","last_unstale":"2024-09-16T01:54:26.899585+0000","last_undegraded":"2024-09-16T01:54:26.899585+0000","last_fullsized":"2024-09-16T01:54:26.899585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677969+0000","last_change":"2024-09-16T01:54:21.857499+0000","last_active":"2024-09-16T01:54:27.677969+0000","last_peered":"2024-09-16T01:54:27.677969+0000","last_clean":"2024-09-16T01:54:27.677969+0000","last_became_active":"2024-09-16T01:54:21.857215+0000","last_became_peered":"2024-09-16T01:54:21.857215+0000","last_unstale":"2024-09-16T01:54:27.677969+0000","last_undegraded":"2024-09-16T01:54:27.677969+0000","last_fullsized":"2024-09-16T01:54:27.677969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:11.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898805+0000","last_change":"2024-09-16T01:54:21.853265+0000","last_active":"2024-09-16T01:54:26.898805+0000","last_peered":"2024-09-16T01:54:26.898805+0000","last_clean":"2024-09-16T01:54:26.898805+0000","last_became_active":"2024-09-16T01:54:21.852863+0000","last_became_peered":"2024-09-16T01:54:21.852863+0000","last_unstale":"2024-09-16T01:54:26.898805+0000","last_undegraded":"2024-09-16T01:54:26.898805+0000","last_fullsized":"2024-09-16T01:54:26.898805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678154+0000","last_change":"2024-09-16T01:54:21.856726+0000","last_active":"2024-09-16T01:54:27.678154+0000","last_peered":"2024-09-16T01:54:27.678154+0000","last_clean":"2024-09-16T01:54:27.678154+0000","last_became_active":"2024-09-16T01:54:21.856432+0000","last_became_peered":"2024-09-16T01:54:21.856432+0000","last_unstale":"2024-09-16T01:54:27.678154+0000","last_undegraded":"2024-09-16T01:54:27.678154+0000","last_fullsized":"2024-09-16T01:54:27.678154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:29.948383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145040+0000","last_change":"2024-09-16T01:54:21.867340+0000","last_active":"2024-09-16T01:54:28.145040+0000","last_peered":"2024-09-16T01:54:28.145040+0000","last_clean":"2024-09-16T01:54:28.145040+0000","last_became_active":"2024-09-16T01:54:21.866029+0000","last_became_peered":"2024-09-16T01:54:21.866029+0000","last_unstale":"2024-09-16T01:54:28.145040+0000","last_undegraded":"2024-09-16T01:54:28.145040+0000","last_fullsized":"2024-09-16T01:54:28.145040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:33.360622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145155+0000","last_change":"2024-09-16T01:54:21.861066+0000","last_active":"2024-09-16T01:54:28.145155+0000","last_peered":"2024-09-16T01:54:28.145155+0000","last_clean":"2024-09-16T01:54:28.145155+0000","last_became_active":"2024-09-16T01:54:21.860305+0000","last_became_peered":"2024-09-16T01:54:21.860305+0000","last_unstale":"2024-09-16T01:54:28.145155+0000","last_undegraded":"2024-09-16T01:54:28.145155+0000","last_fullsized":"2024-09-16T01:54:28.145155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:48.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145799+0000","last_change":"2024-09-16T01:54:21.863878+0000","last_active":"2024-09-16T01:54:28.145799+0000","last_peered":"2024-09-16T01:54:28.145799+0000","last_clean":"2024-09-16T01:54:28.145799+0000","last_became_active":"2024-09-16T01:54:21.863277+0000","last_became_peered":"2024-09-16T01:54:21.863277+0000","last_unstale":"2024-09-16T01:54:28.145799+0000","last_undegraded":"2024-09-16T01:54:28.145799+0000","last_fullsized":"2024-09-16T01:54:28.145799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:38.741991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145254+0000","last_change":"2024-09-16T01:54:21.852758+0000","last_active":"2024-09-16T01:54:28.145254+0000","last_peered":"2024-09-16T01:54:28.145254+0000","last_clean":"2024-09-16T01:54:28.145254+0000","last_became_active":"2024-09-16T01:54:21.852429+0000","last_became_peered":"2024-09-16T01:54:21.852429+0000","last_unstale":"2024-09-16T01:54:28.145254+0000","last_undegraded":"2024-09-16T01:54:28.145254+0000","last_fullsized":"2024-09-16T01:54:28.145254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:33.722900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678582+0000","last_change":"2024-09-16T01:54:21.871495+0000","last_active":"2024-09-16T01:54:27.678582+0000","last_peered":"2024-09-16T01:54:27.678582+0000","last_clean":"2024-09-16T01:54:27.678582+0000","last_became_active":"2024-09-16T01:54:21.871213+0000","last_became_peered":"2024-09-16T01:54:21.871213+0000","last_unstale":"2024-09-16T01:54:27.678582+0000","last_undegraded":"2024-09-16T01:54:27.678582+0000","last_fullsized":"2024-09-16T01:54:27.678582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:29.854384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.677857+0000","last_change":"2024-09-16T01:54:21.863733+0000","last_active":"2024-09-16T01:54:27.677857+0000","last_peered":"2024-09-16T01:54:27.677857+0000","last_clean":"2024-09-16T01:54:27.677857+0000","last_became_active":"2024-09-16T01:54:21.863426+0000","last_became_peered":"2024-09-16T01:54:21.863426+0000","last_unstale":"2024-09-16T01:54:27.677857+0000","last_undegraded":"2024-09-16T01:54:27.677857+0000","last_fullsized":"2024-09-16T01:54:27.677857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.643815+0000","last_change":"2024-09-16T01:54:21.845049+0000","last_active":"2024-09-16T01:54:27.643815+0000","last_peered":"2024-09-16T01:54:27.643815+0000","last_clean":"2024-09-16T01:54:27.643815+0000","last_became_active":"2024-09-16T01:54:21.844746+0000","last_became_peered":"2024-09-16T01:54:21.844746+0000","last_unstale":"2024-09-16T01:54:27.643815+0000","last_undegraded":"2024-09-16T01:54:27.643815+0000","last_fullsized":"2024-09-16T01:54:27.643815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144803+0000","last_change":"2024-09-16T01:54:21.863916+0000","last_active":"2024-09-16T01:54:28.144803+0000","last_peered":"2024-09-16T01:54:28.144803+0000","last_clean":"2024-09-16T01:54:28.144803+0000","last_became_active":"2024-09-16T01:54:21.858949+0000","last_became_peered":"2024-09-16T01:54:21.858949+0000","last_unstale":"2024-09-16T01:54:28.144803+0000","last_undegraded":"2024-09-16T01:54:28.144803+0000","last_fullsized":"2024-09-16T01:54:28.144803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:06.850801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898941+0000","last_change":"2024-09-16T01:54:21.856929+0000","last_active":"2024-09-16T01:54:26.898941+0000","last_peered":"2024-09-16T01:54:26.898941+0000","last_clean":"2024-09-16T01:54:26.898941+0000","last_became_active":"2024-09-16T01:54:21.856610+0000","last_became_peered":"2024-09-16T01:54:21.856610+0000","last_unstale":"2024-09-16T01:54:26.898941+0000","last_undegraded":"2024-09-16T01:54:26.898941+0000","last_fullsized":"2024-09-16T01:54:26.898941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.900438+0000","last_change":"2024-09-16T01:54:21.853558+0000","last_active":"2024-09-16T01:54:26.900438+0000","last_peered":"2024-09-16T01:54:26.900438+0000","last_clean":"2024-09-16T01:54:26.900438+0000","last_became_active":"2024-09-16T01:54:21.853234+0000","last_became_peered":"2024-09-16T01:54:21.853234+0000","last_unstale":"2024-09-16T01:54:26.900438+0000","last_undegraded":"2024-09-16T01:54:26.900438+0000","last_fullsized":"2024-09-16T01:54:26.900438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:58.346519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145294+0000","last_change":"2024-09-16T01:54:21.864089+0000","last_active":"2024-09-16T01:54:28.145294+0000","last_peered":"2024-09-16T01:54:28.145294+0000","last_clean":"2024-09-16T01:54:28.145294+0000","last_became_active":"2024-09-16T01:54:21.863778+0000","last_became_peered":"2024-09-16T01:54:21.863778+0000","last_unstale":"2024-09-16T01:54:28.145294+0000","last_undegraded":"2024-09-16T01:54:28.145294+0000","last_fullsized":"2024-09-16T01:54:28.145294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145937+0000","last_change":"2024-09-16T01:54:21.860265+0000","last_active":"2024-09-16T01:54:28.145937+0000","last_peered":"2024-09-16T01:54:28.145937+0000","last_clean":"2024-09-16T01:54:28.145937+0000","last_became_active":"2024-09-16T01:54:21.859906+0000","last_became_peered":"2024-09-16T01:54:21.859906+0000","last_unstale":"2024-09-16T01:54:28.145937+0000","last_undegraded":"2024-09-16T01:54:28.145937+0000","last_fullsized":"2024-09-16T01:54:28.145937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145883+0000","last_change":"2024-09-16T01:54:21.867977+0000","last_active":"2024-09-16T01:54:28.145883+0000","last_peered":"2024-09-16T01:54:28.145883+0000","last_clean":"2024-09-16T01:54:28.145883+0000","last_became_active":"2024-09-16T01:54:21.867663+0000","last_became_peered":"2024-09-16T01:54:21.867663+0000","last_unstale":"2024-09-16T01:54:28.145883+0000","last_undegraded":"2024-09-16T01:54:28.145883+0000","last_fullsized":"2024-09-16T01:54:28.145883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:17.473803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:26.898589+0000","last_change":"2024-09-16T01:54:21.858992+0000","last_active":"2024-09-16T01:54:26.898589+0000","last_peered":"2024-09-16T01:54:26.898589+0000","last_clean":"2024-09-16T01:54:26.898589+0000","last_became_active":"2024-09-16T01:54:21.858478+0000","last_became_peered":"2024-09-16T01:54:21.858478+0000","last_unstale":"2024-09-16T01:54:26.898589+0000","last_undegraded":"2024-09-16T01:54:26.898589+0000","last_fullsized":"2024-09-16T01:54:26.898589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:03.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145247+0000","last_change":"2024-09-16T01:54:21.866468+0000","last_active":"2024-09-16T01:54:28.145247+0000","last_peered":"2024-09-16T01:54:28.145247+0000","last_clean":"2024-09-16T01:54:28.145247+0000","last_became_active":"2024-09-16T01:54:21.866127+0000","last_became_peered":"2024-09-16T01:54:21.866127+0000","last_unstale":"2024-09-16T01:54:28.145247+0000","last_undegraded":"2024-09-16T01:54:28.145247+0000","last_fullsized":"2024-09-16T01:54:28.145247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:15.758941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678085+0000","last_change":"2024-09-16T01:54:21.863734+0000","last_active":"2024-09-16T01:54:27.678085+0000","last_peered":"2024-09-16T01:54:27.678085+0000","last_clean":"2024-09-16T01:54:27.678085+0000","last_became_active":"2024-09-16T01:54:21.863440+0000","last_became_peered":"2024-09-16T01:54:21.863440+0000","last_unstale":"2024-09-16T01:54:27.678085+0000","last_undegraded":"2024-09-16T01:54:27.678085+0000","last_fullsized":"2024-09-16T01:54:27.678085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:42.323927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145475+0000","last_change":"2024-09-16T01:54:21.862517+0000","last_active":"2024-09-16T01:54:28.145475+0000","last_peered":"2024-09-16T01:54:28.145475+0000","last_clean":"2024-09-16T01:54:28.145475+0000","last_became_active":"2024-09-16T01:54:21.862211+0000","last_became_peered":"2024-09-16T01:54:21.862211+0000","last_unstale":"2024-09-16T01:54:28.145475+0000","last_undegraded":"2024-09-16T01:54:28.145475+0000","last_fullsized":"2024-09-16T01:54:28.145475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:12:08.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.678116+0000","last_change":"2024-09-16T01:54:21.866825+0000","last_active":"2024-09-16T01:54:27.678116+0000","last_peered":"2024-09-16T01:54:27.678116+0000","last_clean":"2024-09-16T01:54:27.678116+0000","last_became_active":"2024-09-16T01:54:21.866552+0000","last_became_peered":"2024-09-16T01:54:21.866552+0000","last_unstale":"2024-09-16T01:54:27.678116+0000","last_undegraded":"2024-09-16T01:54:27.678116+0000","last_fullsized":"2024-09-16T01:54:27.678116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:39.643076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.144763+0000","last_change":"2024-09-16T01:54:21.864915+0000","last_active":"2024-09-16T01:54:28.144763+0000","last_peered":"2024-09-16T01:54:28.144763+0000","last_clean":"2024-09-16T01:54:28.144763+0000","last_became_active":"2024-09-16T01:54:21.864522+0000","last_became_peered":"2024-09-16T01:54:21.864522+0000","last_unstale":"2024-09-16T01:54:28.144763+0000","last_undegraded":"2024-09-16T01:54:28.144763+0000","last_fullsized":"2024-09-16T01:54:28.144763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:45.231377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:27.644314+0000","last_change":"2024-09-16T01:54:21.863988+0000","last_active":"2024-09-16T01:54:27.644314+0000","last_peered":"2024-09-16T01:54:27.644314+0000","last_clean":"2024-09-16T01:54:27.644314+0000","last_became_active":"2024-09-16T01:54:21.863692+0000","last_became_peered":"2024-09-16T01:54:21.863692+0000","last_unstale":"2024-09-16T01:54:27.644314+0000","last_undegraded":"2024-09-16T01:54:27.644314+0000","last_fullsized":"2024-09-16T01:54:27.644314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:37.333547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T01:54:28.145865+0000","last_change":"2024-09-16T01:54:21.862642+0000","last_active":"2024-09-16T01:54:28.145865+0000","last_peered":"2024-09-16T01:54:28.145865+0000","last_clean":"2024-09-16T01:54:28.145865+0000","last_became_active":"2024-09-16T01:54:21.862364+0000","last_became_peered":"2024-09-16T01:54:21.862364+0000","last_unstale":"2024-09-16T01:54:28.145865+0000","last_undegraded":"2024-09-16T01:54:28.145865+0000","last_fullsized":"2024-09-16T01:54:28.145865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:20.830382+0000","last_clean_scrub_stamp":"2024-09-16T01:54:20.830382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:37.651766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":270336,"data_stored":106307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":102623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":864256,"data_stored":693469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":102463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:54:46.692 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:54:46.692 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T01:54:46.692 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T01:54:46.692 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:54:46.745 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:54:46.772 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:54:46.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.827+0000 7f901976d640 1 Processor -- start 2024-09-16T01:54:46.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.827+0000 7f901976d640 1 -- start start 2024-09-16T01:54:46.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.828+0000 7f901976d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9014161c80 0x7f901406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.828+0000 7f901976d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9014162060 0x7f90140b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.828+0000 7f901976d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f901406e870 con 0x7f90140b64b0 2024-09-16T01:54:46.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.828+0000 7f901976d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f901406d9f0 con 0x7f9014161c80 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.828+0000 7f901976d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f901406dcd0 con 0x7f9014162060 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.828+0000 7f90137fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f90140b64b0 0x7f9014162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45534/0 (socket says 172.21.15.42:45534) 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.828+0000 7f90137fe640 1 -- 172.21.15.42:0/2305878749 learned_addr learned my addr 172.21.15.42:0/2305878749 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.828+0000 7f9012ffd640 1 --2- 172.21.15.42:0/2305878749 >> v2:172.21.15.107:3300/0 conn(0x7f9014161c80 0x7f901406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.828+0000 7f90127fc640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9014162060 0x7f90140b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.828+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494613392 0 0) 0x7f9004001490 con 0x7f90140b64b0 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9000003520 con 0x7f90140b64b0 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1796683376 0 0) 0x7f9000003520 con 0x7f90140b64b0 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9014162060 msgr2=0x7f90140b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9014162060 0x7f90140b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 >> v2:172.21.15.107:3300/0 conn(0x7f9014161c80 msgr2=0x7f901406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:46.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 --2- 172.21.15.42:0/2305878749 >> v2:172.21.15.107:3300/0 conn(0x7f9014161c80 0x7f901406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901406dfb0 con 0x7f90140b64b0 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f9004001bc0 con 0x7f90140b64b0 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 >> v1:172.21.15.42:6789/0 conn(0x7f90140b64b0 legacy=0x7f9014162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9014162060 0x7f90000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 0x7f9000004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9000004d40 0x7f90000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f901406d9f0 con 0x7f9000003f30 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f901406dcd0 con 0x7f9000004d40 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f900000b9c0 con 0x7f9014162060 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f90127fc640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 0x7f9000004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f9012ffd640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9014162060 0x7f90000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f90137fe640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9000004d40 0x7f90000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f90127fc640 1 -- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9014162060 msgr2=0x7f90000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f90127fc640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9014162060 0x7f90000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f90127fc640 1 -- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9000004d40 msgr2=0x7f90000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f90127fc640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9000004d40 0x7f90000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.829+0000 7f90127fc640 1 -- 172.21.15.42:0/2305878749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9000003520 con 0x7f9000003f30 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.830+0000 7f90127fc640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 0x7f9000004800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f901408e830 tx=0x7f9000005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4b8827de85a984 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.830+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc036070 con 0x7f9000003f30 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.830+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ffc031400 con 0x7f9000003f30 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.830+0000 7f9011ffb640 1 -- 172.21.15.42:0/2305878749 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc009690 con 0x7f9000003f30 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.831+0000 7f901976d640 1 -- 172.21.15.42:0/2305878749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 msgr2=0x7f9000004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.831+0000 7f901976d640 1 --2- 172.21.15.42:0/2305878749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 0x7f9000004800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f901408e830 tx=0x7f9000005830 comp rx=0 tx=0).stop 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.831+0000 7f90137fe640 1 -- 172.21.15.42:0/2305878749 reap_dead start 2024-09-16T01:54:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.831+0000 7f901976d640 1 -- 172.21.15.42:0/2305878749 shutdown_connections 2024-09-16T01:54:46.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.831+0000 7f901976d640 1 -- 172.21.15.42:0/2305878749 >> 172.21.15.42:0/2305878749 conn(0x7f90140d44f0 msgr2=0x7f90140d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:46.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.831+0000 7f901976d640 1 -- 172.21.15.42:0/2305878749 shutdown_connections 2024-09-16T01:54:46.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.831+0000 7f901976d640 1 -- 172.21.15.42:0/2305878749 wait complete. 2024-09-16T01:54:46.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.832+0000 7f901976d640 1 Processor -- start 2024-09-16T01:54:46.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.832+0000 7f901976d640 1 -- start start 2024-09-16T01:54:46.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f901976d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 0x7f90140b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f901976d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90140b9530 0x7f90140b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f901976d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90140b7420 0x7f90140b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f901976d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f90140d2a10 con 0x7f9000003f30 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f901976d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f90140d2890 con 0x7f90140b7420 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f901976d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f90140b5f70 con 0x7f90140b9530 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f9012ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 0x7f90140b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f9012ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 0x7f90140b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53610/0 (socket says 172.21.15.42:53610) 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f9012ffd640 1 -- 172.21.15.42:0/1699922069 learned_addr learned my addr 172.21.15.42:0/1699922069 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f90137fe640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90140b7420 0x7f90140b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f90127fc640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90140b9530 0x7f90140b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f9012ffd640 1 -- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90140b9530 msgr2=0x7f90140b99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f9012ffd640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90140b9530 0x7f90140b99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f9012ffd640 1 -- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90140b7420 msgr2=0x7f90140b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f9012ffd640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90140b7420 0x7f90140b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f9012ffd640 1 -- 172.21.15.42:0/1699922069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90140cc0c0 con 0x7f9000003f30 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.833+0000 7f90127fc640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90140b9530 0x7f90140b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.834+0000 7f9012ffd640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 0x7f90140b22a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f900c011aa0 tx=0x7f900c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.834+0000 7f900b7fe640 1 -- 172.21.15.42:0/1699922069 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c00fb80 con 0x7f9000003f30 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.834+0000 7f900b7fe640 1 -- 172.21.15.42:0/1699922069 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c00fd20 con 0x7f9000003f30 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.834+0000 7f901976d640 1 -- 172.21.15.42:0/1699922069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90140cc3a0 con 0x7f9000003f30 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.834+0000 7f900b7fe640 1 -- 172.21.15.42:0/1699922069 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c014660 con 0x7f9000003f30 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.834+0000 7f901976d640 1 -- 172.21.15.42:0/1699922069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90140cc960 con 0x7f9000003f30 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.835+0000 7f901976d640 1 -- 172.21.15.42:0/1699922069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901406e330 con 0x7f9000003f30 2024-09-16T01:54:46.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.835+0000 7f900b7fe640 1 -- 172.21.15.42:0/1699922069 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f900c012040 con 0x7f9000003f30 2024-09-16T01:54:46.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.836+0000 7f900b7fe640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8ff406c2b0 0x7f8ff406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:46.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.836+0000 7f900b7fe640 1 -- 172.21.15.42:0/1699922069 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f900c08be70 con 0x7f9000003f30 2024-09-16T01:54:46.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.836+0000 7f90127fc640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8ff406c2b0 0x7f8ff406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:46.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.836+0000 7f90127fc640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8ff406c2b0 0x7f8ff406e770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc033000 tx=0x7f8ffc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:46.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:46.840+0000 7f900b7fe640 1 -- 172.21.15.42:0/1699922069 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f900c019030 con 0x7f9000003f30 2024-09-16T01:54:47.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.054+0000 7f901976d640 1 -- 172.21.15.42:0/1699922069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f901406d730 con 0x7f9000003f30 2024-09-16T01:54:47.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.054+0000 7f900b7fe640 1 -- 172.21.15.42:0/1699922069 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f900c05a2a0 con 0x7f9000003f30 2024-09-16T01:54:47.057 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:47.057 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T01:54:47.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 -- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8ff406c2b0 msgr2=0x7f8ff406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8ff406c2b0 0x7f8ff406e770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc033000 tx=0x7f8ffc008030 comp rx=0 tx=0).stop 2024-09-16T01:54:47.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 -- 172.21.15.42:0/1699922069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 msgr2=0x7f90140b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 0x7f90140b22a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f900c011aa0 tx=0x7f900c011f60 comp rx=0 tx=0).stop 2024-09-16T01:54:47.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 -- 172.21.15.42:0/1699922069 shutdown_connections 2024-09-16T01:54:47.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8ff406c2b0 0x7f8ff406e770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90140b7420 0x7f90140b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90140b9530 0x7f90140b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 --2- 172.21.15.42:0/1699922069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9000003f30 0x7f90140b22a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 -- 172.21.15.42:0/1699922069 >> 172.21.15.42:0/1699922069 conn(0x7f90140d44f0 msgr2=0x7f9014156150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:47.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 -- 172.21.15.42:0/1699922069 shutdown_connections 2024-09-16T01:54:47.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.056+0000 7f901976d640 1 -- 172.21.15.42:0/1699922069 wait complete. 2024-09-16T01:54:47.070 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T01:54:47.070 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:54:47.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.211+0000 7fe493d26640 1 Processor -- start 2024-09-16T01:54:47.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.211+0000 7fe493d26640 1 -- start start 2024-09-16T01:54:47.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.212+0000 7fe493d26640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe48c0cfcc0 0x7fe48c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.212+0000 7fe493d26640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48c0d2700 con 0x7fe48c0d4fd0 2024-09-16T01:54:47.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.212+0000 7fe493d26640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48c0cedb0 con 0x7fe48c15e760 2024-09-16T01:54:47.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.212+0000 7fe493d26640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe48c0cf090 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.212+0000 7fe4922c3640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe48c0d4fd0 0x7fe48c0d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45548/0 (socket says 172.21.15.42:45548) 2024-09-16T01:54:47.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.212+0000 7fe4922c3640 1 -- 172.21.15.42:0/3258986971 learned_addr learned my addr 172.21.15.42:0/3258986971 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:47.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.212+0000 7fe4912c1640 1 --2- 172.21.15.42:0/3258986971 >> v2:172.21.15.107:3300/0 conn(0x7fe48c0cfcc0 0x7fe48c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.212+0000 7fe490ac0640 1 -- 172.21.15.42:0/3258986971 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2661743630 0 0) 0x7fe484001490 con 0x7fe48c0d4fd0 2024-09-16T01:54:47.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.212+0000 7fe490ac0640 1 -- 172.21.15.42:0/3258986971 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe478003520 con 0x7fe48c0d4fd0 2024-09-16T01:54:47.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.213+0000 7fe4912c1640 1 -- 172.21.15.42:0/3258986971 >> v1:172.21.15.107:6789/0 conn(0x7fe48c15e760 legacy=0x7fe48c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.213+0000 7fe4912c1640 1 -- 172.21.15.42:0/3258986971 >> v1:172.21.15.42:6789/0 conn(0x7fe48c0d4fd0 legacy=0x7fe48c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.213+0000 7fe4912c1640 1 -- 172.21.15.42:0/3258986971 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c0b3c80 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.213+0000 7fe4912c1640 1 --2- 172.21.15.42:0/3258986971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe48c0cfcc0 0x7fe48c06cdd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009790 tx=0x7fe47c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ed776670be3dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:47.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.213+0000 7fe490ac0640 1 -- 172.21.15.42:0/3258986971 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c037070 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.214+0000 7fe490ac0640 1 -- 172.21.15.42:0/3258986971 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47c032440 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.214+0000 7fe490ac0640 1 -- 172.21.15.42:0/3258986971 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c032810 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.214+0000 7fe493d26640 1 -- 172.21.15.42:0/3258986971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe48c0cfcc0 msgr2=0x7fe48c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.214+0000 7fe493d26640 1 --2- 172.21.15.42:0/3258986971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe48c0cfcc0 0x7fe48c06cdd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009790 tx=0x7fe47c02a210 comp rx=0 tx=0).stop 2024-09-16T01:54:47.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.214+0000 7fe493d26640 1 -- 172.21.15.42:0/3258986971 shutdown_connections 2024-09-16T01:54:47.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.214+0000 7fe493d26640 1 --2- 172.21.15.42:0/3258986971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe48c0cfcc0 0x7fe48c06cdd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.214+0000 7fe493d26640 1 -- 172.21.15.42:0/3258986971 >> 172.21.15.42:0/3258986971 conn(0x7fe48c08bfc0 msgr2=0x7fe48c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:47.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.214+0000 7fe493d26640 1 -- 172.21.15.42:0/3258986971 shutdown_connections 2024-09-16T01:54:47.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.214+0000 7fe493d26640 1 -- 172.21.15.42:0/3258986971 wait complete. 2024-09-16T01:54:47.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.215+0000 7fe493d26640 1 Processor -- start 2024-09-16T01:54:47.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.215+0000 7fe493d26640 1 -- start start 2024-09-16T01:54:47.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.216+0000 7fe493d26640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe48c0cfcc0 0x7fe48c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.216+0000 7fe493d26640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe48c0d4fd0 0x7fe48c161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.216+0000 7fe493d26640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe48c15e760 0x7fe48c153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.216+0000 7fe493d26640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c0d35b0 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.216+0000 7fe493d26640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c0b3920 con 0x7fe48c0d4fd0 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.216+0000 7fe493d26640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe48c0d3730 con 0x7fe48c15e760 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.216+0000 7fe491ac2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe48c0cfcc0 0x7fe48c15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.216+0000 7fe491ac2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe48c0cfcc0 0x7fe48c15eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53626/0 (socket says 172.21.15.42:53626) 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.216+0000 7fe491ac2640 1 -- 172.21.15.42:0/2655124672 learned_addr learned my addr 172.21.15.42:0/2655124672 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe4912c1640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe48c0d4fd0 0x7fe48c161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe491ac2640 1 -- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe48c15e760 msgr2=0x7fe48c153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe4922c3640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe48c15e760 0x7fe48c153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe491ac2640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe48c15e760 0x7fe48c153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe491ac2640 1 -- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe48c0d4fd0 msgr2=0x7fe48c161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe491ac2640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe48c0d4fd0 0x7fe48c161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe491ac2640 1 -- 172.21.15.42:0/2655124672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c15f080 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe491ac2640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe48c0cfcc0 0x7fe48c15eb40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c3c0 tx=0x7fe48800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:47.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe4827fc640 1 -- 172.21.15.42:0/2655124672 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4880052d0 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe4827fc640 1 -- 172.21.15.42:0/2655124672 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe488005490 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe493d26640 1 -- 172.21.15.42:0/2655124672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48c15f300 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe4827fc640 1 -- 172.21.15.42:0/2655124672 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe488007260 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.217+0000 7fe493d26640 1 -- 172.21.15.42:0/2655124672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48c15f8c0 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.218+0000 7fe493d26640 1 -- 172.21.15.42:0/2655124672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48c160090 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.219+0000 7fe4827fc640 1 -- 172.21.15.42:0/2655124672 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe488007400 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.219+0000 7fe4827fc640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe47006c2b0 0x7fe47006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.219+0000 7fe4827fc640 1 -- 172.21.15.42:0/2655124672 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe48808abc0 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.219+0000 7fe4912c1640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe47006c2b0 0x7fe47006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.220+0000 7fe4912c1640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe47006c2b0 0x7fe47006e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe47c034000 tx=0x7fe47c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:47.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.223+0000 7fe4827fc640 1 -- 172.21.15.42:0/2655124672 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe48c15f080 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.434+0000 7fe493d26640 1 -- 172.21.15.42:0/2655124672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe48c0d3a60 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.434+0000 7fe4827fc640 1 -- 172.21.15.42:0/2655124672 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5231 (secure 0 0 0) 0x7fe488059080 con 0x7fe48c0cfcc0 2024-09-16T01:54:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:47.437 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-16T01:54:40:934131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:54:21.197115+0000","modified":"2024-09-16T01:54:40.289757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34157,"qdb_cluster":[34157]},"id":1}]} 2024-09-16T01:54:47.437 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-16T01:54:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 -- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe47006c2b0 msgr2=0x7fe47006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe47006c2b0 0x7fe47006e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe47c034000 tx=0x7fe47c02e000 comp rx=0 tx=0).stop 2024-09-16T01:54:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 -- 172.21.15.42:0/2655124672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe48c0cfcc0 msgr2=0x7fe48c15eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe48c0cfcc0 0x7fe48c15eb40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c3c0 tx=0x7fe48800c880 comp rx=0 tx=0).stop 2024-09-16T01:54:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 -- 172.21.15.42:0/2655124672 shutdown_connections 2024-09-16T01:54:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe47006c2b0 0x7fe47006e770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe48c15e760 0x7fe48c153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe48c0d4fd0 0x7fe48c161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 --2- 172.21.15.42:0/2655124672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe48c0cfcc0 0x7fe48c15eb40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 -- 172.21.15.42:0/2655124672 >> 172.21.15.42:0/2655124672 conn(0x7fe48c08bfc0 msgr2=0x7fe48c0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 -- 172.21.15.42:0/2655124672 shutdown_connections 2024-09-16T01:54:47.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.436+0000 7fe493d26640 1 -- 172.21.15.42:0/2655124672 wait complete. 2024-09-16T01:54:47.450 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:54:47.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.549+0000 7fa7c56c9640 1 Processor -- start 2024-09-16T01:54:47.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.549+0000 7fa7c56c9640 1 -- start start 2024-09-16T01:54:47.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.550+0000 7fa7c56c9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7c0161c80 0x7fa7c006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.550+0000 7fa7c56c9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7c0162060 0x7fa7c00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.550+0000 7fa7c56c9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c006e870 con 0x7fa7c00b64b0 2024-09-16T01:54:47.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.550+0000 7fa7c56c9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c006d9f0 con 0x7fa7c0162060 2024-09-16T01:54:47.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.550+0000 7fa7c56c9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c006dcd0 con 0x7fa7c0161c80 2024-09-16T01:54:47.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.550+0000 7fa7be7fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7c0162060 0x7fa7c00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.550+0000 7fa7beffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7c0161c80 0x7fa7c006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.551+0000 7fa7bf7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa7c00b64b0 0x7fa7c0162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:51126/0 (socket says 172.21.15.42:51126) 2024-09-16T01:54:47.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.551+0000 7fa7bf7fe640 1 -- 172.21.15.42:0/3371566567 learned_addr learned my addr 172.21.15.42:0/3371566567 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:47.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.551+0000 7fa7be7fc640 1 -- 172.21.15.42:0/3371566567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7c0161c80 msgr2=0x7fa7c006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:47.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.551+0000 7fa7be7fc640 1 --2- 172.21.15.42:0/3371566567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7c0161c80 0x7fa7c006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.551+0000 7fa7be7fc640 1 -- 172.21.15.42:0/3371566567 >> v1:172.21.15.107:6789/0 conn(0x7fa7c00b64b0 legacy=0x7fa7c0162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.551+0000 7fa7be7fc640 1 -- 172.21.15.42:0/3371566567 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c006dfb0 con 0x7fa7c0162060 2024-09-16T01:54:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7be7fc640 1 --2- 172.21.15.42:0/3371566567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7c0162060 0x7fa7c00b5f70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80097a0 tx=0x7fa7a802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6403429894318a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7bdffb640 1 -- 172.21.15.42:0/3371566567 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8037070 con 0x7fa7c0162060 2024-09-16T01:54:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7bdffb640 1 -- 172.21.15.42:0/3371566567 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a8032440 con 0x7fa7c0162060 2024-09-16T01:54:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7bdffb640 1 -- 172.21.15.42:0/3371566567 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8032810 con 0x7fa7c0162060 2024-09-16T01:54:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7c56c9640 1 -- 172.21.15.42:0/3371566567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7c0162060 msgr2=0x7fa7c00b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7c56c9640 1 --2- 172.21.15.42:0/3371566567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7c0162060 0x7fa7c00b5f70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80097a0 tx=0x7fa7a802a180 comp rx=0 tx=0).stop 2024-09-16T01:54:47.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7c56c9640 1 -- 172.21.15.42:0/3371566567 shutdown_connections 2024-09-16T01:54:47.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7c56c9640 1 --2- 172.21.15.42:0/3371566567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7c0162060 0x7fa7c00b5f70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7c56c9640 1 --2- 172.21.15.42:0/3371566567 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7c0161c80 0x7fa7c006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7c56c9640 1 -- 172.21.15.42:0/3371566567 >> 172.21.15.42:0/3371566567 conn(0x7fa7c00d44f0 msgr2=0x7fa7c00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:47.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7c56c9640 1 -- 172.21.15.42:0/3371566567 shutdown_connections 2024-09-16T01:54:47.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.552+0000 7fa7c56c9640 1 -- 172.21.15.42:0/3371566567 wait complete. 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.554+0000 7fa7c56c9640 1 Processor -- start 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.554+0000 7fa7c56c9640 1 -- start start 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.554+0000 7fa7c56c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c00b64b0 0x7fa7c01564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.554+0000 7fa7c56c9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7c0161c80 0x7fa7c0156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.554+0000 7fa7c56c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7c0162060 0x7fa7c00cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.554+0000 7fa7c56c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c00d2a10 con 0x7fa7c00b64b0 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.554+0000 7fa7c56c9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c00d2890 con 0x7fa7c0162060 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.554+0000 7fa7c56c9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c00b6960 con 0x7fa7c0161c80 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7beffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c00b64b0 0x7fa7c01564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7beffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c00b64b0 0x7fa7c01564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53632/0 (socket says 172.21.15.42:53632) 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7beffd640 1 -- 172.21.15.42:0/2346712613 learned_addr learned my addr 172.21.15.42:0/2346712613 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:47.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7bf7fe640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7c0162060 0x7fa7c00cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7be7fc640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7c0161c80 0x7fa7c0156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7beffd640 1 -- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7c0161c80 msgr2=0x7fa7c0156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7beffd640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7c0161c80 0x7fa7c0156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7beffd640 1 -- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7c0162060 msgr2=0x7fa7c00cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7beffd640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7c0162060 0x7fa7c00cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7beffd640 1 -- 172.21.15.42:0/2346712613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c00cce60 con 0x7fa7c00b64b0 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7beffd640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c00b64b0 0x7fa7c01564d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800e9e0 tx=0x7fa7b800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7b77fe640 1 -- 172.21.15.42:0/2346712613 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8017070 con 0x7fa7c00b64b0 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7b77fe640 1 -- 172.21.15.42:0/2346712613 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b800c9d0 con 0x7fa7c00b64b0 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7c56c9640 1 -- 172.21.15.42:0/2346712613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c00cd140 con 0x7fa7c00b64b0 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7b77fe640 1 -- 172.21.15.42:0/2346712613 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800cdc0 con 0x7fa7c00b64b0 2024-09-16T01:54:47.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.555+0000 7fa7c56c9640 1 -- 172.21.15.42:0/2346712613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c00c9f90 con 0x7fa7c00b64b0 2024-09-16T01:54:47.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.556+0000 7fa7c56c9640 1 -- 172.21.15.42:0/2346712613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c00cd660 con 0x7fa7c00b64b0 2024-09-16T01:54:47.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.557+0000 7fa7b77fe640 1 -- 172.21.15.42:0/2346712613 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa7b801a070 con 0x7fa7c00b64b0 2024-09-16T01:54:47.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.557+0000 7fa7b77fe640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa7a006c2e0 0x7fa7a006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.558+0000 7fa7b77fe640 1 -- 172.21.15.42:0/2346712613 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa7b808bb80 con 0x7fa7c00b64b0 2024-09-16T01:54:47.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.558+0000 7fa7be7fc640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa7a006c2e0 0x7fa7a006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.558+0000 7fa7be7fc640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa7a006c2e0 0x7fa7a006e7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8034000 tx=0x7fa7a802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:47.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.562+0000 7fa7b77fe640 1 -- 172.21.15.42:0/2346712613 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7b8059f20 con 0x7fa7c00b64b0 2024-09-16T01:54:47.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.774+0000 7fa7c56c9640 1 -- 172.21.15.42:0/2346712613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7c00c9d80 con 0x7fa7c00b64b0 2024-09-16T01:54:47.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.775+0000 7fa7b77fe640 1 -- 172.21.15.42:0/2346712613 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5231 (secure 0 0 0) 0x7fa7b8059820 con 0x7fa7c00b64b0 2024-09-16T01:54:47.777 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:47.778 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-16T01:54:40:934131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:54:21.197115+0000","modified":"2024-09-16T01:54:40.289757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34157,"qdb_cluster":[34157]},"id":1}]} 2024-09-16T01:54:47.778 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-16T01:54:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 -- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa7a006c2e0 msgr2=0x7fa7a006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa7a006c2e0 0x7fa7a006e7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8034000 tx=0x7fa7a802e000 comp rx=0 tx=0).stop 2024-09-16T01:54:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 -- 172.21.15.42:0/2346712613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c00b64b0 msgr2=0x7fa7c01564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c00b64b0 0x7fa7c01564d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800e9e0 tx=0x7fa7b800eea0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 -- 172.21.15.42:0/2346712613 shutdown_connections 2024-09-16T01:54:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa7a006c2e0 0x7fa7a006e7a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7c0162060 0x7fa7c00cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7c0161c80 0x7fa7c0156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 --2- 172.21.15.42:0/2346712613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c00b64b0 0x7fa7c01564d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 -- 172.21.15.42:0/2346712613 >> 172.21.15.42:0/2346712613 conn(0x7fa7c00d44f0 msgr2=0x7fa7c00d3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 -- 172.21.15.42:0/2346712613 shutdown_connections 2024-09-16T01:54:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.777+0000 7fa7c56c9640 1 -- 172.21.15.42:0/2346712613 wait complete. 2024-09-16T01:54:47.790 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:47.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.890+0000 7ff707a42640 1 Processor -- start 2024-09-16T01:54:47.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.891+0000 7ff707a42640 1 -- start start 2024-09-16T01:54:47.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.891+0000 7ff707a42640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff70015e5f0 0x7ff7000d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.891+0000 7ff707a42640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff7000d30f0 0x7ff7000b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.891+0000 7ff707a42640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7000b64c0 0x7ff7000cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.891+0000 7ff707a42640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff70006d530 con 0x7ff70015e5f0 2024-09-16T01:54:47.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.891+0000 7ff707a42640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff7000d3690 con 0x7ff7000d30f0 2024-09-16T01:54:47.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.891+0000 7ff707a42640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff7000d3970 con 0x7ff7000b64c0 2024-09-16T01:54:47.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.892+0000 7ff7057de640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff70015e5f0 0x7ff7000d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.892+0000 7ff7057de640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff70015e5f0 0x7ff7000d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53642/0 (socket says 172.21.15.42:53642) 2024-09-16T01:54:47.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.892+0000 7ff7057de640 1 -- 172.21.15.42:0/661595376 learned_addr learned my addr 172.21.15.42:0/661595376 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:47.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.892+0000 7ff705fdf640 1 --2- 172.21.15.42:0/661595376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7000b64c0 0x7ff7000cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.892+0000 7ff704fdd640 1 --2- 172.21.15.42:0/661595376 >> v2:172.21.15.107:3300/0 conn(0x7ff7000d30f0 0x7ff7000b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.892+0000 7ff7057de640 1 -- 172.21.15.42:0/661595376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7000b64c0 msgr2=0x7ff7000cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:47.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.892+0000 7ff7057de640 1 --2- 172.21.15.42:0/661595376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7000b64c0 0x7ff7000cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.892+0000 7ff7057de640 1 -- 172.21.15.42:0/661595376 >> v2:172.21.15.107:3300/0 conn(0x7ff7000d30f0 msgr2=0x7ff7000b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:47.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.892+0000 7ff7057de640 1 --2- 172.21.15.42:0/661595376 >> v2:172.21.15.107:3300/0 conn(0x7ff7000d30f0 0x7ff7000b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.892+0000 7ff7057de640 1 -- 172.21.15.42:0/661595376 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70006cee0 con 0x7ff70015e5f0 2024-09-16T01:54:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff7057de640 1 --2- 172.21.15.42:0/661595376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 0x7ff7000d4dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff70008e520 tx=0x7ff6f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647243c001b484c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff6fffff640 1 -- 172.21.15.42:0/661595376 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8037070 con 0x7ff70015e5f0 2024-09-16T01:54:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff6fffff640 1 -- 172.21.15.42:0/661595376 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f8032440 con 0x7ff70015e5f0 2024-09-16T01:54:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff6fffff640 1 -- 172.21.15.42:0/661595376 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8032810 con 0x7ff70015e5f0 2024-09-16T01:54:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff707a42640 1 -- 172.21.15.42:0/661595376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 msgr2=0x7ff7000d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff707a42640 1 --2- 172.21.15.42:0/661595376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 0x7ff7000d4dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff70008e520 tx=0x7ff6f802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff707a42640 1 -- 172.21.15.42:0/661595376 shutdown_connections 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff707a42640 1 --2- 172.21.15.42:0/661595376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7000b64c0 0x7ff7000cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff707a42640 1 --2- 172.21.15.42:0/661595376 >> v2:172.21.15.107:3300/0 conn(0x7ff7000d30f0 0x7ff7000b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff707a42640 1 --2- 172.21.15.42:0/661595376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 0x7ff7000d4dd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff707a42640 1 -- 172.21.15.42:0/661595376 >> 172.21.15.42:0/661595376 conn(0x7ff70008bfc0 msgr2=0x7ff7000d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff707a42640 1 -- 172.21.15.42:0/661595376 shutdown_connections 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.893+0000 7ff707a42640 1 -- 172.21.15.42:0/661595376 wait complete. 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.895+0000 7ff707a42640 1 Processor -- start 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.895+0000 7ff707a42640 1 -- start start 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.895+0000 7ff707a42640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7000b64c0 0x7ff7000b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.895+0000 7ff707a42640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7000d30f0 0x7ff7000b8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.895+0000 7ff707a42640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 0x7ff7000b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.895+0000 7ff707a42640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff7000d5310 con 0x7ff70015e5f0 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.895+0000 7ff707a42640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff70015e9d0 con 0x7ff7000b64c0 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.895+0000 7ff707a42640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff7000cf540 con 0x7ff7000d30f0 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff705fdf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 0x7ff7000b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff705fdf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 0x7ff7000b85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53650/0 (socket says 172.21.15.42:53650) 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff705fdf640 1 -- 172.21.15.42:0/3349176720 learned_addr learned my addr 172.21.15.42:0/3349176720 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff7057de640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7000b64c0 0x7ff7000b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff704fdd640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7000d30f0 0x7ff7000b8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff705fdf640 1 -- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7000d30f0 msgr2=0x7ff7000b8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff705fdf640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7000d30f0 0x7ff7000b8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff705fdf640 1 -- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7000b64c0 msgr2=0x7ff7000b9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff705fdf640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7000b64c0 0x7ff7000b9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff705fdf640 1 -- 172.21.15.42:0/3349176720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7000b7950 con 0x7ff70015e5f0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff705fdf640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 0x7ff7000b85d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0007e40 tx=0x7ff6f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff6fdffb640 1 -- 172.21.15.42:0/3349176720 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0014620 con 0x7ff70015e5f0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff6fdffb640 1 -- 172.21.15.42:0/3349176720 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0019070 con 0x7ff70015e5f0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff707a42640 1 -- 172.21.15.42:0/3349176720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7000b7c30 con 0x7ff70015e5f0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff6fdffb640 1 -- 172.21.15.42:0/3349176720 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0014a20 con 0x7ff70015e5f0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.896+0000 7ff707a42640 1 -- 172.21.15.42:0/3349176720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7000c8560 con 0x7ff70015e5f0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.897+0000 7ff707a42640 1 -- 172.21.15.42:0/3349176720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7000b52b0 con 0x7ff70015e5f0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.898+0000 7ff6fdffb640 1 -- 172.21.15.42:0/3349176720 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff6f0014bc0 con 0x7ff70015e5f0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.898+0000 7ff6fdffb640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6ec06c2b0 0x7ff6ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.899+0000 7ff6fdffb640 1 -- 172.21.15.42:0/3349176720 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff6f008bf40 con 0x7ff70015e5f0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.899+0000 7ff7057de640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6ec06c2b0 0x7ff6ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:47.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.899+0000 7ff7057de640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6ec06c2b0 0x7ff6ec06e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8034000 tx=0x7ff6f802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:47.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:47.903+0000 7ff6fdffb640 1 -- 172.21.15.42:0/3349176720 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7000b52b0 con 0x7ff70015e5f0 2024-09-16T01:54:48.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.078+0000 7ff707a42640 1 -- 172.21.15.42:0/3349176720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7000b5f80 con 0x7ff70015e5f0 2024-09-16T01:54:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.079+0000 7ff6fdffb640 1 -- 172.21.15.42:0/3349176720 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7ff6f0059d10 con 0x7ff70015e5f0 2024-09-16T01:54:48.082 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:48.082 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 -- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6ec06c2b0 msgr2=0x7ff6ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6ec06c2b0 0x7ff6ec06e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8034000 tx=0x7ff6f802e000 comp rx=0 tx=0).stop 2024-09-16T01:54:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 -- 172.21.15.42:0/3349176720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 msgr2=0x7ff7000b85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 0x7ff7000b85d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0007e40 tx=0x7ff6f000e4b0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 -- 172.21.15.42:0/3349176720 shutdown_connections 2024-09-16T01:54:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6ec06c2b0 0x7ff6ec06e770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff70015e5f0 0x7ff7000b85d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7000d30f0 0x7ff7000b8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 --2- 172.21.15.42:0/3349176720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff7000b64c0 0x7ff7000b9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 -- 172.21.15.42:0/3349176720 >> 172.21.15.42:0/3349176720 conn(0x7ff70008bfc0 msgr2=0x7ff7000b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 -- 172.21.15.42:0/3349176720 shutdown_connections 2024-09-16T01:54:48.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.081+0000 7ff707a42640 1 -- 172.21.15.42:0/3349176720 wait complete. 2024-09-16T01:54:48.095 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:54:48.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.195+0000 7f2099af1640 1 Processor -- start 2024-09-16T01:54:48.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.195+0000 7f2099af1640 1 -- start start 2024-09-16T01:54:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2099af1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f209415e760 0x7f209406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2099af1640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f20940cfcc0 0x7f20940d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2099af1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20940d2700 con 0x7f20940d4fd0 2024-09-16T01:54:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2099af1640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f20940cedb0 con 0x7f20940cfcc0 2024-09-16T01:54:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2099af1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f20940cf090 con 0x7f209415e760 2024-09-16T01:54:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2093fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f20940cfcc0 0x7f20940d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2093fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f20940cfcc0 0x7f20940d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57420/0 (socket says 172.21.15.42:57420) 2024-09-16T01:54:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2093fff640 1 -- 172.21.15.42:0/1982885979 learned_addr learned my addr 172.21.15.42:0/1982885979 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f20937fe640 1 --2- 172.21.15.42:0/1982885979 >> v2:172.21.15.107:3300/0 conn(0x7f209415e760 0x7f209406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2093fff640 1 -- 172.21.15.42:0/1982885979 >> v2:172.21.15.107:3300/0 conn(0x7f209415e760 msgr2=0x7f209406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2093fff640 1 --2- 172.21.15.42:0/1982885979 >> v2:172.21.15.107:3300/0 conn(0x7f209415e760 0x7f209406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2093fff640 1 -- 172.21.15.42:0/1982885979 >> v1:172.21.15.107:6789/0 conn(0x7f20940d4fd0 legacy=0x7f20940cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.196+0000 7f2093fff640 1 -- 172.21.15.42:0/1982885979 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20940b3c80 con 0x7f20940cfcc0 2024-09-16T01:54:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.197+0000 7f2093fff640 1 --2- 172.21.15.42:0/1982885979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 0x7f20940d2ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f209408ca50 tx=0x7f208c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a41c81ae06b5e0b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:48.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.197+0000 7f20927fc640 1 -- 172.21.15.42:0/1982885979 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c036070 con 0x7f20940cfcc0 2024-09-16T01:54:48.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.197+0000 7f20927fc640 1 -- 172.21.15.42:0/1982885979 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c031600 con 0x7f20940cfcc0 2024-09-16T01:54:48.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.197+0000 7f20927fc640 1 -- 172.21.15.42:0/1982885979 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c0319d0 con 0x7f20940cfcc0 2024-09-16T01:54:48.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.198+0000 7f2099af1640 1 -- 172.21.15.42:0/1982885979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 msgr2=0x7f20940d2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.198+0000 7f2099af1640 1 --2- 172.21.15.42:0/1982885979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 0x7f20940d2ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f209408ca50 tx=0x7f208c02a730 comp rx=0 tx=0).stop 2024-09-16T01:54:48.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.198+0000 7f2099af1640 1 -- 172.21.15.42:0/1982885979 shutdown_connections 2024-09-16T01:54:48.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.198+0000 7f2099af1640 1 --2- 172.21.15.42:0/1982885979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 0x7f20940d2ea0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.198+0000 7f2099af1640 1 --2- 172.21.15.42:0/1982885979 >> v2:172.21.15.107:3300/0 conn(0x7f209415e760 0x7f209406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.198+0000 7f2099af1640 1 -- 172.21.15.42:0/1982885979 >> 172.21.15.42:0/1982885979 conn(0x7f209408bfc0 msgr2=0x7f20940d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:48.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.198+0000 7f2099af1640 1 -- 172.21.15.42:0/1982885979 shutdown_connections 2024-09-16T01:54:48.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.198+0000 7f2099af1640 1 -- 172.21.15.42:0/1982885979 wait complete. 2024-09-16T01:54:48.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.199+0000 7f2099af1640 1 Processor -- start 2024-09-16T01:54:48.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.199+0000 7f2099af1640 1 -- start start 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f2099af1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 0x7f2094149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f2099af1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20940d4fd0 0x7f20940b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f2099af1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209415e760 0x7f20941f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f2099af1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20940d33e0 con 0x7f20940cfcc0 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f2099af1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f20940b38e0 con 0x7f20940d4fd0 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f2099af1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f20940d3560 con 0x7f209415e760 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f20937fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 0x7f2094149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f20937fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 0x7f2094149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57424/0 (socket says 172.21.15.42:57424) 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f20937fe640 1 -- 172.21.15.42:0/308477515 learned_addr learned my addr 172.21.15.42:0/308477515 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f2092ffd640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20940d4fd0 0x7f20940b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f2093fff640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209415e760 0x7f20941f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f20937fe640 1 -- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209415e760 msgr2=0x7f20941f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f20937fe640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209415e760 0x7f20941f8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f20937fe640 1 -- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20940d4fd0 msgr2=0x7f20940b9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f20937fe640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20940d4fd0 0x7f20940b9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f20937fe640 1 -- 172.21.15.42:0/308477515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2094149e60 con 0x7f20940cfcc0 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.200+0000 7f2093fff640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209415e760 0x7f20941f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.201+0000 7f20937fe640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 0x7f2094149920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f208400d600 tx=0x7f208400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.201+0000 7f207bfff640 1 -- 172.21.15.42:0/308477515 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20840125f0 con 0x7f20940cfcc0 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.201+0000 7f207bfff640 1 -- 172.21.15.42:0/308477515 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2084019070 con 0x7f20940cfcc0 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.201+0000 7f207bfff640 1 -- 172.21.15.42:0/308477515 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20840129f0 con 0x7f20940cfcc0 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.201+0000 7f2099af1640 1 -- 172.21.15.42:0/308477515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2094158710 con 0x7f20940cfcc0 2024-09-16T01:54:48.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.201+0000 7f2099af1640 1 -- 172.21.15.42:0/308477515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2094158cd0 con 0x7f20940cfcc0 2024-09-16T01:54:48.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.202+0000 7f2099af1640 1 -- 172.21.15.42:0/308477515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20940d3890 con 0x7f20940cfcc0 2024-09-16T01:54:48.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.202+0000 7f207bfff640 1 -- 172.21.15.42:0/308477515 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2084012b90 con 0x7f20940cfcc0 2024-09-16T01:54:48.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.203+0000 7f207bfff640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f208006c2e0 0x7f208006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.203+0000 7f207bfff640 1 -- 172.21.15.42:0/308477515 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f208408baf0 con 0x7f20940cfcc0 2024-09-16T01:54:48.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.203+0000 7f2092ffd640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f208006c2e0 0x7f208006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.204+0000 7f2092ffd640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f208006c2e0 0x7f208006e7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20940b9a70 tx=0x7f2088009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:48.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.207+0000 7f207bfff640 1 -- 172.21.15.42:0/308477515 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2084059f20 con 0x7f20940cfcc0 2024-09-16T01:54:48.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.417+0000 7f2099af1640 1 -- 172.21.15.42:0/308477515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20940b6d20 con 0x7f20940cfcc0 2024-09-16T01:54:48.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.418+0000 7f207bfff640 1 -- 172.21.15.42:0/308477515 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5231 (secure 0 0 0) 0x7f2084059820 con 0x7f20940cfcc0 2024-09-16T01:54:48.420 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:48.420 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-16T01:54:40:934131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:54:21.197115+0000","modified":"2024-09-16T01:54:40.289757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34157,"qdb_cluster":[34157]},"id":1}]} 2024-09-16T01:54:48.421 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-16T01:54:48.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.419+0000 7f2099af1640 1 -- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f208006c2e0 msgr2=0x7f208006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.419+0000 7f2099af1640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f208006c2e0 0x7f208006e7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20940b9a70 tx=0x7f2088009040 comp rx=0 tx=0).stop 2024-09-16T01:54:48.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.419+0000 7f2099af1640 1 -- 172.21.15.42:0/308477515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 msgr2=0x7f2094149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.419+0000 7f2099af1640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 0x7f2094149920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f208400d600 tx=0x7f208400dac0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.420+0000 7f2099af1640 1 -- 172.21.15.42:0/308477515 shutdown_connections 2024-09-16T01:54:48.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.420+0000 7f2099af1640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f208006c2e0 0x7f208006e7a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.420+0000 7f2099af1640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f209415e760 0x7f20941f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.420+0000 7f2099af1640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20940d4fd0 0x7f20940b9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.420+0000 7f2099af1640 1 --2- 172.21.15.42:0/308477515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20940cfcc0 0x7f2094149920 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.420+0000 7f2099af1640 1 -- 172.21.15.42:0/308477515 >> 172.21.15.42:0/308477515 conn(0x7f209408bfc0 msgr2=0x7f20940d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:48.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.420+0000 7f2099af1640 1 -- 172.21.15.42:0/308477515 shutdown_connections 2024-09-16T01:54:48.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.420+0000 7f2099af1640 1 -- 172.21.15.42:0/308477515 wait complete. 2024-09-16T01:54:48.835 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:54:21.197115+0000', 'modified': '2024-09-16T01:54:40.289757+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34157}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34157': {'gid': 34157, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.107:6837/2229527903', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6835', 'nonce': 2229527903}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 2229527903}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34157, 'qdb_cluster': [34157]} 2024-09-16T01:54:48.835 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:54:48.835 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-16T01:54:48.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.939+0000 7fa629ae4640 1 Processor -- start 2024-09-16T01:54:48.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.940+0000 7fa629ae4640 1 -- start start 2024-09-16T01:54:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.940+0000 7fa629ae4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa624161c80 0x7fa62406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.940+0000 7fa629ae4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa624162060 0x7fa6240b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.940+0000 7fa629ae4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa6240b64b0 0x7fa6240b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.940+0000 7fa629ae4640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fa62406e870 con 0x7fa624162060 2024-09-16T01:54:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.940+0000 7fa629ae4640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa62406d9f0 con 0x7fa6240b64b0 2024-09-16T01:54:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.940+0000 7fa629ae4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa62406dcd0 con 0x7fa624161c80 2024-09-16T01:54:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.940+0000 7fa622ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa624162060 0x7fa6240b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.941+0000 7fa622ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa624162060 0x7fa6240b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57436/0 (socket says 172.21.15.42:57436) 2024-09-16T01:54:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.941+0000 7fa622ffd640 1 -- 172.21.15.42:0/2879576713 learned_addr learned my addr 172.21.15.42:0/2879576713 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.941+0000 7fa623fff640 1 --2- 172.21.15.42:0/2879576713 >> v2:172.21.15.107:3300/0 conn(0x7fa6240b64b0 0x7fa6240b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.941+0000 7fa6237fe640 1 --2- 172.21.15.42:0/2879576713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa624161c80 0x7fa62406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.941+0000 7fa622ffd640 1 -- 172.21.15.42:0/2879576713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa624161c80 msgr2=0x7fa62406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.941+0000 7fa622ffd640 1 --2- 172.21.15.42:0/2879576713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa624161c80 0x7fa62406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.941+0000 7fa622ffd640 1 -- 172.21.15.42:0/2879576713 >> v2:172.21.15.107:3300/0 conn(0x7fa6240b64b0 msgr2=0x7fa6240b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.941+0000 7fa622ffd640 1 --2- 172.21.15.42:0/2879576713 >> v2:172.21.15.107:3300/0 conn(0x7fa6240b64b0 0x7fa6240b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.941+0000 7fa622ffd640 1 -- 172.21.15.42:0/2879576713 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62406dfb0 con 0x7fa624162060 2024-09-16T01:54:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa622ffd640 1 --2- 172.21.15.42:0/2879576713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624162060 0x7fa6240b5f70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa6240687b0 tx=0x7fa61802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41db1b4128496df0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa6227fc640 1 -- 172.21.15.42:0/2879576713 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618037070 con 0x7fa624162060 2024-09-16T01:54:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa6227fc640 1 -- 172.21.15.42:0/2879576713 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa618032440 con 0x7fa624162060 2024-09-16T01:54:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa6227fc640 1 -- 172.21.15.42:0/2879576713 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618032810 con 0x7fa624162060 2024-09-16T01:54:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa629ae4640 1 -- 172.21.15.42:0/2879576713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624162060 msgr2=0x7fa6240b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa629ae4640 1 --2- 172.21.15.42:0/2879576713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624162060 0x7fa6240b5f70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa6240687b0 tx=0x7fa61802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa629ae4640 1 -- 172.21.15.42:0/2879576713 shutdown_connections 2024-09-16T01:54:48.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa629ae4640 1 --2- 172.21.15.42:0/2879576713 >> v2:172.21.15.107:3300/0 conn(0x7fa6240b64b0 0x7fa6240b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa629ae4640 1 --2- 172.21.15.42:0/2879576713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624162060 0x7fa6240b5f70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa629ae4640 1 --2- 172.21.15.42:0/2879576713 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa624161c80 0x7fa62406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa629ae4640 1 -- 172.21.15.42:0/2879576713 >> 172.21.15.42:0/2879576713 conn(0x7fa6240d44f0 msgr2=0x7fa6240d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:48.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa629ae4640 1 -- 172.21.15.42:0/2879576713 shutdown_connections 2024-09-16T01:54:48.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.942+0000 7fa629ae4640 1 -- 172.21.15.42:0/2879576713 wait complete. 2024-09-16T01:54:48.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.944+0000 7fa629ae4640 1 Processor -- start 2024-09-16T01:54:48.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.944+0000 7fa629ae4640 1 -- start start 2024-09-16T01:54:48.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.944+0000 7fa629ae4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6240b64b0 0x7fa62415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa629ae4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624161c80 0x7fa62415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa629ae4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa624162060 0x7fa6240cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa629ae4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa624162500 con 0x7fa624161c80 2024-09-16T01:54:48.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa629ae4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240d2aa0 con 0x7fa624162060 2024-09-16T01:54:48.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa629ae4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa624162680 con 0x7fa6240b64b0 2024-09-16T01:54:48.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624161c80 0x7fa62415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624161c80 0x7fa62415d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57444/0 (socket says 172.21.15.42:57444) 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa622ffd640 1 -- 172.21.15.42:0/665540215 learned_addr learned my addr 172.21.15.42:0/665540215 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa6237fe640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6240b64b0 0x7fa62415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa623fff640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa624162060 0x7fa6240cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa622ffd640 1 -- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6240b64b0 msgr2=0x7fa62415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa622ffd640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6240b64b0 0x7fa62415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa622ffd640 1 -- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa624162060 msgr2=0x7fa6240cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa622ffd640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa624162060 0x7fa6240cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa622ffd640 1 -- 172.21.15.42:0/665540215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62415df10 con 0x7fa624161c80 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa622ffd640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624161c80 0x7fa62415d6e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa618000c00 tx=0x7fa6180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa60bfff640 1 -- 172.21.15.42:0/665540215 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618041020 con 0x7fa624161c80 2024-09-16T01:54:48.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa60bfff640 1 -- 172.21.15.42:0/665540215 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61803d620 con 0x7fa624161c80 2024-09-16T01:54:48.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa629ae4640 1 -- 172.21.15.42:0/665540215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62415e1f0 con 0x7fa624161c80 2024-09-16T01:54:48.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa60bfff640 1 -- 172.21.15.42:0/665540215 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618037040 con 0x7fa624161c80 2024-09-16T01:54:48.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.945+0000 7fa629ae4640 1 -- 172.21.15.42:0/665540215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6240cc6b0 con 0x7fa624161c80 2024-09-16T01:54:48.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.947+0000 7fa60bfff640 1 -- 172.21.15.42:0/665540215 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa618044020 con 0x7fa624161c80 2024-09-16T01:54:48.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.948+0000 7fa60bfff640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa61006c2b0 0x7fa61006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.948+0000 7fa60bfff640 1 -- 172.21.15.42:0/665540215 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa6180abe20 con 0x7fa624161c80 2024-09-16T01:54:48.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.948+0000 7fa6237fe640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa61006c2b0 0x7fa61006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.948+0000 7fa6237fe640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa61006c2b0 0x7fa61006e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6140074a0 tx=0x7fa61400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.948+0000 7fa62c883740 1 Processor -- start 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.949+0000 7fa62c883740 1 -- start start 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.949+0000 7fa62c883740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88503a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.949+0000 7fa62c883740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884bba80 0x558a884be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.949+0000 7fa62c883740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 0x558a884b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.949+0000 7fa62c883740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558a88420520 con 0x558a884be2c0 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.949+0000 7fa62c883740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558a883c83e0 con 0x558a884bfa50 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.949+0000 7fa62c883740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x558a8841c4e0 con 0x558a884bba80 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.949+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88503a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88503a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57446/0 (socket says 172.21.15.42:57446) 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6237fe640 1 -- 172.21.15.42:0/3613964150 learned_addr learned my addr 172.21.15.42:0/3613964150 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:48.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa623fff640 1 --2- 172.21.15.42:0/3613964150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 0x558a884b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa622ffd640 1 --2- 172.21.15.42:0/3613964150 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884bba80 0x558a884be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6237fe640 1 -- 172.21.15.42:0/3613964150 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884bba80 msgr2=0x558a884be6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6237fe640 1 --2- 172.21.15.42:0/3613964150 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884bba80 0x558a884be6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6237fe640 1 -- 172.21.15.42:0/3613964150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 msgr2=0x558a884b88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6237fe640 1 --2- 172.21.15.42:0/3613964150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 0x558a884b88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6237fe640 1 -- 172.21.15.42:0/3613964150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a883e32f0 con 0x558a884be2c0 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa623fff640 1 --2- 172.21.15.42:0/3613964150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 0x558a884b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6237fe640 1 --2- 172.21.15.42:0/3613964150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88503a60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa614016860 tx=0x7fa614014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bc81c480e8cb03 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6097fa640 1 -- 172.21.15.42:0/3613964150 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61401d040 con 0x558a884be2c0 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6097fa640 1 -- 172.21.15.42:0/3613964150 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa614026070 con 0x558a884be2c0 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.950+0000 7fa6097fa640 1 -- 172.21.15.42:0/3613964150 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614017ba0 con 0x558a884be2c0 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.951+0000 7fa62c883740 1 -- 172.21.15.42:0/3613964150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 msgr2=0x558a88503a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.951+0000 7fa62c883740 1 --2- 172.21.15.42:0/3613964150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88503a60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa614016860 tx=0x7fa614014000 comp rx=0 tx=0).stop 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.951+0000 7fa62c883740 1 -- 172.21.15.42:0/3613964150 shutdown_connections 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.951+0000 7fa62c883740 1 --2- 172.21.15.42:0/3613964150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 0x558a884b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.951+0000 7fa62c883740 1 --2- 172.21.15.42:0/3613964150 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884bba80 0x558a884be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.951+0000 7fa62c883740 1 --2- 172.21.15.42:0/3613964150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88503a60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.951+0000 7fa62c883740 1 -- 172.21.15.42:0/3613964150 >> 172.21.15.42:0/3613964150 conn(0x558a884baa80 msgr2=0x558a88502f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.951+0000 7fa62c883740 1 -- 172.21.15.42:0/3613964150 shutdown_connections 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.951+0000 7fa62c883740 1 -- 172.21.15.42:0/3613964150 wait complete. 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.952+0000 7fa62c883740 1 -- start start 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.952+0000 7fa62c883740 1 Processor -- start 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.952+0000 7fa62c883740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884be2c0 0x558a884de5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.952+0000 7fa62c883740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 0x558a884ddc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.952+0000 7fa62c883740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a88513310 0x558a884e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.952+0000 7fa62c883740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558a884b9f20 con 0x558a88513310 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.952+0000 7fa62c883740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558a883a9450 con 0x558a884bfa50 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.952+0000 7fa62c883740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x558a88504290 con 0x558a884be2c0 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.952+0000 7fa62c883740 10 client.0 _ll_register_callbacks cb 0x558a88132ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.952+0000 7fa623fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a88513310 0x558a884e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa623fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a88513310 0x558a884e0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57462/0 (socket says 172.21.15.42:57462) 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa623fff640 1 -- 172.21.15.42:0/3115652498 learned_addr learned my addr 172.21.15.42:0/3115652498 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa6237fe640 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884be2c0 0x558a884de5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa622ffd640 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 0x558a884ddc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa623fff640 1 -- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884be2c0 msgr2=0x558a884de5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa623fff640 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884be2c0 0x558a884de5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa623fff640 1 -- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 msgr2=0x558a884ddc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa623fff640 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 0x558a884ddc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa623fff640 1 -- 172.21.15.42:0/3115652498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a881332d0 con 0x558a88513310 2024-09-16T01:54:48.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa623fff640 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a88513310 0x558a884e0e60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa61c014420 tx=0x7fa61c0148e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13c4e8797a1d340 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:48.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa6027fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-16T01:54:48.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa6027fc640 1 -- 172.21.15.42:0/3115652498 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c004440 con 0x558a88513310 2024-09-16T01:54:48.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa6027fc640 1 -- 172.21.15.42:0/3115652498 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa61c003610 con 0x558a88513310 2024-09-16T01:54:48.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa62c883740 1 -- 172.21.15.42:0/3115652498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa614026070 con 0x558a88513310 2024-09-16T01:54:48.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa6027fc640 1 -- 172.21.15.42:0/3115652498 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa61c026050 con 0x558a88513310 2024-09-16T01:54:48.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa62c883740 10 client.4668 fetch_fsmap learned FSMap version 8 2024-09-16T01:54:48.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa62c883740 1 -- 172.21.15.42:0/3115652498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x558a881fd6b0 con 0x558a88513310 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.953+0000 7fa6027fc640 1 -- 172.21.15.42:0/3115652498 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa614026070 con 0x558a88513310 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.954+0000 7fa6027fc640 1 -- 172.21.15.42:0/3115652498 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7fa61c003810 con 0x558a88513310 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.954+0000 7fa62c883740 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.954+0000 7fa62c883740 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.954+0000 7fa62c883740 20 client.4668 populate_metadata read hostname 'smithi042' 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.954+0000 7fa62c883740 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x558a88516ad0 0x558a884b8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.954+0000 7fa62c883740 4 client.4668 mds_command: new command op to 34157 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.954+0000 7fa62c883740 1 -- 172.21.15.42:0/3115652498 --> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a8842dc50 con 0x558a88516ad0 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.954+0000 7fa6237fe640 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x558a88516ad0 0x558a884b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.954+0000 7fa6237fe640 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x558a88516ad0 0x558a884b8590 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be2cca90649d4f88 server_cookie=4db60ca89f1b3884 in_seq=0 out_seq=0 2024-09-16T01:54:48.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.954+0000 7fa6027fc640 10 client.4668 ms_handle_connect on v2:172.21.15.107:6835/2229527903 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa6027fc640 1 -- 172.21.15.42:0/3115652498 <== mds.0 v2:172.21.15.107:6835/2229527903 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a8842dc50 con 0x558a88516ad0 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa6027fc640 10 client.4668 handle_command_reply: tid=0 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa62c883740 1 client.4668 shutdown 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa62c883740 1 -- 172.21.15.42:0/3115652498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a88513310 msgr2=0x558a884e0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa62c883740 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a88513310 0x558a884e0e60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa61c014420 tx=0x7fa61c0148e0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa62c883740 1 -- 172.21.15.42:0/3115652498 shutdown_connections 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa62c883740 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x558a88516ad0 0x558a884b8590 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa62c883740 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a88513310 0x558a884e0e60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa62c883740 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a884bfa50 0x558a884ddc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa6027fc640 0 client.4668 ms_handle_reset on v2:172.21.15.107:6835/2229527903 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa62c883740 1 --2- 172.21.15.42:0/3115652498 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884be2c0 0x558a884de5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa62c883740 1 -- 172.21.15.42:0/3115652498 >> 172.21.15.42:0/3115652498 conn(0x558a884bba80 msgr2=0x558a88502530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.955+0000 7fa62c883740 1 -- 172.21.15.42:0/3115652498 shutdown_connections 2024-09-16T01:54:48.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.956+0000 7fa62c883740 1 -- 172.21.15.42:0/3115652498 wait complete. 2024-09-16T01:54:48.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.956+0000 7fa62c883740 20 client.4668 trim_cache size 0 max 16384 2024-09-16T01:54:48.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.976+0000 7fa62c883740 1 Processor -- start 2024-09-16T01:54:48.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.976+0000 7fa62c883740 1 -- start start 2024-09-16T01:54:48.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa62c883740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884be2c0 0x558a88578380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa62c883740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884bfa50 0x558a88500ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa62c883740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 0x558a88501420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa62c883740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa6242020a0 con 0x558a884bfa50 2024-09-16T01:54:48.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa62c883740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa624201100 con 0x558a88513310 2024-09-16T01:54:48.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa62c883740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa624200490 con 0x558a884be2c0 2024-09-16T01:54:48.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884bfa50 0x558a88500ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884bfa50 0x558a88500ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57466/0 (socket says 172.21.15.42:57466) 2024-09-16T01:54:48.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa622ffd640 1 -- 172.21.15.42:0/2716503007 learned_addr learned my addr 172.21.15.42:0/2716503007 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:48.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa623fff640 1 --2- 172.21.15.42:0/2716503007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 0x558a88501420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa6237fe640 1 --2- 172.21.15.42:0/2716503007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884be2c0 0x558a88578380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa622ffd640 1 -- 172.21.15.42:0/2716503007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884be2c0 msgr2=0x558a88578380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa622ffd640 1 --2- 172.21.15.42:0/2716503007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884be2c0 0x558a88578380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa622ffd640 1 -- 172.21.15.42:0/2716503007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 msgr2=0x558a88501420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.977+0000 7fa622ffd640 1 --2- 172.21.15.42:0/2716503007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 0x558a88501420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.978+0000 7fa622ffd640 1 -- 172.21.15.42:0/2716503007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a884e11d0 con 0x558a884bfa50 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.978+0000 7fa623fff640 1 --2- 172.21.15.42:0/2716503007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 0x558a88501420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.978+0000 7fa622ffd640 1 --2- 172.21.15.42:0/2716503007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884bfa50 0x558a88500ee0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa618079ae0 tx=0x7fa61803f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dee7c0eb06cf049 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.978+0000 7fa608ff9640 1 -- 172.21.15.42:0/2716503007 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6180a8070 con 0x558a884bfa50 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.978+0000 7fa608ff9640 1 -- 172.21.15.42:0/2716503007 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61807df00 con 0x558a884bfa50 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.978+0000 7fa608ff9640 1 -- 172.21.15.42:0/2716503007 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618082730 con 0x558a884bfa50 2024-09-16T01:54:48.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.978+0000 7fa62c883740 1 -- 172.21.15.42:0/2716503007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884bfa50 msgr2=0x558a88500ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.978+0000 7fa62c883740 1 --2- 172.21.15.42:0/2716503007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884bfa50 0x558a88500ee0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa618079ae0 tx=0x7fa61803f040 comp rx=0 tx=0).stop 2024-09-16T01:54:48.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.979+0000 7fa62c883740 1 -- 172.21.15.42:0/2716503007 shutdown_connections 2024-09-16T01:54:48.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.979+0000 7fa62c883740 1 --2- 172.21.15.42:0/2716503007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 0x558a88501420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.979+0000 7fa62c883740 1 --2- 172.21.15.42:0/2716503007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884bfa50 0x558a88500ee0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.979+0000 7fa62c883740 1 --2- 172.21.15.42:0/2716503007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884be2c0 0x558a88578380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.979+0000 7fa62c883740 1 -- 172.21.15.42:0/2716503007 >> 172.21.15.42:0/2716503007 conn(0x558a884bba80 msgr2=0x558a885124a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:48.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.979+0000 7fa62c883740 1 -- 172.21.15.42:0/2716503007 shutdown_connections 2024-09-16T01:54:48.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.979+0000 7fa62c883740 1 -- 172.21.15.42:0/2716503007 wait complete. 2024-09-16T01:54:48.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.979+0000 7fa62c883740 1 -- start start 2024-09-16T01:54:48.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.979+0000 7fa62c883740 1 Processor -- start 2024-09-16T01:54:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa62c883740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88571bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa62c883740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884bfa50 0x558a8857ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa62c883740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 0x558a8857b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa62c883740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558a88516950 con 0x558a884be2c0 2024-09-16T01:54:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa62c883740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa624200ae0 con 0x558a88513310 2024-09-16T01:54:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa62c883740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x558a88516fa0 con 0x558a884bfa50 2024-09-16T01:54:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa62c883740 10 client.0 _ll_register_callbacks cb 0x7fa61c009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:54:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88571bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88571bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57482/0 (socket says 172.21.15.42:57482) 2024-09-16T01:54:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa6237fe640 1 -- 172.21.15.42:0/1199958781 learned_addr learned my addr 172.21.15.42:0/1199958781 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa622ffd640 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884bfa50 0x558a8857ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa623fff640 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 0x558a8857b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa6237fe640 1 -- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884bfa50 msgr2=0x558a8857ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa6237fe640 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884bfa50 0x558a8857ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa6237fe640 1 -- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 msgr2=0x558a8857b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:48.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.980+0000 7fa6237fe640 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 0x558a8857b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa6237fe640 1 -- 172.21.15.42:0/1199958781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a884e46d0 con 0x558a884be2c0 2024-09-16T01:54:48.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa6237fe640 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88571bb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa614022000 tx=0x7fa614004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e811aede219f3bd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:48.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa6027fc640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-16T01:54:48.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa6027fc640 1 -- 172.21.15.42:0/1199958781 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614017980 con 0x558a884be2c0 2024-09-16T01:54:48.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa6027fc640 1 -- 172.21.15.42:0/1199958781 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa614017b20 con 0x558a884be2c0 2024-09-16T01:54:48.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa62c883740 1 -- 172.21.15.42:0/1199958781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa61807df00 con 0x558a884be2c0 2024-09-16T01:54:48.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa6027fc640 1 -- 172.21.15.42:0/1199958781 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa614043050 con 0x558a884be2c0 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa62c883740 10 client.4674 fetch_fsmap learned FSMap version 8 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa62c883740 1 -- 172.21.15.42:0/1199958781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x558a884de580 con 0x558a884be2c0 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa6027fc640 1 -- 172.21.15.42:0/1199958781 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61807df00 con 0x558a884be2c0 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa6027fc640 1 -- 172.21.15.42:0/1199958781 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7fa614046020 con 0x558a884be2c0 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa62c883740 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa62c883740 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa62c883740 20 client.4674 populate_metadata read hostname 'smithi042' 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa62c883740 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x558a88579720 0x558a88581850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa62c883740 4 client.4674 mds_command: new command op to 34157 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.981+0000 7fa62c883740 1 -- 172.21.15.42:0/1199958781 --> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] -- command(tid 0: {"prefix": "status"}) -- 0x558a88427fa0 con 0x558a88579720 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa622ffd640 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x558a88579720 0x558a88581850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa6027fc640 10 client.4674 ms_handle_connect on v2:172.21.15.107:6835/2229527903 2024-09-16T01:54:48.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa622ffd640 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x558a88579720 0x558a88581850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90ee9a21fdda5409 server_cookie=e86cd735e19a9828 in_seq=0 out_seq=0 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa6027fc640 1 -- 172.21.15.42:0/1199958781 <== mds.0 v2:172.21.15.107:6835/2229527903 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558a88427fa0 con 0x558a88579720 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa6027fc640 10 client.4674 handle_command_reply: tid=0 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 client.4674 shutdown 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 -- 172.21.15.42:0/1199958781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 msgr2=0x558a88571bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88571bb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa614022000 tx=0x7fa614004a40 comp rx=0 tx=0).stop 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 -- 172.21.15.42:0/1199958781 shutdown_connections 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:6835/2229527903,v1:172.21.15.107:6837/2229527903] conn(0x558a88579720 0x558a88581850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a88513310 0x558a8857b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x558a884bfa50 0x558a8857ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa6027fc640 0 client.4674 ms_handle_reset on v2:172.21.15.107:6835/2229527903 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 --2- 172.21.15.42:0/1199958781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a884be2c0 0x558a88571bb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 -- 172.21.15.42:0/1199958781 >> 172.21.15.42:0/1199958781 conn(0x558a884bba80 msgr2=0x558a884fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 -- 172.21.15.42:0/1199958781 shutdown_connections 2024-09-16T01:54:48.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.982+0000 7fa62c883740 1 -- 172.21.15.42:0/1199958781 wait complete. 2024-09-16T01:54:48.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa62c883740 20 client.4674 trim_cache size 0 max 16384 2024-09-16T01:54:48.996 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:54:48.996 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "356ce71f-2ad9-4fe3-af21-266c510b09c8", 2024-09-16T01:54:48.996 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-16T01:54:48.996 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 34157, 2024-09-16T01:54:48.996 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-16T01:54:48.996 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-16T01:54:48.996 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-16T01:54:48.996 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 27.144514787999999, 2024-09-16T01:54:48.997 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 8, 2024-09-16T01:54:48.997 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 25, 2024-09-16T01:54:48.997 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 25, 2024-09-16T01:54:48.997 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 33.155447367000001 2024-09-16T01:54:48.997 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:54:49.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 -- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa61006c2b0 msgr2=0x7fa61006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:49.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa61006c2b0 0x7fa61006e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6140074a0 tx=0x7fa61400b040 comp rx=0 tx=0).stop 2024-09-16T01:54:49.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 -- 172.21.15.42:0/665540215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624161c80 msgr2=0x7fa62415d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:49.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624161c80 0x7fa62415d6e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa618000c00 tx=0x7fa6180046c0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 -- 172.21.15.42:0/665540215 shutdown_connections 2024-09-16T01:54:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa61006c2b0 0x7fa61006e770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa624162060 0x7fa6240cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa624161c80 0x7fa62415d6e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 --2- 172.21.15.42:0/665540215 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa6240b64b0 0x7fa62415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 -- 172.21.15.42:0/665540215 >> 172.21.15.42:0/665540215 conn(0x7fa6240d44f0 msgr2=0x7fa6240b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 -- 172.21.15.42:0/665540215 shutdown_connections 2024-09-16T01:54:49.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:48.983+0000 7fa629ae4640 1 -- 172.21.15.42:0/665540215 wait complete. 2024-09-16T01:54:49.002 INFO:teuthology.run_tasks:Running task sequential... 2024-09-16T01:54:49.012 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-16T01:54:49.012 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-16T01:54:49.012 INFO:teuthology.task.print:Enabling mgr modules 2024-09-16T01:54:49.012 INFO:teuthology.run_tasks:Running task kclient... 2024-09-16T01:54:49.034 INFO:tasks.kclient:Mounting kernel clients... 2024-09-16T01:54:49.035 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-16T01:54:49.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:49.035 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-16T01:54:49.052 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-16T01:54:49.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:49.053 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:54:49.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:49.119 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-09-16T01:54:49.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:49.226 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-16T01:54:49.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:49.242 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-09-16T01:54:49.310 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-09-16T01:54:49.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:54:49.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:49.312 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-16T01:54:49.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:49.332 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-16T01:54:49.403 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-09-16T01:54:49.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:54:49.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:49.406 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-16T01:54:49.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:49.464 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-16T01:54:49.534 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-09-16T01:54:49.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:54:49.535 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-16T01:54:49.536 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:54:49.536 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:54:49.536 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:54:49.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.637+0000 7f0143477640 1 Processor -- start 2024-09-16T01:54:49.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.637+0000 7f0143477640 1 -- start start 2024-09-16T01:54:49.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0143477640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f013c072de0 0x7f013c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:49.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0143477640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013c146140 con 0x7f013c072320 2024-09-16T01:54:49.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0143477640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013c0cd740 con 0x7f013c072700 2024-09-16T01:54:49.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0143477640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f013c0cda20 con 0x7f013c072de0 2024-09-16T01:54:49.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0141213640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f013c072320 0x7f013c0cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36486/0 (socket says 172.21.15.42:36486) 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0141213640 1 -- 172.21.15.42:0/1048012331 learned_addr learned my addr 172.21.15.42:0/1048012331 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1234092819 0 0) 0x7f013c146140 con 0x7f013c072320 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0140a12640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f013c072de0 0x7f013c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0128003520 con 0x7f013c072320 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1780380085 0 0) 0x7f0128003520 con 0x7f013c072320 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f013c072de0 msgr2=0x7f013c15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0133fff640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f013c072de0 0x7f013c15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 >> v1:172.21.15.107:6789/0 conn(0x7f013c072700 legacy=0x7f013c15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c0cdd00 con 0x7f013c072320 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.638+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f01380019f0 con 0x7f013c072320 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 >> v1:172.21.15.42:6789/0 conn(0x7f013c072320 legacy=0x7f013c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0133fff640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01280039e0 0x7f0128003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:49.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0133fff640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0128004800 0x7f0128004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0133fff640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f013c072de0 0x7f0128005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f013c0cda20 con 0x7f01280039e0 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f012800bb20 con 0x7f0128004800 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f012800bd20 con 0x7f013c072de0 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0141213640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01280039e0 0x7f0128003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0140a12640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0128004800 0x7f0128004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0141a14640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f013c072de0 0x7f0128005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0141213640 1 -- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f013c072de0 msgr2=0x7f0128005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0141213640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f013c072de0 0x7f0128005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0141213640 1 -- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0128004800 msgr2=0x7f0128004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0141213640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0128004800 0x7f0128004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.639+0000 7f0141213640 1 -- 172.21.15.42:0/1048012331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0128003520 con 0x7f01280039e0 2024-09-16T01:54:49.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.640+0000 7f0141213640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01280039e0 0x7f0128003e00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f013800a840 tx=0x7f0128005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5bfa2c039c9c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:49.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.640+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013800a460 con 0x7f01280039e0 2024-09-16T01:54:49.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.640+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013802f070 con 0x7f01280039e0 2024-09-16T01:54:49.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.640+0000 7f0133fff640 1 -- 172.21.15.42:0/1048012331 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013802bcb0 con 0x7f01280039e0 2024-09-16T01:54:49.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.640+0000 7f0143477640 1 -- 172.21.15.42:0/1048012331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01280039e0 msgr2=0x7f0128003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:49.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.640+0000 7f0143477640 1 --2- 172.21.15.42:0/1048012331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01280039e0 0x7f0128003e00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f013800a840 tx=0x7f0128005830 comp rx=0 tx=0).stop 2024-09-16T01:54:49.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.640+0000 7f0141a14640 1 -- 172.21.15.42:0/1048012331 reap_dead start 2024-09-16T01:54:49.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.640+0000 7f0143477640 1 -- 172.21.15.42:0/1048012331 shutdown_connections 2024-09-16T01:54:49.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.640+0000 7f0143477640 1 -- 172.21.15.42:0/1048012331 >> 172.21.15.42:0/1048012331 conn(0x7f013c067d70 msgr2=0x7f013c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:49.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.641+0000 7f0143477640 1 -- 172.21.15.42:0/1048012331 shutdown_connections 2024-09-16T01:54:49.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.641+0000 7f0143477640 1 -- 172.21.15.42:0/1048012331 wait complete. 2024-09-16T01:54:49.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.642+0000 7f0143477640 1 Processor -- start 2024-09-16T01:54:49.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.642+0000 7f0143477640 1 -- start start 2024-09-16T01:54:49.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0143477640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01280039e0 0x7f013c1f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:49.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0143477640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f013c142030 0x7f013c1425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:49.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0143477640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c13e400 0x7f013c13e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:49.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0143477640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f013c15d360 con 0x7f013c142030 2024-09-16T01:54:49.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0143477640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f013c15d1e0 con 0x7f013c13e400 2024-09-16T01:54:49.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0143477640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f013c15d4e0 con 0x7f01280039e0 2024-09-16T01:54:49.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0140a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f013c142030 0x7f013c1425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:49.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0140a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f013c142030 0x7f013c1425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57500/0 (socket says 172.21.15.42:57500) 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0140a12640 1 -- 172.21.15.42:0/3689300176 learned_addr learned my addr 172.21.15.42:0/3689300176 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0141213640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01280039e0 0x7f013c1f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0141a14640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c13e400 0x7f013c13e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0140a12640 1 -- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01280039e0 msgr2=0x7f013c1f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0140a12640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01280039e0 0x7f013c1f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0140a12640 1 -- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c13e400 msgr2=0x7f013c13e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0140a12640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c13e400 0x7f013c13e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0140a12640 1 -- 172.21.15.42:0/3689300176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c144ca0 con 0x7f013c142030 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0140a12640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f013c142030 0x7f013c1425b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f012c0119a0 tx=0x7f012c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0131ffb640 1 -- 172.21.15.42:0/3689300176 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c00faf0 con 0x7f013c142030 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0131ffb640 1 -- 172.21.15.42:0/3689300176 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c00fc90 con 0x7f013c142030 2024-09-16T01:54:49.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0143477640 1 -- 172.21.15.42:0/3689300176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013c145220 con 0x7f013c142030 2024-09-16T01:54:49.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.643+0000 7f0131ffb640 1 -- 172.21.15.42:0/3689300176 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c014440 con 0x7f013c142030 2024-09-16T01:54:49.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.644+0000 7f0143477640 1 -- 172.21.15.42:0/3689300176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013c13f740 con 0x7f013c142030 2024-09-16T01:54:49.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.644+0000 7f0143477640 1 -- 172.21.15.42:0/3689300176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013c0cce60 con 0x7f013c142030 2024-09-16T01:54:49.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.645+0000 7f0131ffb640 1 -- 172.21.15.42:0/3689300176 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f012c012040 con 0x7f013c142030 2024-09-16T01:54:49.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.645+0000 7f0131ffb640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f012006c2b0 0x7f012006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:49.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.645+0000 7f0131ffb640 1 -- 172.21.15.42:0/3689300176 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f012c08bc00 con 0x7f013c142030 2024-09-16T01:54:49.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.646+0000 7f0141213640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f012006c2b0 0x7f012006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:49.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.646+0000 7f0141213640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f012006c2b0 0x7f012006e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0138033000 tx=0x7f0138007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:49.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.650+0000 7f0131ffb640 1 -- 172.21.15.42:0/3689300176 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f012c092080 con 0x7f013c142030 2024-09-16T01:54:49.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.859+0000 7f0143477640 1 -- 172.21.15.42:0/3689300176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f013c1e4020 con 0x7f013c142030 2024-09-16T01:54:49.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.860+0000 7f0131ffb640 1 -- 172.21.15.42:0/3689300176 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f012c019030 con 0x7f013c142030 2024-09-16T01:54:49.862 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:54:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.861+0000 7f0143477640 1 -- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f012006c2b0 msgr2=0x7f012006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.861+0000 7f0143477640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f012006c2b0 0x7f012006e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0138033000 tx=0x7f0138007000 comp rx=0 tx=0).stop 2024-09-16T01:54:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.861+0000 7f0143477640 1 -- 172.21.15.42:0/3689300176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f013c142030 msgr2=0x7f013c1425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.861+0000 7f0143477640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f013c142030 0x7f013c1425b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f012c0119a0 tx=0x7f012c011e60 comp rx=0 tx=0).stop 2024-09-16T01:54:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.862+0000 7f0143477640 1 -- 172.21.15.42:0/3689300176 shutdown_connections 2024-09-16T01:54:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.862+0000 7f0143477640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f012006c2b0 0x7f012006e770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.862+0000 7f0143477640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f013c13e400 0x7f013c13e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.862+0000 7f0143477640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f013c142030 0x7f013c1425b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.862+0000 7f0143477640 1 --2- 172.21.15.42:0/3689300176 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f01280039e0 0x7f013c1f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.862+0000 7f0143477640 1 -- 172.21.15.42:0/3689300176 >> 172.21.15.42:0/3689300176 conn(0x7f013c067d70 msgr2=0x7f013c0c7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.862+0000 7f0143477640 1 -- 172.21.15.42:0/3689300176 shutdown_connections 2024-09-16T01:54:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49.862+0000 7f0143477640 1 -- 172.21.15.42:0/3689300176 wait complete. 2024-09-16T01:54:49.875 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:54:49.875 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:54:49.875 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-16T01:54:49.875 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:54:49.875 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:54:49.875 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:54:49.875 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:54:49.875 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:54:49.876 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:54:49.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:49.876 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-16T01:54:49.892 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:54:49.892 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:54:49.892 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:54:49.892 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:49.892 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42765sec preferred_lft 42765sec 2024-09-16T01:54:49.893 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-16T01:54:49.894 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:49.894 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:49.894 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:49.894 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-16T01:54:49.894 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T01:54:49.894 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:49.894 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:49.894 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2024-09-16T01:54:49.894 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2024-09-16T01:54:49.894 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2024-09-16T01:54:49.895 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T01:54:49.895 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:49.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:50.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:50.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:50.035 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:54:50.061 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-16T01:54:50.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:50.062 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-16T01:54:50.119 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-16T01:54:50.119 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:54:50.119 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-16T01:54:50.119 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-16T01:54:50.120 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:54:50.120 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:50.120 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:50.120 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-16T01:54:50.120 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-16T01:54:50.120 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-16T01:54:50.120 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:50.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:50.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:50.249 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-16T01:54:50.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:50.265 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-09-16T01:54:50.321 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:50.321 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:50.321 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:54:50.321 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-16T01:54:50.321 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:50.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:50.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:50.439 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-16T01:54:50.440 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:50.440 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:50.440 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-16T01:54:50.440 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T01:54:50.440 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-16T01:54:50.440 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-16T01:54:50.440 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-16T01:54:50.440 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:50.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:50.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:50.558 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:50.558 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:50.558 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-16T01:54:50.558 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T01:54:50.558 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:50.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:50.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:50.636 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:54:50.637 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:54:50.652 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:54:50.653 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:54:50.653 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:54:50.709 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:54:50.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:50.709 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:54:50.794 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:54:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:54:50.795 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:54:50.917 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:54:50.917 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:54:50.917 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:54:50.917 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:54:50.917 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:54:50.935 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:54:50.935 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:54:50.935 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:54:50.935 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:54:50.935 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:54:50.935 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-16T01:54:50.936 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-16T01:54:50.936 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=356ce71f-2ad9-4fe3-af21-266c510b09c8" will pass to kernel 2024-09-16T01:54:50.936 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:54:50.936 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:54:50.936 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:54:50.936 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:54:50.936 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:54:50.937 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:54:50.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:50.938 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:54:50.964 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:51.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:51.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:51.061 INFO:teuthology.orchestra.run.smithi042.stdout:client4683 2024-09-16T01:54:51.062 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:54:51.062 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:54:51.079 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:51.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:51.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:51.177 INFO:teuthology.orchestra.run.smithi042.stdout:client4683 2024-09-16T01:54:51.177 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:51.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:51.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:51.234 INFO:teuthology.orchestra.run.smithi042.stdout:client4683 2024-09-16T01:54:51.235 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/356ce71f-2ad9-4fe3-af21-266c510b09c8.client4683/status') 2024-09-16T01:54:51.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:51.294 INFO:teuthology.orchestra.run.smithi042.stdout:instance: client.4683 (3)192.168.0.1:0/3727796939 2024-09-16T01:54:51.295 INFO:teuthology.orchestra.run.smithi042.stdout:blocklisted: false 2024-09-16T01:54:51.295 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records in 2024-09-16T01:54:51.295 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records out 2024-09-16T01:54:51.295 INFO:teuthology.orchestra.run.smithi042.stderr:69 bytes copied, 2.4557e-05 s, 2.8 MB/s 2024-09-16T01:54:51.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:51.302 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-16T01:54:51.302 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:54:51.302 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-16T01:54:51.302 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:54:51.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.402+0000 7f42bf0c9640 1 Processor -- start 2024-09-16T01:54:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.402+0000 7f42bf0c9640 1 -- start start 2024-09-16T01:54:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42bf0c9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f42b8162060 0x7f42b80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42bf0c9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b80b64b0 0x7f42b80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42bf0c9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b806d9f0 con 0x7f42b8161c80 2024-09-16T01:54:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42bf0c9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f42b806dcd0 con 0x7f42b8162060 2024-09-16T01:54:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42bf0c9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42b806dfb0 con 0x7f42b80b64b0 2024-09-16T01:54:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42bd666640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b80b64b0 0x7f42b80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42b7fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f42b8162060 0x7f42b80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42b7fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f42b8162060 0x7f42b80b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:46898/0 (socket says 172.21.15.42:46898) 2024-09-16T01:54:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42b7fff640 1 -- 172.21.15.42:0/433050532 learned_addr learned my addr 172.21.15.42:0/433050532 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42bd666640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b80b64b0 0x7f42b80b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:49470/0 (socket says 172.21.15.42:49470) 2024-09-16T01:54:51.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.403+0000 7f42bce65640 1 --1- 172.21.15.42:0/433050532 >> v1:172.21.15.107:6789/0 conn(0x7f42b8161c80 0x7f42b806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:47618/0 (socket says 172.21.15.42:47618) 2024-09-16T01:54:51.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.404+0000 7f42b7fff640 1 -- 172.21.15.42:0/433050532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b80b64b0 msgr2=0x7f42b80b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:51.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.404+0000 7f42b7fff640 1 --2- 172.21.15.42:0/433050532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b80b64b0 0x7f42b80b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:51.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.404+0000 7f42b7fff640 1 -- 172.21.15.42:0/433050532 >> v1:172.21.15.107:6789/0 conn(0x7f42b8161c80 legacy=0x7f42b806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:51.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.404+0000 7f42b7fff640 1 -- 172.21.15.42:0/433050532 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b80d01f0 con 0x7f42b8162060 2024-09-16T01:54:51.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.404+0000 7f42b77fe640 1 -- 172.21.15.42:0/433050532 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733026991 0 0) 0x7f42b806d9f0 con 0x7f42b8161c80 2024-09-16T01:54:51.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.404+0000 7f42bd666640 1 --2- 172.21.15.42:0/433050532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b80b64b0 0x7f42b80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:51.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.404+0000 7f42b7fff640 1 --2- 172.21.15.42:0/433050532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42b8162060 0x7f42b80b5f70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009870 tx=0x7f42a402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6c2fc43db76a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:51.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.404+0000 7f42b77fe640 1 -- 172.21.15.42:0/433050532 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4037070 con 0x7f42b8162060 2024-09-16T01:54:51.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.405+0000 7f42b77fe640 1 -- 172.21.15.42:0/433050532 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a4032440 con 0x7f42b8162060 2024-09-16T01:54:51.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.405+0000 7f42b77fe640 1 -- 172.21.15.42:0/433050532 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4032810 con 0x7f42b8162060 2024-09-16T01:54:51.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.405+0000 7f42bf0c9640 1 -- 172.21.15.42:0/433050532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42b8162060 msgr2=0x7f42b80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:51.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.405+0000 7f42bf0c9640 1 --2- 172.21.15.42:0/433050532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42b8162060 0x7f42b80b5f70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009870 tx=0x7f42a402a270 comp rx=0 tx=0).stop 2024-09-16T01:54:51.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.405+0000 7f42bf0c9640 1 -- 172.21.15.42:0/433050532 shutdown_connections 2024-09-16T01:54:51.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.405+0000 7f42bf0c9640 1 --2- 172.21.15.42:0/433050532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b80b64b0 0x7f42b80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:51.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.405+0000 7f42bf0c9640 1 --2- 172.21.15.42:0/433050532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42b8162060 0x7f42b80b5f70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:51.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.405+0000 7f42bf0c9640 1 -- 172.21.15.42:0/433050532 >> 172.21.15.42:0/433050532 conn(0x7f42b80d44f0 msgr2=0x7f42b80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:51.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.405+0000 7f42bf0c9640 1 -- 172.21.15.42:0/433050532 shutdown_connections 2024-09-16T01:54:51.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.405+0000 7f42bf0c9640 1 -- 172.21.15.42:0/433050532 wait complete. 2024-09-16T01:54:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.406+0000 7f42bf0c9640 1 Processor -- start 2024-09-16T01:54:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.406+0000 7f42bf0c9640 1 -- start start 2024-09-16T01:54:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.407+0000 7f42bf0c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42b80b64b0 0x7f42b81f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.407+0000 7f42bf0c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42b8161c80 0x7f42b81599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.407+0000 7f42bf0c9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b8162060 0x7f42b80b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.407+0000 7f42bf0c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f42b80cf360 con 0x7f42b80b64b0 2024-09-16T01:54:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.407+0000 7f42bf0c9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42b80cf1e0 con 0x7f42b8161c80 2024-09-16T01:54:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.407+0000 7f42bf0c9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42b80cf4e0 con 0x7f42b8162060 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.407+0000 7f42bce65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42b80b64b0 0x7f42b81f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bce65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42b80b64b0 0x7f42b81f44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57516/0 (socket says 172.21.15.42:57516) 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bce65640 1 -- 172.21.15.42:0/3107262825 learned_addr learned my addr 172.21.15.42:0/3107262825 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42b7fff640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42b8161c80 0x7f42b81599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bd666640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b8162060 0x7f42b80b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bce65640 1 -- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b8162060 msgr2=0x7f42b80b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bce65640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b8162060 0x7f42b80b8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bce65640 1 -- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42b8161c80 msgr2=0x7f42b81599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bce65640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42b8161c80 0x7f42b81599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bce65640 1 -- 172.21.15.42:0/3107262825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b80b7550 con 0x7f42b80b64b0 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42b7fff640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42b8161c80 0x7f42b81599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bce65640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42b80b64b0 0x7f42b81f44e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00c4d0 tx=0x7f42ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:51.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42b57fa640 1 -- 172.21.15.42:0/3107262825 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0074e0 con 0x7f42b80b64b0 2024-09-16T01:54:51.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42b57fa640 1 -- 172.21.15.42:0/3107262825 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac0047e0 con 0x7f42b80b64b0 2024-09-16T01:54:51.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bf0c9640 1 -- 172.21.15.42:0/3107262825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b80b7830 con 0x7f42b80b64b0 2024-09-16T01:54:51.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42b57fa640 1 -- 172.21.15.42:0/3107262825 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac004bd0 con 0x7f42b80b64b0 2024-09-16T01:54:51.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.408+0000 7f42bf0c9640 1 -- 172.21.15.42:0/3107262825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b80b7df0 con 0x7f42b80b64b0 2024-09-16T01:54:51.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.409+0000 7f42bf0c9640 1 -- 172.21.15.42:0/3107262825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b80b8120 con 0x7f42b80b64b0 2024-09-16T01:54:51.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.410+0000 7f42b57fa640 1 -- 172.21.15.42:0/3107262825 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f42ac011070 con 0x7f42b80b64b0 2024-09-16T01:54:51.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.410+0000 7f42b57fa640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f429c06c2b0 0x7f429c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:51.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.410+0000 7f42b57fa640 1 -- 172.21.15.42:0/3107262825 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f42ac08b2c0 con 0x7f42b80b64b0 2024-09-16T01:54:51.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.410+0000 7f42b7fff640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f429c06c2b0 0x7f429c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:51.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.411+0000 7f42b7fff640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f429c06c2b0 0x7f429c06e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f42a4034000 tx=0x7f42a402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:51.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.414+0000 7f42b57fa640 1 -- 172.21.15.42:0/3107262825 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42ac059780 con 0x7f42b80b64b0 2024-09-16T01:54:51.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.623+0000 7f42bf0c9640 1 -- 172.21.15.42:0/3107262825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f42b80b5f70 con 0x7f42b80b64b0 2024-09-16T01:54:51.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.624+0000 7f42b57fa640 1 -- 172.21.15.42:0/3107262825 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f42ac059080 con 0x7f42b80b64b0 2024-09-16T01:54:51.629 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:54:51.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 -- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f429c06c2b0 msgr2=0x7f429c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f429c06c2b0 0x7f429c06e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f42a4034000 tx=0x7f42a402e000 comp rx=0 tx=0).stop 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 -- 172.21.15.42:0/3107262825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42b80b64b0 msgr2=0x7f42b81f44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42b80b64b0 0x7f42b81f44e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00c4d0 tx=0x7f42ac00c8d0 comp rx=0 tx=0).stop 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 -- 172.21.15.42:0/3107262825 shutdown_connections 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f429c06c2b0 0x7f429c06e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42b8162060 0x7f42b80b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42b8161c80 0x7f42b81599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 --2- 172.21.15.42:0/3107262825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42b80b64b0 0x7f42b81f44e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 -- 172.21.15.42:0/3107262825 >> 172.21.15.42:0/3107262825 conn(0x7f42b80d44f0 msgr2=0x7f42b80cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 -- 172.21.15.42:0/3107262825 shutdown_connections 2024-09-16T01:54:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51.626+0000 7f42bf0c9640 1 -- 172.21.15.42:0/3107262825 wait complete. 2024-09-16T01:54:51.639 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:54:51.639 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:54:51.639 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-16T01:54:51.639 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-16T01:54:51.639 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-16T01:54:51.639 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:54:51.639 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:54:51.639 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:54:51.639 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-16T01:54:51.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:51.640 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-16T01:54:51.657 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:54:51.657 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:54:51.657 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:54:51.657 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:51.657 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-16T01:54:51.657 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:51.657 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:51.657 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42763sec preferred_lft 42763sec 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:51.658 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 5e:ba:0a:2b:0d:4d brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::9414:18ff:fe6a:9503/64 scope link 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 5e:ba:0a:2b:0d:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::5cba:aff:fe2b:d4d/64 scope link tentative 2024-09-16T01:54:51.659 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:51.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:51.660 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:54:51.722 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-16T01:54:51.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:51.723 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-16T01:54:51.780 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-16T01:54:51.780 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:54:51.780 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-16T01:54:51.780 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-16T01:54:51.780 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:54:51.781 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:51.781 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:51.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-16T01:54:51.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-16T01:54:51.782 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-16T01:54:51.782 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:51.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:51.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:51.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:51.911 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-16T01:54:51.926 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:54:51.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:51.927 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-09-16T01:54:51.983 INFO:teuthology.orchestra.run.smithi042.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-16T01:54:51.983 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:51.983 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:51.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:54:51.984 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-16T01:54:51.984 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:52.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:52.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:52.203 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-16T01:54:52.229 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:54:52.229 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:54:52.229 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:54:52.229 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-16T01:54:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:52.230 INFO:teuthology.orchestra.run.smithi042.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:54:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 1e:81:af:2a:b5:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T01:54:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T01:54:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::1c81:afff:fe2a:b56d/64 scope link tentative 2024-09-16T01:54:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:52.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:52.231 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-16T01:54:52.296 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 1e:81:af:2a:b5:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::1c81:afff:fe2a:b56d/64 scope link tentative 2024-09-16T01:54:52.297 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:52.298 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-16T01:54:52.299 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:52.299 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:52.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-16T01:54:52.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-16T01:54:52.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-16T01:54:52.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-16T01:54:52.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-16T01:54:52.299 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:52.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:52.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:52.455 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:52.456 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:54:52.456 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.1 up 2024-09-16T01:54:52.456 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.1 master ceph-brx 2024-09-16T01:54:52.456 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:54:52.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:52.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:52.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:54:52.537 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-16T01:54:52.562 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-16T01:54:52.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:54:52.563 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-16T01:54:52.618 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:54:52.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:52.618 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T01:54:52.704 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T01:54:52.704 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T01:54:52.704 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:54:52.713 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T01:54:52.713 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T01:54:52.713 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:54:52.713 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:54:52.713 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:54:52.723 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T01:54:52.723 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T01:54:52.723 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:54:52.723 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:54:52.723 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:54:52.723 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-16T01:54:52.723 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-16T01:54:52.724 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=356ce71f-2ad9-4fe3-af21-266c510b09c8" will pass to kernel 2024-09-16T01:54:52.724 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-16T01:54:52.724 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:54:52.724 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:54:52.724 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:54:52.724 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:54:52.725 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:54:52.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:52.726 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-16T01:54:52.752 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:52.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:52.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:52.853 INFO:teuthology.orchestra.run.smithi042.stdout:client4689 2024-09-16T01:54:52.854 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:54:52.854 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:54:52.871 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:52.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:52.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:52.968 INFO:teuthology.orchestra.run.smithi042.stdout:client4689 2024-09-16T01:54:52.969 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:53.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:53.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:53.026 INFO:teuthology.orchestra.run.smithi042.stdout:client4689 2024-09-16T01:54:53.026 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/356ce71f-2ad9-4fe3-af21-266c510b09c8.client4689/status') 2024-09-16T01:54:53.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:53.086 INFO:teuthology.orchestra.run.smithi042.stdout:instance: client.4689 (3)192.168.0.2:0/11287875 2024-09-16T01:54:53.087 INFO:teuthology.orchestra.run.smithi042.stdout:blocklisted: false 2024-09-16T01:54:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records in 2024-09-16T01:54:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records out 2024-09-16T01:54:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:67 bytes copied, 2.2716e-05 s, 2.9 MB/s 2024-09-16T01:54:53.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:53.094 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-16T01:54:53.094 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:54:53.094 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:54:53.094 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:54:53.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.194+0000 7f764875b640 1 Processor -- start 2024-09-16T01:54:53.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.194+0000 7f764875b640 1 -- start start 2024-09-16T01:54:53.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f764875b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f764015e740 0x7f76400d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:53.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f764875b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f764006dbd0 0x7f764006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:53.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f764875b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76400d0780 con 0x7f764009b690 2024-09-16T01:54:53.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f764875b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f764015eb20 con 0x7f764015e740 2024-09-16T01:54:53.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f764875b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f764006d260 con 0x7f764006dbd0 2024-09-16T01:54:53.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f76464f7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f764015e740 0x7f76400d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:53.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f76464f7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f764015e740 0x7f76400d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57526/0 (socket says 172.21.15.42:57526) 2024-09-16T01:54:53.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f76464f7640 1 -- 172.21.15.42:0/56476574 learned_addr learned my addr 172.21.15.42:0/56476574 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:53.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f76464f7640 1 -- 172.21.15.42:0/56476574 >> v2:172.21.15.107:3300/0 conn(0x7f764006dbd0 msgr2=0x7f764006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:53.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f76464f7640 1 --2- 172.21.15.42:0/56476574 >> v2:172.21.15.107:3300/0 conn(0x7f764006dbd0 0x7f764006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:53.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f76464f7640 1 -- 172.21.15.42:0/56476574 >> v1:172.21.15.107:6789/0 conn(0x7f764009b690 legacy=0x7f764006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:53.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.195+0000 7f76464f7640 1 -- 172.21.15.42:0/56476574 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76400d0a60 con 0x7f764015e740 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.196+0000 7f76464f7640 1 --2- 172.21.15.42:0/56476574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764015e740 0x7f76400d1540 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f764006cba0 tx=0x7f763002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621d1987c07b648d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.196+0000 7f76454f5640 1 -- 172.21.15.42:0/56476574 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630036070 con 0x7f764015e740 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.196+0000 7f76454f5640 1 -- 172.21.15.42:0/56476574 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7630031600 con 0x7f764015e740 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.196+0000 7f76454f5640 1 -- 172.21.15.42:0/56476574 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76300319d0 con 0x7f764015e740 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.197+0000 7f764875b640 1 -- 172.21.15.42:0/56476574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764015e740 msgr2=0x7f76400d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.197+0000 7f764875b640 1 --2- 172.21.15.42:0/56476574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764015e740 0x7f76400d1540 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f764006cba0 tx=0x7f763002a780 comp rx=0 tx=0).stop 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.197+0000 7f764875b640 1 -- 172.21.15.42:0/56476574 shutdown_connections 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.197+0000 7f764875b640 1 --2- 172.21.15.42:0/56476574 >> v2:172.21.15.107:3300/0 conn(0x7f764006dbd0 0x7f764006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.197+0000 7f764875b640 1 --2- 172.21.15.42:0/56476574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764015e740 0x7f76400d1540 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.197+0000 7f764875b640 1 -- 172.21.15.42:0/56476574 >> 172.21.15.42:0/56476574 conn(0x7f76400d23a0 msgr2=0x7f76400d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:53.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.197+0000 7f764875b640 1 -- 172.21.15.42:0/56476574 shutdown_connections 2024-09-16T01:54:53.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.197+0000 7f764875b640 1 -- 172.21.15.42:0/56476574 wait complete. 2024-09-16T01:54:53.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.198+0000 7f764875b640 1 Processor -- start 2024-09-16T01:54:53.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.198+0000 7f764875b640 1 -- start start 2024-09-16T01:54:53.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f764875b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764006dbd0 0x7f76400b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:53.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f764875b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f764009b690 0x7f76400b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f764875b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764015e740 0x7f76400caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f764875b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f764009bac0 con 0x7f764006dbd0 2024-09-16T01:54:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f764875b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f76400d1020 con 0x7f764009b690 2024-09-16T01:54:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f764875b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f764006dfe0 con 0x7f764015e740 2024-09-16T01:54:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f76464f7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764006dbd0 0x7f76400b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f76464f7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764006dbd0 0x7f76400b7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57528/0 (socket says 172.21.15.42:57528) 2024-09-16T01:54:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f76464f7640 1 -- 172.21.15.42:0/1824808383 learned_addr learned my addr 172.21.15.42:0/1824808383 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f7646cf8640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764015e740 0x7f76400caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f7645cf6640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f764009b690 0x7f76400b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f76464f7640 1 -- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764015e740 msgr2=0x7f76400caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f76464f7640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764015e740 0x7f76400caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f76464f7640 1 -- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f764009b690 msgr2=0x7f76400b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f76464f7640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f764009b690 0x7f76400b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.199+0000 7f76464f7640 1 -- 172.21.15.42:0/1824808383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76400b6b90 con 0x7f764006dbd0 2024-09-16T01:54:53.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.200+0000 7f76464f7640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764006dbd0 0x7f76400b7c30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7630009f40 tx=0x7f7630004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:53.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.200+0000 7f763effd640 1 -- 172.21.15.42:0/1824808383 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630041020 con 0x7f764006dbd0 2024-09-16T01:54:53.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.200+0000 7f763effd640 1 -- 172.21.15.42:0/1824808383 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7630007800 con 0x7f764006dbd0 2024-09-16T01:54:53.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.200+0000 7f764875b640 1 -- 172.21.15.42:0/1824808383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76400b6e70 con 0x7f764006dbd0 2024-09-16T01:54:53.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.200+0000 7f763effd640 1 -- 172.21.15.42:0/1824808383 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630036040 con 0x7f764006dbd0 2024-09-16T01:54:53.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.200+0000 7f764875b640 1 -- 172.21.15.42:0/1824808383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76400b7430 con 0x7f764006dbd0 2024-09-16T01:54:53.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.201+0000 7f764875b640 1 -- 172.21.15.42:0/1824808383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764006cd20 con 0x7f764006dbd0 2024-09-16T01:54:53.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.201+0000 7f763effd640 1 -- 172.21.15.42:0/1824808383 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7630044020 con 0x7f764006dbd0 2024-09-16T01:54:53.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.202+0000 7f763effd640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f762c06c2b0 0x7f762c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:53.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.202+0000 7f763effd640 1 -- 172.21.15.42:0/1824808383 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f76300ac730 con 0x7f764006dbd0 2024-09-16T01:54:53.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.202+0000 7f7645cf6640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f762c06c2b0 0x7f762c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:53.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.202+0000 7f7645cf6640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f762c06c2b0 0x7f762c06e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7634007fd0 tx=0x7f7634009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:53.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.206+0000 7f763effd640 1 -- 172.21.15.42:0/1824808383 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f763004b030 con 0x7f764006dbd0 2024-09-16T01:54:53.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.416+0000 7f764875b640 1 -- 172.21.15.42:0/1824808383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f76400d1cb0 con 0x7f764006dbd0 2024-09-16T01:54:53.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.417+0000 7f763effd640 1 -- 172.21.15.42:0/1824808383 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f763007aa40 con 0x7f764006dbd0 2024-09-16T01:54:53.419 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:54:53.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 -- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f762c06c2b0 msgr2=0x7f762c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:53.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f762c06c2b0 0x7f762c06e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7634007fd0 tx=0x7f7634009040 comp rx=0 tx=0).stop 2024-09-16T01:54:53.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 -- 172.21.15.42:0/1824808383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764006dbd0 msgr2=0x7f76400b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:53.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764006dbd0 0x7f76400b7c30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7630009f40 tx=0x7f7630004a40 comp rx=0 tx=0).stop 2024-09-16T01:54:53.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 -- 172.21.15.42:0/1824808383 shutdown_connections 2024-09-16T01:54:53.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f762c06c2b0 0x7f762c06e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:53.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f764015e740 0x7f76400caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:53.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f764009b690 0x7f76400b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:53.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 --2- 172.21.15.42:0/1824808383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f764006dbd0 0x7f76400b7c30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:53.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 -- 172.21.15.42:0/1824808383 >> 172.21.15.42:0/1824808383 conn(0x7f76400d23a0 msgr2=0x7f76400ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:53.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 -- 172.21.15.42:0/1824808383 shutdown_connections 2024-09-16T01:54:53.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:53.419+0000 7f764875b640 1 -- 172.21.15.42:0/1824808383 wait complete. 2024-09-16T01:54:53.433 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:54:53.433 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:54:53.433 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-09-16T01:54:53.433 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:54:53.433 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:54:53.433 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:54:53.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:54:53.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:54:53.433 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:54:53.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:53.434 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-09-16T01:54:53.453 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:54:53.453 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:53.454 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:53.455 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:54:53.455 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:53.455 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:54:53.455 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42765sec preferred_lft 42765sec 2024-09-16T01:54:53.455 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link noprefixroute 2024-09-16T01:54:53.455 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:53.455 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T01:54:53.456 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:53.456 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-16T01:54:53.456 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2024-09-16T01:54:53.456 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2024-09-16T01:54:53.456 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2024-09-16T01:54:53.456 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T01:54:53.456 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-16T01:54:53.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:53.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:53.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:53.674 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:54:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-09-16T01:54:53.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:53.701 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-09-16T01:54:53.769 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-09-16T01:54:53.770 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:54:53.770 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:54:53.770 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:54:53.770 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:54:53.770 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:53.770 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-16T01:54:53.770 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:54:53.770 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:54:53.770 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:54:53.771 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-16T01:54:53.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:54.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:54.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:54.053 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-16T01:54:54.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:54.069 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-09-16T01:54:54.126 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:54.126 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-16T01:54:54.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:54:54.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-16T01:54:54.126 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-16T01:54:54.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:54.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:54.244 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-16T01:54:54.244 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:54.245 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-16T01:54:54.245 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-16T01:54:54.245 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T01:54:54.245 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-16T01:54:54.245 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-16T01:54:54.245 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-16T01:54:54.245 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-16T01:54:54.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:54.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:54.387 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:54.387 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-16T01:54:54.388 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-09-16T01:54:54.388 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T01:54:54.388 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-16T01:54:54.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:54.465 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:54:54.465 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:54:54.481 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:54:54.482 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:54:54.482 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:54:54.537 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:54:54.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:54.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:54:54.629 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:54:54.629 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:54:54.629 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-16T01:54:54.759 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:54:54.759 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:54:54.759 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-16T01:54:54.760 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:54:54.760 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:54:54.764 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:54:54.765 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:54:54.765 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-16T01:54:54.765 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:54:54.765 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:54:54.765 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-16T01:54:54.765 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-16T01:54:54.765 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=356ce71f-2ad9-4fe3-af21-266c510b09c8" will pass to kernel 2024-09-16T01:54:54.766 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:54:54.766 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:54:54.766 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:54:54.766 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:54:54.766 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:54:54.768 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:54:54.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:54.768 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:54:54.794 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:54.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:54.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:54.889 INFO:teuthology.orchestra.run.smithi107.stdout:client4675 2024-09-16T01:54:54.890 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:54:54.890 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:54:54.906 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:54.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:54.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:55.002 INFO:teuthology.orchestra.run.smithi107.stdout:client4675 2024-09-16T01:54:55.002 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:55.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:55.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:55.057 INFO:teuthology.orchestra.run.smithi107.stdout:client4675 2024-09-16T01:54:55.057 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/356ce71f-2ad9-4fe3-af21-266c510b09c8.client4675/status') 2024-09-16T01:54:55.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:55.116 INFO:teuthology.orchestra.run.smithi107.stdout:instance: client.4675 (3)192.168.0.1:0/812992673 2024-09-16T01:54:55.116 INFO:teuthology.orchestra.run.smithi107.stdout:blocklisted: false 2024-09-16T01:54:55.116 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records in 2024-09-16T01:54:55.117 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records out 2024-09-16T01:54:55.117 INFO:teuthology.orchestra.run.smithi107.stderr:68 bytes copied, 2.1748e-05 s, 3.1 MB/s 2024-09-16T01:54:55.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:55.125 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-16T01:54:55.125 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:54:55.125 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-16T01:54:55.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:54:55.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.238+0000 7fc7149e8640 1 Processor -- start 2024-09-16T01:54:55.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.238+0000 7fc7149e8640 1 -- start start 2024-09-16T01:54:55.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.239+0000 7fc7149e8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc710162060 0x7fc7100b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:55.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.239+0000 7fc7149e8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc7100b64b0 0x7fc7100b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:55.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.239+0000 7fc7149e8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71006d9f0 con 0x7fc710161c80 2024-09-16T01:54:55.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.239+0000 7fc7149e8640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fc71006dcd0 con 0x7fc710162060 2024-09-16T01:54:55.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.239+0000 7fc7149e8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc71006dfb0 con 0x7fc7100b64b0 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.240+0000 7fc70dd9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc710162060 0x7fc7100b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.240+0000 7fc70dd9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc710162060 0x7fc7100b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57542/0 (socket says 172.21.15.42:57542) 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.240+0000 7fc70dd9b640 1 -- 172.21.15.42:0/1512252066 learned_addr learned my addr 172.21.15.42:0/1512252066 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.240+0000 7fc70ed9d640 1 --2- 172.21.15.42:0/1512252066 >> v2:172.21.15.107:3300/0 conn(0x7fc7100b64b0 0x7fc7100b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.240+0000 7fc70dd9b640 1 -- 172.21.15.42:0/1512252066 >> v2:172.21.15.107:3300/0 conn(0x7fc7100b64b0 msgr2=0x7fc7100b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.240+0000 7fc70dd9b640 1 --2- 172.21.15.42:0/1512252066 >> v2:172.21.15.107:3300/0 conn(0x7fc7100b64b0 0x7fc7100b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.240+0000 7fc70dd9b640 1 -- 172.21.15.42:0/1512252066 >> v1:172.21.15.107:6789/0 conn(0x7fc710161c80 legacy=0x7fc71006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.240+0000 7fc70dd9b640 1 -- 172.21.15.42:0/1512252066 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7100d01f0 con 0x7fc710162060 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.241+0000 7fc70dd9b640 1 --2- 172.21.15.42:0/1512252066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 0x7fc7100b5f70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc71008d750 tx=0x7fc70402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca3cf227a5ae347 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.241+0000 7fc70d59a640 1 -- 172.21.15.42:0/1512252066 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704037070 con 0x7fc710162060 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.241+0000 7fc70d59a640 1 -- 172.21.15.42:0/1512252066 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc704032440 con 0x7fc710162060 2024-09-16T01:54:55.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.241+0000 7fc70d59a640 1 -- 172.21.15.42:0/1512252066 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704032810 con 0x7fc710162060 2024-09-16T01:54:55.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.241+0000 7fc7149e8640 1 -- 172.21.15.42:0/1512252066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 msgr2=0x7fc7100b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:55.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.241+0000 7fc7149e8640 1 --2- 172.21.15.42:0/1512252066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 0x7fc7100b5f70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc71008d750 tx=0x7fc70402a270 comp rx=0 tx=0).stop 2024-09-16T01:54:55.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.242+0000 7fc7149e8640 1 -- 172.21.15.42:0/1512252066 shutdown_connections 2024-09-16T01:54:55.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.242+0000 7fc7149e8640 1 --2- 172.21.15.42:0/1512252066 >> v2:172.21.15.107:3300/0 conn(0x7fc7100b64b0 0x7fc7100b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.242+0000 7fc7149e8640 1 --2- 172.21.15.42:0/1512252066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 0x7fc7100b5f70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.242+0000 7fc7149e8640 1 -- 172.21.15.42:0/1512252066 >> 172.21.15.42:0/1512252066 conn(0x7fc7100d44f0 msgr2=0x7fc7100d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.242+0000 7fc7149e8640 1 -- 172.21.15.42:0/1512252066 shutdown_connections 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.242+0000 7fc7149e8640 1 -- 172.21.15.42:0/1512252066 wait complete. 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.243+0000 7fc7149e8640 1 Processor -- start 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.243+0000 7fc7149e8640 1 -- start start 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc7149e8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7100b64b0 0x7fc710159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc7149e8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc710161c80 0x7fc7100b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc7149e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 0x7fc7100b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc7149e8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc7100cf1e0 con 0x7fc710162060 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc7149e8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc7100d2aa0 con 0x7fc710161c80 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc7149e8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc7100cf360 con 0x7fc7100b64b0 2024-09-16T01:54:55.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 0x7fc7100b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70ed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 0x7fc7100b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57554/0 (socket says 172.21.15.42:57554) 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70ed9d640 1 -- 172.21.15.42:0/2129359192 learned_addr learned my addr 172.21.15.42:0/2129359192 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70dd9b640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc710161c80 0x7fc7100b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70e59c640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7100b64b0 0x7fc710159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70ed9d640 1 -- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7100b64b0 msgr2=0x7fc710159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70ed9d640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7100b64b0 0x7fc710159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70ed9d640 1 -- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc710161c80 msgr2=0x7fc7100b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70ed9d640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc710161c80 0x7fc7100b7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70ed9d640 1 -- 172.21.15.42:0/2129359192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7100b9600 con 0x7fc710162060 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.244+0000 7fc70ed9d640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 0x7fc7100b2280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc70800d800 tx=0x7fc70800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.245+0000 7fc6feffd640 1 -- 172.21.15.42:0/2129359192 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70800b6c0 con 0x7fc710162060 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.245+0000 7fc6feffd640 1 -- 172.21.15.42:0/2129359192 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc708019070 con 0x7fc710162060 2024-09-16T01:54:55.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.245+0000 7fc7149e8640 1 -- 172.21.15.42:0/2129359192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7100b9320 con 0x7fc710162060 2024-09-16T01:54:55.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.245+0000 7fc6feffd640 1 -- 172.21.15.42:0/2129359192 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70800bac0 con 0x7fc710162060 2024-09-16T01:54:55.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.245+0000 7fc7149e8640 1 -- 172.21.15.42:0/2129359192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7100c8340 con 0x7fc710162060 2024-09-16T01:54:55.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.246+0000 7fc7149e8640 1 -- 172.21.15.42:0/2129359192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7100b5f70 con 0x7fc710162060 2024-09-16T01:54:55.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.246+0000 7fc6feffd640 1 -- 172.21.15.42:0/2129359192 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc70800bc60 con 0x7fc710162060 2024-09-16T01:54:55.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.247+0000 7fc6feffd640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc6f006c2b0 0x7fc6f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:55.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.247+0000 7fc6feffd640 1 -- 172.21.15.42:0/2129359192 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc70808b9e0 con 0x7fc710162060 2024-09-16T01:54:55.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.247+0000 7fc70e59c640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc6f006c2b0 0x7fc6f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:55.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.247+0000 7fc70e59c640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc6f006c2b0 0x7fc6f006e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc700001f10 tx=0x7fc700009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:55.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.252+0000 7fc6feffd640 1 -- 172.21.15.42:0/2129359192 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc708059850 con 0x7fc710162060 2024-09-16T01:54:55.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.461+0000 7fc7149e8640 1 -- 172.21.15.42:0/2129359192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc7100ba470 con 0x7fc710162060 2024-09-16T01:54:55.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.462+0000 7fc6feffd640 1 -- 172.21.15.42:0/2129359192 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fc70805db50 con 0x7fc710162060 2024-09-16T01:54:55.464 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:54:55.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.463+0000 7fc7149e8640 1 -- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc6f006c2b0 msgr2=0x7fc6f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:55.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.463+0000 7fc7149e8640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc6f006c2b0 0x7fc6f006e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc700001f10 tx=0x7fc700009040 comp rx=0 tx=0).stop 2024-09-16T01:54:55.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.463+0000 7fc7149e8640 1 -- 172.21.15.42:0/2129359192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 msgr2=0x7fc7100b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:55.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.463+0000 7fc7149e8640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 0x7fc7100b2280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc70800d800 tx=0x7fc70800dcc0 comp rx=0 tx=0).stop 2024-09-16T01:54:55.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.464+0000 7fc7149e8640 1 -- 172.21.15.42:0/2129359192 shutdown_connections 2024-09-16T01:54:55.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.464+0000 7fc7149e8640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc6f006c2b0 0x7fc6f006e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:55.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.464+0000 7fc7149e8640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc710162060 0x7fc7100b2280 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:55.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.464+0000 7fc7149e8640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc710161c80 0x7fc7100b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:55.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.464+0000 7fc7149e8640 1 --2- 172.21.15.42:0/2129359192 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc7100b64b0 0x7fc710159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:55.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.464+0000 7fc7149e8640 1 -- 172.21.15.42:0/2129359192 >> 172.21.15.42:0/2129359192 conn(0x7fc7100d44f0 msgr2=0x7fc7100b4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:55.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.464+0000 7fc7149e8640 1 -- 172.21.15.42:0/2129359192 shutdown_connections 2024-09-16T01:54:55.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:55.464+0000 7fc7149e8640 1 -- 172.21.15.42:0/2129359192 wait complete. 2024-09-16T01:54:55.477 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:54:55.477 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:54:55.477 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-09-16T01:54:55.477 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-16T01:54:55.477 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-16T01:54:55.477 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:54:55.477 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:54:55.477 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:54:55.477 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-16T01:54:55.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:55.478 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-09-16T01:54:55.493 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:54:55.494 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:54:55.494 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:54:55.494 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:55.494 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-09-16T01:54:55.494 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:55.494 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:55.494 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:55.494 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-09-16T01:54:55.494 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:55.494 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42762sec preferred_lft 42762sec 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link noprefixroute 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether d2:23:6c:a0:3f:21 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:54:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:55.496 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::44ed:c5ff:fe61:2de0/64 scope link 2024-09-16T01:54:55.496 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:55.496 INFO:teuthology.orchestra.run.smithi107.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:54:55.496 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether d2:23:6c:a0:3f:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:54:55.496 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::d023:6cff:fea0:3f21/64 scope link tentative 2024-09-16T01:54:55.496 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:55.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:55.496 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:54:55.557 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-09-16T01:54:55.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:55.559 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-09-16T01:54:55.615 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-09-16T01:54:55.615 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:54:55.615 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:54:55.615 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:54:55.615 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:54:55.616 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:55.616 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-16T01:54:55.616 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:54:55.616 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:54:55.616 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:54:55.616 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-16T01:54:55.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:55.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:55.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:55.741 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-16T01:54:55.756 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:54:55.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:55.757 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-09-16T01:54:55.812 INFO:teuthology.orchestra.run.smithi107.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-16T01:54:55.812 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:55.812 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-16T01:54:55.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:54:55.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-16T01:54:55.813 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-16T01:54:55.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:55.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:55.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:55.929 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-16T01:54:55.953 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:54:55.953 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:54:55.953 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:54:55.953 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:55.954 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-09-16T01:54:55.954 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:55.954 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:54:55.954 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 8e:e5:ea:a1:9c:61 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T01:54:55.954 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T01:54:55.954 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:55.954 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::8ce5:eaff:fea1:9c61/64 scope link 2024-09-16T01:54:55.954 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:55.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:55.956 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-16T01:54:56.021 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 8e:e5:ea:a1:9c:61 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::8ce5:eaff:fea1:9c61/64 scope link 2024-09-16T01:54:56.022 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:54:56.023 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-16T01:54:56.024 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:56.024 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-16T01:54:56.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-16T01:54:56.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-16T01:54:56.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-16T01:54:56.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-16T01:54:56.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-16T01:54:56.024 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-16T01:54:56.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:56.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:56.175 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:54:56.175 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-09-16T01:54:56.175 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.1 up 2024-09-16T01:54:56.175 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.1 master ceph-brx 2024-09-16T01:54:56.176 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-09-16T01:54:56.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:56.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:54:56.252 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-16T01:54:56.267 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-16T01:54:56.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:54:56.267 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-16T01:54:56.321 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:54:56.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:56.321 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T01:54:56.404 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T01:54:56.404 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T01:54:56.404 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-16T01:54:56.413 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T01:54:56.413 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T01:54:56.413 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-16T01:54:56.413 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:54:56.413 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:54:56.418 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T01:54:56.418 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T01:54:56.418 INFO:teuthology.orchestra.run.smithi107.stdout:invalid new device string format 2024-09-16T01:54:56.418 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:54:56.418 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:54:56.418 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-16T01:54:56.418 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-16T01:54:56.418 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=356ce71f-2ad9-4fe3-af21-266c510b09c8" will pass to kernel 2024-09-16T01:54:56.419 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-16T01:54:56.419 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:54:56.419 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:54:56.419 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:54:56.419 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:54:56.420 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:54:56.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:56.421 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-16T01:54:56.485 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:56.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:56.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:56.581 INFO:teuthology.orchestra.run.smithi107.stdout:client34460 2024-09-16T01:54:56.581 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:54:56.581 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:54:56.597 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:56.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:56.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:56.693 INFO:teuthology.orchestra.run.smithi107.stdout:client34460 2024-09-16T01:54:56.693 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:54:56.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:54:56.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:56.747 INFO:teuthology.orchestra.run.smithi107.stdout:client34460 2024-09-16T01:54:56.748 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/356ce71f-2ad9-4fe3-af21-266c510b09c8.client34460/status') 2024-09-16T01:54:56.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:54:56.805 INFO:teuthology.orchestra.run.smithi107.stdout:instance: client.34460 (3)192.168.0.2:0/4141786126 2024-09-16T01:54:56.805 INFO:teuthology.orchestra.run.smithi107.stdout:blocklisted: false 2024-09-16T01:54:56.805 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records in 2024-09-16T01:54:56.805 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records out 2024-09-16T01:54:56.806 INFO:teuthology.orchestra.run.smithi107.stderr:70 bytes copied, 2.2189e-05 s, 3.2 MB/s 2024-09-16T01:54:56.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-16T01:54:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:54:56.812 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-16T01:54:56.871 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-16T01:54:56.871 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:54:56.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.986+0000 7fe296ee4640 1 Processor -- start 2024-09-16T01:54:56.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.986+0000 7fe296ee4640 1 -- start start 2024-09-16T01:54:56.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.987+0000 7fe296ee4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe29015e760 0x7fe29006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:56.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.987+0000 7fe296ee4640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2900d2700 con 0x7fe2900cfcc0 2024-09-16T01:54:56.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.987+0000 7fe296ee4640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2900cedb0 con 0x7fe2900d4fd0 2024-09-16T01:54:56.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.987+0000 7fe296ee4640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe2900cf090 con 0x7fe29015e760 2024-09-16T01:54:56.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.987+0000 7fe294c80640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe29015e760 0x7fe29006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:56.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.987+0000 7fe294c80640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe29015e760 0x7fe29006cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57558/0 (socket says 172.21.15.42:57558) 2024-09-16T01:54:56.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.987+0000 7fe294c80640 1 -- 172.21.15.42:0/2017983444 learned_addr learned my addr 172.21.15.42:0/2017983444 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:56.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.987+0000 7fe295481640 1 --1- 172.21.15.42:0/2017983444 >> v1:172.21.15.42:6789/0 conn(0x7fe2900cfcc0 0x7fe2900d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36492/0 (socket says 172.21.15.42:36492) 2024-09-16T01:54:56.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.988+0000 7fe294c80640 1 -- 172.21.15.42:0/2017983444 >> v1:172.21.15.107:6789/0 conn(0x7fe2900d4fd0 legacy=0x7fe2900cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:56.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.988+0000 7fe294c80640 1 -- 172.21.15.42:0/2017983444 >> v1:172.21.15.42:6789/0 conn(0x7fe2900cfcc0 legacy=0x7fe2900d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:56.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.988+0000 7fe294c80640 1 -- 172.21.15.42:0/2017983444 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2900b3c80 con 0x7fe29015e760 2024-09-16T01:54:56.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.988+0000 7fe28f7fe640 1 -- 172.21.15.42:0/2017983444 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 947926442 0 0) 0x7fe288001490 con 0x7fe2900cfcc0 2024-09-16T01:54:56.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.988+0000 7fe294c80640 1 --2- 172.21.15.42:0/2017983444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29015e760 0x7fe29006cdd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe280009870 tx=0x7fe28002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df5551eb379d858 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:56.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.989+0000 7fe28f7fe640 1 -- 172.21.15.42:0/2017983444 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280037070 con 0x7fe29015e760 2024-09-16T01:54:56.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.989+0000 7fe28f7fe640 1 -- 172.21.15.42:0/2017983444 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28002ae50 con 0x7fe29015e760 2024-09-16T01:54:56.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.989+0000 7fe28f7fe640 1 -- 172.21.15.42:0/2017983444 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280032860 con 0x7fe29015e760 2024-09-16T01:54:56.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.989+0000 7fe296ee4640 1 -- 172.21.15.42:0/2017983444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29015e760 msgr2=0x7fe29006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:56.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.989+0000 7fe296ee4640 1 --2- 172.21.15.42:0/2017983444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29015e760 0x7fe29006cdd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe280009870 tx=0x7fe28002a300 comp rx=0 tx=0).stop 2024-09-16T01:54:56.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.989+0000 7fe296ee4640 1 -- 172.21.15.42:0/2017983444 shutdown_connections 2024-09-16T01:54:56.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.989+0000 7fe296ee4640 1 --2- 172.21.15.42:0/2017983444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29015e760 0x7fe29006cdd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:56.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.989+0000 7fe296ee4640 1 -- 172.21.15.42:0/2017983444 >> 172.21.15.42:0/2017983444 conn(0x7fe29008bfc0 msgr2=0x7fe2900d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:56.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.989+0000 7fe296ee4640 1 -- 172.21.15.42:0/2017983444 shutdown_connections 2024-09-16T01:54:56.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.989+0000 7fe296ee4640 1 -- 172.21.15.42:0/2017983444 wait complete. 2024-09-16T01:54:56.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.990+0000 7fe296ee4640 1 Processor -- start 2024-09-16T01:54:56.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.990+0000 7fe296ee4640 1 -- start start 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.991+0000 7fe296ee4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2900cfcc0 0x7fe290155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.991+0000 7fe296ee4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900d4fd0 0x7fe290160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.991+0000 7fe296ee4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe29015e760 0x7fe2900b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.991+0000 7fe296ee4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe2900d35b0 con 0x7fe2900d4fd0 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.991+0000 7fe296ee4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe2900b3920 con 0x7fe2900cfcc0 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.991+0000 7fe296ee4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe2900d3730 con 0x7fe29015e760 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900d4fd0 0x7fe290160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900d4fd0 0x7fe290160b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57574/0 (socket says 172.21.15.42:57574) 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28ffff640 1 -- 172.21.15.42:0/1738148098 learned_addr learned my addr 172.21.15.42:0/1738148098 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe295481640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe29015e760 0x7fe2900b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe294c80640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2900cfcc0 0x7fe290155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:56.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28ffff640 1 -- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe29015e760 msgr2=0x7fe2900b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28ffff640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe29015e760 0x7fe2900b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28ffff640 1 -- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2900cfcc0 msgr2=0x7fe290155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28ffff640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2900cfcc0 0x7fe290155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28ffff640 1 -- 172.21.15.42:0/1738148098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2901562f0 con 0x7fe2900d4fd0 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28ffff640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900d4fd0 0x7fe290160b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c480 tx=0x7fe28400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28d7fa640 1 -- 172.21.15.42:0/1738148098 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2840052d0 con 0x7fe2900d4fd0 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28d7fa640 1 -- 172.21.15.42:0/1738148098 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe284005490 con 0x7fe2900d4fd0 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe296ee4640 1 -- 172.21.15.42:0/1738148098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2900b75d0 con 0x7fe2900d4fd0 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe28d7fa640 1 -- 172.21.15.42:0/1738148098 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284003880 con 0x7fe2900d4fd0 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.992+0000 7fe296ee4640 1 -- 172.21.15.42:0/1738148098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2900b7b90 con 0x7fe2900d4fd0 2024-09-16T01:54:56.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.993+0000 7fe296ee4640 1 -- 172.21.15.42:0/1738148098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2900b8250 con 0x7fe2900d4fd0 2024-09-16T01:54:56.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.994+0000 7fe28d7fa640 1 -- 172.21.15.42:0/1738148098 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe284003a20 con 0x7fe2900d4fd0 2024-09-16T01:54:56.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.994+0000 7fe28d7fa640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe27c06c2e0 0x7fe27c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:56.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.994+0000 7fe28d7fa640 1 -- 172.21.15.42:0/1738148098 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe28408b280 con 0x7fe2900d4fd0 2024-09-16T01:54:56.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.995+0000 7fe294c80640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe27c06c2e0 0x7fe27c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:56.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.995+0000 7fe294c80640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe27c06c2e0 0x7fe27c06e7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe280034000 tx=0x7fe28002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:57.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:56.999+0000 7fe28d7fa640 1 -- 172.21.15.42:0/1738148098 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2900b8250 con 0x7fe2900d4fd0 2024-09-16T01:54:57.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.179+0000 7fe296ee4640 1 -- 172.21.15.42:0/1738148098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2900d3a60 con 0x7fe2900d4fd0 2024-09-16T01:54:57.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.180+0000 7fe28d7fa640 1 -- 172.21.15.42:0/1738148098 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7fe2840590f0 con 0x7fe2900d4fd0 2024-09-16T01:54:57.182 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:54:57.182 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 -- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe27c06c2e0 msgr2=0x7fe27c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe27c06c2e0 0x7fe27c06e7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe280034000 tx=0x7fe28002e000 comp rx=0 tx=0).stop 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 -- 172.21.15.42:0/1738148098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900d4fd0 msgr2=0x7fe290160b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900d4fd0 0x7fe290160b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c480 tx=0x7fe28400c940 comp rx=0 tx=0).stop 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 -- 172.21.15.42:0/1738148098 shutdown_connections 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe27c06c2e0 0x7fe27c06e7a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe29015e760 0x7fe2900b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900d4fd0 0x7fe290160b00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 --2- 172.21.15.42:0/1738148098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2900cfcc0 0x7fe290155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 -- 172.21.15.42:0/1738148098 >> 172.21.15.42:0/1738148098 conn(0x7fe29008bfc0 msgr2=0x7fe2900b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 -- 172.21.15.42:0/1738148098 shutdown_connections 2024-09-16T01:54:57.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.182+0000 7fe296ee4640 1 -- 172.21.15.42:0/1738148098 wait complete. 2024-09-16T01:54:57.195 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:54:08.299569+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T01:54:19.072922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T01:54:20.185940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-16T01:54:23.886069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-16T01:54:57.195 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:54:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.299+0000 7ff6a081e640 1 Processor -- start 2024-09-16T01:54:57.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.299+0000 7ff6a081e640 1 -- start start 2024-09-16T01:54:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.300+0000 7ff6a081e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff69c0d4c10 0x7ff69c162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.300+0000 7ff6a081e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff69c0d3320 0x7ff69c0d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.300+0000 7ff6a081e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c0d2600 con 0x7ff69c0b5f80 2024-09-16T01:54:57.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.300+0000 7ff6a081e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff69c0d5420 con 0x7ff69c0d3320 2024-09-16T01:54:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.300+0000 7ff6a081e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff69c0d2e90 con 0x7ff69c0d4c10 2024-09-16T01:54:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.300+0000 7ff69ad9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff69c0d3320 0x7ff69c0d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.300+0000 7ff69ad9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff69c0d3320 0x7ff69c0d37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57588/0 (socket says 172.21.15.42:57588) 2024-09-16T01:54:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.300+0000 7ff69a59c640 1 --1- 172.21.15.42:0/170687431 >> v1:172.21.15.42:6789/0 conn(0x7ff69c0b5f80 0x7ff69c0b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36508/0 (socket says 172.21.15.42:36508) 2024-09-16T01:54:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.300+0000 7ff69ad9d640 1 -- 172.21.15.42:0/170687431 learned_addr learned my addr 172.21.15.42:0/170687431 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.301+0000 7ff699d9b640 1 --2- 172.21.15.42:0/170687431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff69c0d4c10 0x7ff69c162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.301+0000 7ff69ad9d640 1 -- 172.21.15.42:0/170687431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff69c0d4c10 msgr2=0x7ff69c162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.301+0000 7ff69ad9d640 1 --2- 172.21.15.42:0/170687431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff69c0d4c10 0x7ff69c162980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.301+0000 7ff69ad9d640 1 -- 172.21.15.42:0/170687431 >> v1:172.21.15.42:6789/0 conn(0x7ff69c0b5f80 legacy=0x7ff69c0b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.301+0000 7ff69ad9d640 1 -- 172.21.15.42:0/170687431 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c0b3c10 con 0x7ff69c0d3320 2024-09-16T01:54:57.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.301+0000 7ff69959a640 1 -- 172.21.15.42:0/170687431 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2398044117 0 0) 0x7ff694001110 con 0x7ff69c0b5f80 2024-09-16T01:54:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.301+0000 7ff69ad9d640 1 --2- 172.21.15.42:0/170687431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 0x7ff69c0d37b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009e50 tx=0x7ff68c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96572bf210e4748 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff69959a640 1 -- 172.21.15.42:0/170687431 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c036070 con 0x7ff69c0d3320 2024-09-16T01:54:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff69959a640 1 -- 172.21.15.42:0/170687431 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68c031600 con 0x7ff69c0d3320 2024-09-16T01:54:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff69959a640 1 -- 172.21.15.42:0/170687431 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0319d0 con 0x7ff69c0d3320 2024-09-16T01:54:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff6a081e640 1 -- 172.21.15.42:0/170687431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 msgr2=0x7ff69c0d37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff6a081e640 1 --2- 172.21.15.42:0/170687431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 0x7ff69c0d37b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009e50 tx=0x7ff68c02a710 comp rx=0 tx=0).stop 2024-09-16T01:54:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff6a081e640 1 -- 172.21.15.42:0/170687431 shutdown_connections 2024-09-16T01:54:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff6a081e640 1 --2- 172.21.15.42:0/170687431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 0x7ff69c0d37b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff6a081e640 1 --2- 172.21.15.42:0/170687431 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff69c0d4c10 0x7ff69c162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff6a081e640 1 -- 172.21.15.42:0/170687431 >> 172.21.15.42:0/170687431 conn(0x7ff69c08bfc0 msgr2=0x7ff69c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff6a081e640 1 -- 172.21.15.42:0/170687431 shutdown_connections 2024-09-16T01:54:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.302+0000 7ff6a081e640 1 -- 172.21.15.42:0/170687431 wait complete. 2024-09-16T01:54:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.304+0000 7ff6a081e640 1 Processor -- start 2024-09-16T01:54:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.304+0000 7ff6a081e640 1 -- start start 2024-09-16T01:54:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.304+0000 7ff6a081e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff69c0b5f80 0x7ff69c0b9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.304+0000 7ff6a081e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 0x7ff69c160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.304+0000 7ff6a081e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff69c0d4c10 0x7ff69c1613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.304+0000 7ff6a081e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c0d2b20 con 0x7ff69c0d3320 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.304+0000 7ff6a081e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c0d2880 con 0x7ff69c0d4c10 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.304+0000 7ff6a081e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff69c15f690 con 0x7ff69c0b5f80 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff699d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 0x7ff69c160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff699d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 0x7ff69c160e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57604/0 (socket says 172.21.15.42:57604) 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff699d9b640 1 -- 172.21.15.42:0/3258529180 learned_addr learned my addr 172.21.15.42:0/3258529180 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff69a59c640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff69c0b5f80 0x7ff69c0b9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff69ad9d640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff69c0d4c10 0x7ff69c1613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff699d9b640 1 -- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff69c0b5f80 msgr2=0x7ff69c0b9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff699d9b640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff69c0b5f80 0x7ff69c0b9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff699d9b640 1 -- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff69c0d4c10 msgr2=0x7ff69c1613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff699d9b640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff69c0d4c10 0x7ff69c1613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff699d9b640 1 -- 172.21.15.42:0/3258529180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c0b96e0 con 0x7ff69c0d3320 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff699d9b640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 0x7ff69c160e90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c7f0 tx=0x7ff68400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff692ffd640 1 -- 172.21.15.42:0/3258529180 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684015070 con 0x7ff69c0d3320 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff692ffd640 1 -- 172.21.15.42:0/3258529180 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff684004240 con 0x7ff69c0d3320 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff6a081e640 1 -- 172.21.15.42:0/3258529180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c0b2ce0 con 0x7ff69c0d3320 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff692ffd640 1 -- 172.21.15.42:0/3258529180 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684007620 con 0x7ff69c0d3320 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.305+0000 7ff6a081e640 1 -- 172.21.15.42:0/3258529180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c0c8180 con 0x7ff69c0d3320 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.306+0000 7ff6a081e640 1 -- 172.21.15.42:0/3258529180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c0c83e0 con 0x7ff69c0d3320 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.307+0000 7ff692ffd640 1 -- 172.21.15.42:0/3258529180 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff6840077c0 con 0x7ff69c0d3320 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.307+0000 7ff692ffd640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff67c06c2e0 0x7ff67c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.307+0000 7ff692ffd640 1 -- 172.21.15.42:0/3258529180 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff68408b530 con 0x7ff69c0d3320 2024-09-16T01:54:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.308+0000 7ff69a59c640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff67c06c2e0 0x7ff67c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.308+0000 7ff69a59c640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff67c06c2e0 0x7ff67c06e7a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff694007fd0 tx=0x7ff694007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.312+0000 7ff692ffd640 1 -- 172.21.15.42:0/3258529180 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff684059310 con 0x7ff69c0d3320 2024-09-16T01:54:57.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.488+0000 7ff6a081e640 1 -- 172.21.15.42:0/3258529180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff69c0d37b0 con 0x7ff69c0d3320 2024-09-16T01:54:57.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.488+0000 7ff692ffd640 1 -- 172.21.15.42:0/3258529180 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7ff68405d610 con 0x7ff69c0d3320 2024-09-16T01:54:57.490 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-16T01:54:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 -- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff67c06c2e0 msgr2=0x7ff67c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff67c06c2e0 0x7ff67c06e7a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff694007fd0 tx=0x7ff694007de0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 -- 172.21.15.42:0/3258529180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 msgr2=0x7ff69c160e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 0x7ff69c160e90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c7f0 tx=0x7ff68400ccb0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 -- 172.21.15.42:0/3258529180 shutdown_connections 2024-09-16T01:54:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff67c06c2e0 0x7ff67c06e7a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff69c0d4c10 0x7ff69c1613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff69c0d3320 0x7ff69c160e90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 --2- 172.21.15.42:0/3258529180 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff69c0b5f80 0x7ff69c0b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 -- 172.21.15.42:0/3258529180 >> 172.21.15.42:0/3258529180 conn(0x7ff69c08bfc0 msgr2=0x7ff69c0d39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:57.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 -- 172.21.15.42:0/3258529180 shutdown_connections 2024-09-16T01:54:57.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.490+0000 7ff6a081e640 1 -- 172.21.15.42:0/3258529180 wait complete. 2024-09-16T01:54:57.503 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T01:54:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.606+0000 7fe2fa247640 1 Processor -- start 2024-09-16T01:54:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.606+0000 7fe2fa247640 1 -- start start 2024-09-16T01:54:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2fa247640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe2f4161a20 0x7fe2f40d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2fa247640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40d1420 0x7fe2f40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2fa247640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe2f40cf160 0x7fe2f40b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2fa247640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f4161e00 con 0x7fe2f40cf160 2024-09-16T01:54:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2fa247640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f40d1830 con 0x7fe2f4161a20 2024-09-16T01:54:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2fa247640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f40cf980 con 0x7fe2f40d1420 2024-09-16T01:54:57.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2f3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe2f40cf160 0x7fe2f40b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2f3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe2f40cf160 0x7fe2f40b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57620/0 (socket says 172.21.15.42:57620) 2024-09-16T01:54:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2f3fff640 1 -- 172.21.15.42:0/2132074878 learned_addr learned my addr 172.21.15.42:0/2132074878 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2f37fe640 1 --2- 172.21.15.42:0/2132074878 >> v2:172.21.15.107:3300/0 conn(0x7fe2f4161a20 0x7fe2f40d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.607+0000 7fe2f2ffd640 1 --2- 172.21.15.42:0/2132074878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40d1420 0x7fe2f40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.608+0000 7fe2f3fff640 1 -- 172.21.15.42:0/2132074878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40d1420 msgr2=0x7fe2f40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.608+0000 7fe2f3fff640 1 --2- 172.21.15.42:0/2132074878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40d1420 0x7fe2f40cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.608+0000 7fe2f3fff640 1 -- 172.21.15.42:0/2132074878 >> v2:172.21.15.107:3300/0 conn(0x7fe2f4161a20 msgr2=0x7fe2f40d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.608+0000 7fe2f3fff640 1 --2- 172.21.15.42:0/2132074878 >> v2:172.21.15.107:3300/0 conn(0x7fe2f4161a20 0x7fe2f40d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.608+0000 7fe2f3fff640 1 -- 172.21.15.42:0/2132074878 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f406d050 con 0x7fe2f40cf160 2024-09-16T01:54:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.608+0000 7fe2f2ffd640 1 --2- 172.21.15.42:0/2132074878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40d1420 0x7fe2f40cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.608+0000 7fe2f3fff640 1 --2- 172.21.15.42:0/2132074878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40cf160 0x7fe2f40b5f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2f408c910 tx=0x7fe2ec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d154d724ecb60ad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.608+0000 7fe2f27fc640 1 -- 172.21.15.42:0/2132074878 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec036070 con 0x7fe2f40cf160 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.608+0000 7fe2f27fc640 1 -- 172.21.15.42:0/2132074878 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec031600 con 0x7fe2f40cf160 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.609+0000 7fe2f27fc640 1 -- 172.21.15.42:0/2132074878 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0319d0 con 0x7fe2f40cf160 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.609+0000 7fe2fa247640 1 -- 172.21.15.42:0/2132074878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40cf160 msgr2=0x7fe2f40b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.609+0000 7fe2fa247640 1 --2- 172.21.15.42:0/2132074878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40cf160 0x7fe2f40b5f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2f408c910 tx=0x7fe2ec02a6a0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.609+0000 7fe2fa247640 1 -- 172.21.15.42:0/2132074878 shutdown_connections 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.609+0000 7fe2fa247640 1 --2- 172.21.15.42:0/2132074878 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40d1420 0x7fe2f40cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.609+0000 7fe2fa247640 1 --2- 172.21.15.42:0/2132074878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40cf160 0x7fe2f40b5f50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.609+0000 7fe2fa247640 1 --2- 172.21.15.42:0/2132074878 >> v2:172.21.15.107:3300/0 conn(0x7fe2f4161a20 0x7fe2f40d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.609+0000 7fe2fa247640 1 -- 172.21.15.42:0/2132074878 >> 172.21.15.42:0/2132074878 conn(0x7fe2f409d850 msgr2=0x7fe2f408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:57.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.609+0000 7fe2fa247640 1 -- 172.21.15.42:0/2132074878 shutdown_connections 2024-09-16T01:54:57.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.609+0000 7fe2fa247640 1 -- 172.21.15.42:0/2132074878 wait complete. 2024-09-16T01:54:57.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.610+0000 7fe2fa247640 1 Processor -- start 2024-09-16T01:54:57.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.611+0000 7fe2fa247640 1 -- start start 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.611+0000 7fe2fa247640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40cf160 0x7fe2f41f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.611+0000 7fe2fa247640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40d1420 0x7fe2f41f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.611+0000 7fe2fa247640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2f4161a20 0x7fe2f406e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.611+0000 7fe2fa247640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f406d2f0 con 0x7fe2f40d1420 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.611+0000 7fe2fa247640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f40cff00 con 0x7fe2f4161a20 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.611+0000 7fe2fa247640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f40b1040 con 0x7fe2f40cf160 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.611+0000 7fe2f2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40d1420 0x7fe2f41f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.611+0000 7fe2f2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40d1420 0x7fe2f41f7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57624/0 (socket says 172.21.15.42:57624) 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.611+0000 7fe2f2ffd640 1 -- 172.21.15.42:0/2382946674 learned_addr learned my addr 172.21.15.42:0/2382946674 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2f37fe640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40cf160 0x7fe2f41f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2f3fff640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2f4161a20 0x7fe2f406e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2f2ffd640 1 -- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40cf160 msgr2=0x7fe2f41f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2f2ffd640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40cf160 0x7fe2f41f44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2f2ffd640 1 -- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2f4161a20 msgr2=0x7fe2f406e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2f2ffd640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2f4161a20 0x7fe2f406e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2f2ffd640 1 -- 172.21.15.42:0/2382946674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f40cb7f0 con 0x7fe2f40d1420 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2f3fff640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2f4161a20 0x7fe2f406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2f2ffd640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40d1420 0x7fe2f41f7250 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800e730 tx=0x7fe2e800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2dbfff640 1 -- 172.21.15.42:0/2382946674 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e800f040 con 0x7fe2f40d1420 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2dbfff640 1 -- 172.21.15.42:0/2382946674 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e8004230 con 0x7fe2f40d1420 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2fa247640 1 -- 172.21.15.42:0/2382946674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f40cbad0 con 0x7fe2f40d1420 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2dbfff640 1 -- 172.21.15.42:0/2382946674 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e800ee40 con 0x7fe2f40d1420 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.612+0000 7fe2fa247640 1 -- 172.21.15.42:0/2382946674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f40cc090 con 0x7fe2f40d1420 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.613+0000 7fe2fa247640 1 -- 172.21.15.42:0/2382946674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f40cf5f0 con 0x7fe2f40d1420 2024-09-16T01:54:57.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.614+0000 7fe2dbfff640 1 -- 172.21.15.42:0/2382946674 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe2e800c6d0 con 0x7fe2f40d1420 2024-09-16T01:54:57.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.614+0000 7fe2dbfff640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe2e006c2b0 0x7fe2e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.614+0000 7fe2dbfff640 1 -- 172.21.15.42:0/2382946674 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe2e808b470 con 0x7fe2f40d1420 2024-09-16T01:54:57.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.614+0000 7fe2f37fe640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe2e006c2b0 0x7fe2e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.615+0000 7fe2f37fe640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe2e006c2b0 0x7fe2e006e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40098f0 tx=0x7fe2e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:57.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.618+0000 7fe2dbfff640 1 -- 172.21.15.42:0/2382946674 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2e8017020 con 0x7fe2f40d1420 2024-09-16T01:54:57.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.793+0000 7fe2fa247640 1 -- 172.21.15.42:0/2382946674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe2f415e160 con 0x7fe2f40d1420 2024-09-16T01:54:57.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.793+0000 7fe2dbfff640 1 -- 172.21.15.42:0/2382946674 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fe2e8059930 con 0x7fe2f40d1420 2024-09-16T01:54:57.795 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-09-16T01:54:57.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 -- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe2e006c2b0 msgr2=0x7fe2e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe2e006c2b0 0x7fe2e006e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40098f0 tx=0x7fe2e4008040 comp rx=0 tx=0).stop 2024-09-16T01:54:57.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 -- 172.21.15.42:0/2382946674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40d1420 msgr2=0x7fe2f41f7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40d1420 0x7fe2f41f7250 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800e730 tx=0x7fe2e800ebf0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 -- 172.21.15.42:0/2382946674 shutdown_connections 2024-09-16T01:54:57.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe2e006c2b0 0x7fe2e006e770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2f4161a20 0x7fe2f406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2f40d1420 0x7fe2f41f7250 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 --2- 172.21.15.42:0/2382946674 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe2f40cf160 0x7fe2f41f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 -- 172.21.15.42:0/2382946674 >> 172.21.15.42:0/2382946674 conn(0x7fe2f409d850 msgr2=0x7fe2f415caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:57.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.795+0000 7fe2fa247640 1 -- 172.21.15.42:0/2382946674 shutdown_connections 2024-09-16T01:54:57.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.796+0000 7fe2fa247640 1 -- 172.21.15.42:0/2382946674 wait complete. 2024-09-16T01:54:57.808 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T01:54:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.913+0000 7fe02db8d640 1 Processor -- start 2024-09-16T01:54:57.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.913+0000 7fe02db8d640 1 -- start start 2024-09-16T01:54:57.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe02db8d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe02815e6c0 0x7fe0280cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe02db8d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0280d5090 0x7fe0280cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe02db8d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0280cfef0 con 0x7fe0280cfae0 2024-09-16T01:54:57.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe02db8d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe0280cf400 con 0x7fe02815e6c0 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe02db8d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe0280b10d0 con 0x7fe0280d5090 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe0277fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe02815e6c0 0x7fe0280cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe027fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe0280cfae0 0x7fe0281622d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36512/0 (socket says 172.21.15.42:36512) 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe0277fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe02815e6c0 0x7fe0280cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57638/0 (socket says 172.21.15.42:57638) 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe027fff640 1 -- 172.21.15.42:0/3617016618 learned_addr learned my addr 172.21.15.42:0/3617016618 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe026ffd640 1 --2- 172.21.15.42:0/3617016618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0280d5090 0x7fe0280cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe0277fe640 1 -- 172.21.15.42:0/3617016618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0280d5090 msgr2=0x7fe0280cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe0277fe640 1 --2- 172.21.15.42:0/3617016618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0280d5090 0x7fe0280cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe0277fe640 1 -- 172.21.15.42:0/3617016618 >> v1:172.21.15.42:6789/0 conn(0x7fe0280cfae0 legacy=0x7fe0281622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe0277fe640 1 -- 172.21.15.42:0/3617016618 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0280d34f0 con 0x7fe02815e6c0 2024-09-16T01:54:57.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.914+0000 7fe0267fc640 1 -- 172.21.15.42:0/3617016618 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388477708 0 0) 0x7fe020001490 con 0x7fe0280cfae0 2024-09-16T01:54:57.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.915+0000 7fe0277fe640 1 --2- 172.21.15.42:0/3617016618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 0x7fe0280cebb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe0280b1250 tx=0x7fe01802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5574b6b76d78cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:57.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.915+0000 7fe0267fc640 1 -- 172.21.15.42:0/3617016618 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018037070 con 0x7fe02815e6c0 2024-09-16T01:54:57.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.915+0000 7fe0267fc640 1 -- 172.21.15.42:0/3617016618 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01802adb0 con 0x7fe02815e6c0 2024-09-16T01:54:57.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.915+0000 7fe0267fc640 1 -- 172.21.15.42:0/3617016618 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018032660 con 0x7fe02815e6c0 2024-09-16T01:54:57.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.916+0000 7fe02db8d640 1 -- 172.21.15.42:0/3617016618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 msgr2=0x7fe0280cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.916+0000 7fe02db8d640 1 --2- 172.21.15.42:0/3617016618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 0x7fe0280cebb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe0280b1250 tx=0x7fe01802a060 comp rx=0 tx=0).stop 2024-09-16T01:54:57.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.916+0000 7fe02db8d640 1 -- 172.21.15.42:0/3617016618 shutdown_connections 2024-09-16T01:54:57.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.916+0000 7fe02db8d640 1 --2- 172.21.15.42:0/3617016618 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0280d5090 0x7fe0280cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.916+0000 7fe02db8d640 1 --2- 172.21.15.42:0/3617016618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 0x7fe0280cebb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.916+0000 7fe02db8d640 1 -- 172.21.15.42:0/3617016618 >> 172.21.15.42:0/3617016618 conn(0x7fe02808bfc0 msgr2=0x7fe0280d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:57.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.916+0000 7fe02db8d640 1 -- 172.21.15.42:0/3617016618 shutdown_connections 2024-09-16T01:54:57.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.916+0000 7fe02db8d640 1 -- 172.21.15.42:0/3617016618 wait complete. 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.917+0000 7fe02db8d640 1 Processor -- start 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.917+0000 7fe02db8d640 1 -- start start 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe02db8d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0280cfae0 0x7fe02814a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe02db8d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0280d5090 0x7fe0280cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe02db8d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 0x7fe0280cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe02db8d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe0280cf0f0 con 0x7fe02815e6c0 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe02db8d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe0280d3a70 con 0x7fe0280cfae0 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe02db8d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe02815eaa0 con 0x7fe0280d5090 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe027fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 0x7fe0280cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe027fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 0x7fe0280cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57648/0 (socket says 172.21.15.42:57648) 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe027fff640 1 -- 172.21.15.42:0/4143697107 learned_addr learned my addr 172.21.15.42:0/4143697107 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:57.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe026ffd640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0280d5090 0x7fe0280cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe0277fe640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0280cfae0 0x7fe02814a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe027fff640 1 -- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0280d5090 msgr2=0x7fe0280cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe027fff640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0280d5090 0x7fe0280cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe027fff640 1 -- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0280cfae0 msgr2=0x7fe02814a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe027fff640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0280cfae0 0x7fe02814a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.918+0000 7fe027fff640 1 -- 172.21.15.42:0/4143697107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0280ced60 con 0x7fe02815e6c0 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.919+0000 7fe027fff640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 0x7fe0280cbb70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c730 tx=0x7fe02000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.919+0000 7fe00ffff640 1 -- 172.21.15.42:0/4143697107 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020018070 con 0x7fe02815e6c0 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.919+0000 7fe00ffff640 1 -- 172.21.15.42:0/4143697107 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02000ce40 con 0x7fe02815e6c0 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.919+0000 7fe02db8d640 1 -- 172.21.15.42:0/4143697107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0281e90f0 con 0x7fe02815e6c0 2024-09-16T01:54:57.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.919+0000 7fe00ffff640 1 -- 172.21.15.42:0/4143697107 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02000a880 con 0x7fe02815e6c0 2024-09-16T01:54:57.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.919+0000 7fe02db8d640 1 -- 172.21.15.42:0/4143697107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02814a2e0 con 0x7fe02815e6c0 2024-09-16T01:54:57.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.920+0000 7fe02db8d640 1 -- 172.21.15.42:0/4143697107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02814a5a0 con 0x7fe02815e6c0 2024-09-16T01:54:57.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.920+0000 7fe00ffff640 1 -- 172.21.15.42:0/4143697107 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe02001b070 con 0x7fe02815e6c0 2024-09-16T01:54:57.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.921+0000 7fe00ffff640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe01406c2b0 0x7fe01406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:57.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.921+0000 7fe00ffff640 1 -- 172.21.15.42:0/4143697107 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe02008ad00 con 0x7fe02815e6c0 2024-09-16T01:54:57.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.921+0000 7fe0277fe640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe01406c2b0 0x7fe01406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:57.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.921+0000 7fe0277fe640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe01406c2b0 0x7fe01406e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe018034000 tx=0x7fe01802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:57.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:57.925+0000 7fe00ffff640 1 -- 172.21.15.42:0/4143697107 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe02814a5a0 con 0x7fe02815e6c0 2024-09-16T01:54:58.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.101+0000 7fe02db8d640 1 -- 172.21.15.42:0/4143697107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe0280cf5a0 con 0x7fe02815e6c0 2024-09-16T01:54:58.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.102+0000 7fe00ffff640 1 -- 172.21.15.42:0/4143697107 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fe0280cfef0 con 0x7fe02815e6c0 2024-09-16T01:54:58.103 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-09-16T01:54:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.103+0000 7fe02db8d640 1 -- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe01406c2b0 msgr2=0x7fe01406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.103+0000 7fe02db8d640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe01406c2b0 0x7fe01406e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe018034000 tx=0x7fe01802e000 comp rx=0 tx=0).stop 2024-09-16T01:54:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.103+0000 7fe02db8d640 1 -- 172.21.15.42:0/4143697107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 msgr2=0x7fe0280cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.103+0000 7fe02db8d640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 0x7fe0280cbb70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c730 tx=0x7fe02000cbf0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.104+0000 7fe02db8d640 1 -- 172.21.15.42:0/4143697107 shutdown_connections 2024-09-16T01:54:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.104+0000 7fe02db8d640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe01406c2b0 0x7fe01406e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.104+0000 7fe02db8d640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe02815e6c0 0x7fe0280cbb70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.104+0000 7fe02db8d640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe0280d5090 0x7fe0280cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.104+0000 7fe02db8d640 1 --2- 172.21.15.42:0/4143697107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0280cfae0 0x7fe02814a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.104+0000 7fe02db8d640 1 -- 172.21.15.42:0/4143697107 >> 172.21.15.42:0/4143697107 conn(0x7fe02808bfc0 msgr2=0x7fe0280b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.104+0000 7fe02db8d640 1 -- 172.21.15.42:0/4143697107 shutdown_connections 2024-09-16T01:54:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.104+0000 7fe02db8d640 1 -- 172.21.15.42:0/4143697107 wait complete. 2024-09-16T01:54:58.116 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-16T01:54:58.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.221+0000 7f998aa47640 1 Processor -- start 2024-09-16T01:54:58.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.222+0000 7f998aa47640 1 -- start start 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.222+0000 7f998aa47640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 0x7f99840af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.222+0000 7f998aa47640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f99840cc930 0x7f99840ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.222+0000 7f998aa47640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99841632a0 con 0x7f9984162e60 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.222+0000 7f998aa47640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9984163550 con 0x7f99840cc930 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.222+0000 7f998aa47640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9984163830 con 0x7f998415cfc0 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f99837fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9984162e60 0x7f99840b3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57842/0 (socket says 172.21.15.42:57842) 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f99837fe640 1 -- 172.21.15.42:0/523105965 learned_addr learned my addr 172.21.15.42:0/523105965 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f9988fe4640 1 --2- 172.21.15.42:0/523105965 >> v2:172.21.15.107:3300/0 conn(0x7f99840cc930 0x7f99840ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f9983fff640 1 --2- 172.21.15.42:0/523105965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 0x7f99840af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f9982ffd640 1 -- 172.21.15.42:0/523105965 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 666918101 0 0) 0x7f99841632a0 con 0x7f9984162e60 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f9982ffd640 1 -- 172.21.15.42:0/523105965 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f996c003520 con 0x7f9984162e60 2024-09-16T01:54:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f9988fe4640 1 -- 172.21.15.42:0/523105965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 msgr2=0x7f99840af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:58.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f9988fe4640 1 --2- 172.21.15.42:0/523105965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 0x7f99840af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f9988fe4640 1 -- 172.21.15.42:0/523105965 >> v1:172.21.15.42:6789/0 conn(0x7f9984162e60 legacy=0x7f99840b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f9982ffd640 1 -- 172.21.15.42:0/523105965 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 527735284 0 0) 0x7f996c003520 con 0x7f9984162e60 2024-09-16T01:54:58.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f9988fe4640 1 -- 172.21.15.42:0/523105965 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9984163b10 con 0x7f99840cc930 2024-09-16T01:54:58.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.223+0000 7f9983fff640 1 --2- 172.21.15.42:0/523105965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 0x7f99840af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:54:58.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.224+0000 7f9988fe4640 1 --2- 172.21.15.42:0/523105965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99840cc930 0x7f99840ccde0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f997c009d90 tx=0x7f997c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7cdb1bb036b6e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:58.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.224+0000 7f9982ffd640 1 -- 172.21.15.42:0/523105965 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978001670 con 0x7f99840cc930 2024-09-16T01:54:58.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.224+0000 7f9982ffd640 1 -- 172.21.15.42:0/523105965 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997c007540 con 0x7f99840cc930 2024-09-16T01:54:58.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.224+0000 7f9982ffd640 1 -- 172.21.15.42:0/523105965 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c007910 con 0x7f99840cc930 2024-09-16T01:54:58.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.225+0000 7f998aa47640 1 -- 172.21.15.42:0/523105965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99840cc930 msgr2=0x7f99840ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.225+0000 7f998aa47640 1 --2- 172.21.15.42:0/523105965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99840cc930 0x7f99840ccde0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f997c009d90 tx=0x7f997c02a5f0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.225+0000 7f998aa47640 1 -- 172.21.15.42:0/523105965 shutdown_connections 2024-09-16T01:54:58.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.225+0000 7f998aa47640 1 --2- 172.21.15.42:0/523105965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99840cc930 0x7f99840ccde0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.225+0000 7f998aa47640 1 --2- 172.21.15.42:0/523105965 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 0x7f99840af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.225+0000 7f998aa47640 1 -- 172.21.15.42:0/523105965 >> 172.21.15.42:0/523105965 conn(0x7f998406bdf0 msgr2=0x7f998406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:58.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.225+0000 7f998aa47640 1 -- 172.21.15.42:0/523105965 shutdown_connections 2024-09-16T01:54:58.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.225+0000 7f998aa47640 1 -- 172.21.15.42:0/523105965 wait complete. 2024-09-16T01:54:58.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.227+0000 7f998aa47640 1 Processor -- start 2024-09-16T01:54:58.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.227+0000 7f998aa47640 1 -- start start 2024-09-16T01:54:58.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.227+0000 7f998aa47640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99840cc930 0x7f99841f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.227+0000 7f998aa47640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 0x7f99840b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.227+0000 7f998aa47640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9984162e60 0x7f99840b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.227+0000 7f998aa47640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9984072e40 con 0x7f99840cc930 2024-09-16T01:54:58.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.227+0000 7f998aa47640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f99840b3e10 con 0x7f9984162e60 2024-09-16T01:54:58.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.227+0000 7f998aa47640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9984072fc0 con 0x7f998415cfc0 2024-09-16T01:54:58.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9983fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99840cc930 0x7f99841f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9983fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99840cc930 0x7f99841f87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56556/0 (socket says 172.21.15.42:56556) 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9983fff640 1 -- 172.21.15.42:0/2540560554 learned_addr learned my addr 172.21.15.42:0/2540560554 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9988fe4640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9984162e60 0x7f99840b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f99837fe640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 0x7f99840b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9983fff640 1 -- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 msgr2=0x7f99840b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9983fff640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 0x7f99840b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9983fff640 1 -- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9984162e60 msgr2=0x7f99840b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9983fff640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9984162e60 0x7f99840b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9983fff640 1 -- 172.21.15.42:0/2540560554 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9984158cf0 con 0x7f99840cc930 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9983fff640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99840cc930 0x7f99841f87c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f997400ec10 tx=0x7f997400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9980ff9640 1 -- 172.21.15.42:0/2540560554 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974017070 con 0x7f99840cc930 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9980ff9640 1 -- 172.21.15.42:0/2540560554 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997400cc30 con 0x7f99840cc930 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f998aa47640 1 -- 172.21.15.42:0/2540560554 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9984158fd0 con 0x7f99840cc930 2024-09-16T01:54:58.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f9980ff9640 1 -- 172.21.15.42:0/2540560554 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974013470 con 0x7f99840cc930 2024-09-16T01:54:58.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.228+0000 7f998aa47640 1 -- 172.21.15.42:0/2540560554 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f998406ddc0 con 0x7f99840cc930 2024-09-16T01:54:58.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.229+0000 7f998aa47640 1 -- 172.21.15.42:0/2540560554 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9984050050 con 0x7f99840cc930 2024-09-16T01:54:58.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.230+0000 7f9980ff9640 1 -- 172.21.15.42:0/2540560554 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f997401a070 con 0x7f99840cc930 2024-09-16T01:54:58.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.231+0000 7f9980ff9640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f997006c2b0 0x7f997006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.231+0000 7f9980ff9640 1 -- 172.21.15.42:0/2540560554 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f997408bdb0 con 0x7f99840cc930 2024-09-16T01:54:58.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.231+0000 7f99837fe640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f997006c2b0 0x7f997006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.231+0000 7f99837fe640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f997006c2b0 0x7f997006e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9984070890 tx=0x7f9978009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:58.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.234+0000 7f9980ff9640 1 -- 172.21.15.42:0/2540560554 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9984050050 con 0x7f99840cc930 2024-09-16T01:54:58.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.411+0000 7f998aa47640 1 -- 172.21.15.42:0/2540560554 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f998415cb30 con 0x7f99840cc930 2024-09-16T01:54:58.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.412+0000 7f9980ff9640 1 -- 172.21.15.42:0/2540560554 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f997405a350 con 0x7f99840cc930 2024-09-16T01:54:58.413 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-09-16T01:54:58.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 -- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f997006c2b0 msgr2=0x7f997006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f997006c2b0 0x7f997006e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9984070890 tx=0x7f9978009040 comp rx=0 tx=0).stop 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 -- 172.21.15.42:0/2540560554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99840cc930 msgr2=0x7f99841f87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99840cc930 0x7f99841f87c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f997400ec10 tx=0x7f997400c520 comp rx=0 tx=0).stop 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 -- 172.21.15.42:0/2540560554 shutdown_connections 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f997006c2b0 0x7f997006e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9984162e60 0x7f99840b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f998415cfc0 0x7f99840b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 --2- 172.21.15.42:0/2540560554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99840cc930 0x7f99841f87c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 -- 172.21.15.42:0/2540560554 >> 172.21.15.42:0/2540560554 conn(0x7f998406bdf0 msgr2=0x7f99840ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 -- 172.21.15.42:0/2540560554 shutdown_connections 2024-09-16T01:54:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.414+0000 7f998aa47640 1 -- 172.21.15.42:0/2540560554 wait complete. 2024-09-16T01:54:58.427 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-09-16T01:54:58.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.530+0000 7f5813f76640 1 Processor -- start 2024-09-16T01:54:58.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.530+0000 7f5813f76640 1 -- start start 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5813f76640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f580c15e990 0x7f580c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5813f76640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f580c0ae140 0x7f580c0ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5813f76640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f580c0b6520 con 0x7f580c15e5b0 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5813f76640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f580c0b2c30 con 0x7f580c0ae140 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5813f76640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f580c0aeb30 con 0x7f580c15e990 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5812513640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f580c0ae140 0x7f580c0ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5812513640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f580c0ae140 0x7f580c0ae5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56572/0 (socket says 172.21.15.42:56572) 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5812513640 1 -- 172.21.15.42:0/1774088515 learned_addr learned my addr 172.21.15.42:0/1774088515 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5811511640 1 --2- 172.21.15.42:0/1774088515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f580c15e990 0x7f580c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5812513640 1 -- 172.21.15.42:0/1774088515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f580c15e990 msgr2=0x7f580c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5812513640 1 --2- 172.21.15.42:0/1774088515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f580c15e990 0x7f580c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5812513640 1 -- 172.21.15.42:0/1774088515 >> v1:172.21.15.107:6789/0 conn(0x7f580c15e5b0 legacy=0x7f580c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:58.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.531+0000 7f5812513640 1 -- 172.21.15.42:0/1774088515 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c0b1a40 con 0x7f580c0ae140 2024-09-16T01:54:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.532+0000 7f5812513640 1 --2- 172.21.15.42:0/1774088515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c0ae140 0x7f580c0ae5f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5804009e50 tx=0x7f580402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53a272924dd1a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.532+0000 7f5810d10640 1 -- 172.21.15.42:0/1774088515 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804036070 con 0x7f580c0ae140 2024-09-16T01:54:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.532+0000 7f5810d10640 1 -- 172.21.15.42:0/1774088515 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5804031600 con 0x7f580c0ae140 2024-09-16T01:54:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.532+0000 7f5810d10640 1 -- 172.21.15.42:0/1774088515 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58040319d0 con 0x7f580c0ae140 2024-09-16T01:54:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.533+0000 7f5813f76640 1 -- 172.21.15.42:0/1774088515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c0ae140 msgr2=0x7f580c0ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.533+0000 7f5813f76640 1 --2- 172.21.15.42:0/1774088515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c0ae140 0x7f580c0ae5f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5804009e50 tx=0x7f580402a6c0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.533+0000 7f5813f76640 1 -- 172.21.15.42:0/1774088515 shutdown_connections 2024-09-16T01:54:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.533+0000 7f5813f76640 1 --2- 172.21.15.42:0/1774088515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c0ae140 0x7f580c0ae5f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.533+0000 7f5813f76640 1 --2- 172.21.15.42:0/1774088515 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f580c15e990 0x7f580c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.533+0000 7f5813f76640 1 -- 172.21.15.42:0/1774088515 >> 172.21.15.42:0/1774088515 conn(0x7f580c073490 msgr2=0x7f580c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:58.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.533+0000 7f5813f76640 1 -- 172.21.15.42:0/1774088515 shutdown_connections 2024-09-16T01:54:58.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.533+0000 7f5813f76640 1 -- 172.21.15.42:0/1774088515 wait complete. 2024-09-16T01:54:58.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.534+0000 7f5813f76640 1 Processor -- start 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.534+0000 7f5813f76640 1 -- start start 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5813f76640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f580c0ae140 0x7f580c15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5813f76640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c15e5b0 0x7f580c1457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5813f76640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c15e990 0x7f580c145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5813f76640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f580c0b0490 con 0x7f580c15e5b0 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5813f76640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f580c0b2000 con 0x7f580c15e990 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5813f76640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f580c0b07e0 con 0x7f580c0ae140 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5811511640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c15e5b0 0x7f580c1457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5811511640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c15e5b0 0x7f580c1457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56576/0 (socket says 172.21.15.42:56576) 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5811511640 1 -- 172.21.15.42:0/1004748321 learned_addr learned my addr 172.21.15.42:0/1004748321 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5812513640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c15e990 0x7f580c145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5811d12640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f580c0ae140 0x7f580c15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5811511640 1 -- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f580c0ae140 msgr2=0x7f580c15ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5811511640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f580c0ae140 0x7f580c15ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5811511640 1 -- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c15e990 msgr2=0x7f580c145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5811511640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c15e990 0x7f580c145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.535+0000 7f5811511640 1 -- 172.21.15.42:0/1004748321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c161c10 con 0x7f580c15e5b0 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.536+0000 7f5811511640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c15e5b0 0x7f580c1457b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00c820 tx=0x7f57fc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.536+0000 7f58027fc640 1 -- 172.21.15.42:0/1004748321 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc004030 con 0x7f580c15e5b0 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.536+0000 7f58027fc640 1 -- 172.21.15.42:0/1004748321 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57fc0041d0 con 0x7f580c15e5b0 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.536+0000 7f58027fc640 1 -- 172.21.15.42:0/1004748321 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc007830 con 0x7f580c15e5b0 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.536+0000 7f5813f76640 1 -- 172.21.15.42:0/1004748321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580c161ef0 con 0x7f580c15e5b0 2024-09-16T01:54:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.536+0000 7f5813f76640 1 -- 172.21.15.42:0/1004748321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f580c0cb5a0 con 0x7f580c15e5b0 2024-09-16T01:54:58.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.537+0000 7f5813f76640 1 -- 172.21.15.42:0/1004748321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580c0ae5f0 con 0x7f580c15e5b0 2024-09-16T01:54:58.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.537+0000 7f58027fc640 1 -- 172.21.15.42:0/1004748321 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f57fc0079d0 con 0x7f580c15e5b0 2024-09-16T01:54:58.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.538+0000 7f58027fc640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f57f006c2b0 0x7f57f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:58.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.538+0000 7f58027fc640 1 -- 172.21.15.42:0/1004748321 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f57fc08b740 con 0x7f580c15e5b0 2024-09-16T01:54:58.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.538+0000 7f5811d12640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f57f006c2b0 0x7f57f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:58.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.539+0000 7f5811d12640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f57f006c2b0 0x7f57f006e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5808004f60 tx=0x7f5808007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:58.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.543+0000 7f58027fc640 1 -- 172.21.15.42:0/1004748321 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57fc015020 con 0x7f580c15e5b0 2024-09-16T01:54:58.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.805+0000 7f5813f76640 1 -- 172.21.15.42:0/1004748321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f580c15c4d0 con 0x7f580c15e5b0 2024-09-16T01:54:58.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.980+0000 7f58027fc640 1 -- 172.21.15.42:0/1004748321 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v54) ==== 145+0+0 (secure 0 0 0) 0x7f57fc059490 con 0x7f580c15e5b0 2024-09-16T01:54:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 -- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f57f006c2b0 msgr2=0x7f57f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f57f006c2b0 0x7f57f006e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5808004f60 tx=0x7f5808007e30 comp rx=0 tx=0).stop 2024-09-16T01:54:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 -- 172.21.15.42:0/1004748321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c15e5b0 msgr2=0x7f580c1457b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c15e5b0 0x7f580c1457b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00c820 tx=0x7f57fc00cce0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 -- 172.21.15.42:0/1004748321 shutdown_connections 2024-09-16T01:54:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f57f006c2b0 0x7f57f006e770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c15e990 0x7f580c145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f580c15e5b0 0x7f580c1457b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 --2- 172.21.15.42:0/1004748321 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f580c0ae140 0x7f580c15ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:58.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 -- 172.21.15.42:0/1004748321 >> 172.21.15.42:0/1004748321 conn(0x7f580c073490 msgr2=0x7f580c15ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:58.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 -- 172.21.15.42:0/1004748321 shutdown_connections 2024-09-16T01:54:58.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:58.982+0000 7f5813f76640 1 -- 172.21.15.42:0/1004748321 wait complete. 2024-09-16T01:54:58.995 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:54:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.101+0000 7f51f6aba640 1 Processor -- start 2024-09-16T01:54:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.101+0000 7f51f6aba640 1 -- start start 2024-09-16T01:54:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f6aba640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f51f0161ac0 0x7f51f00b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f6aba640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 0x7f51f006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f6aba640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f51f006c150 0x7f51f0162290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f6aba640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f51f006c5a0 con 0x7f51f0161ac0 2024-09-16T01:54:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f6aba640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f51f015f920 con 0x7f51f006c150 2024-09-16T01:54:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f6aba640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f51f015eff0 con 0x7f51f00b43b0 2024-09-16T01:54:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f4856640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f51f0161ac0 0x7f51f00b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f4856640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f51f0161ac0 0x7f51f00b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56590/0 (socket says 172.21.15.42:56590) 2024-09-16T01:54:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f4856640 1 -- 172.21.15.42:0/2595899368 learned_addr learned my addr 172.21.15.42:0/2595899368 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51effff640 1 --2- 172.21.15.42:0/2595899368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 0x7f51f006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f4856640 1 -- 172.21.15.42:0/2595899368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 msgr2=0x7f51f006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f5057640 1 --2- 172.21.15.42:0/2595899368 >> v2:172.21.15.107:3300/0 conn(0x7f51f006c150 0x7f51f0162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f4856640 1 --2- 172.21.15.42:0/2595899368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 0x7f51f006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f4856640 1 -- 172.21.15.42:0/2595899368 >> v2:172.21.15.107:3300/0 conn(0x7f51f006c150 msgr2=0x7f51f0162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f4856640 1 --2- 172.21.15.42:0/2595899368 >> v2:172.21.15.107:3300/0 conn(0x7f51f006c150 0x7f51f0162290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f4856640 1 -- 172.21.15.42:0/2595899368 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f015f2d0 con 0x7f51f0161ac0 2024-09-16T01:54:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51effff640 1 --2- 172.21.15.42:0/2595899368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 0x7f51f006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.102+0000 7f51f5057640 1 --2- 172.21.15.42:0/2595899368 >> v2:172.21.15.107:3300/0 conn(0x7f51f006c150 0x7f51f0162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:54:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.103+0000 7f51f4856640 1 --2- 172.21.15.42:0/2595899368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f0161ac0 0x7f51f00b2650 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f51f00b21c0 tx=0x7f51e402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873862d070df9804 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.103+0000 7f51ef7fe640 1 -- 172.21.15.42:0/2595899368 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4037070 con 0x7f51f0161ac0 2024-09-16T01:54:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.103+0000 7f51ef7fe640 1 -- 172.21.15.42:0/2595899368 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e4032440 con 0x7f51f0161ac0 2024-09-16T01:54:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.103+0000 7f51ef7fe640 1 -- 172.21.15.42:0/2595899368 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4032810 con 0x7f51f0161ac0 2024-09-16T01:54:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.104+0000 7f51f6aba640 1 -- 172.21.15.42:0/2595899368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f0161ac0 msgr2=0x7f51f00b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.104+0000 7f51f6aba640 1 --2- 172.21.15.42:0/2595899368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f0161ac0 0x7f51f00b2650 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f51f00b21c0 tx=0x7f51e402a140 comp rx=0 tx=0).stop 2024-09-16T01:54:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.104+0000 7f51f6aba640 1 -- 172.21.15.42:0/2595899368 shutdown_connections 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.104+0000 7f51f6aba640 1 --2- 172.21.15.42:0/2595899368 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 0x7f51f006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.104+0000 7f51f6aba640 1 --2- 172.21.15.42:0/2595899368 >> v2:172.21.15.107:3300/0 conn(0x7f51f006c150 0x7f51f0162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.104+0000 7f51f6aba640 1 --2- 172.21.15.42:0/2595899368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f0161ac0 0x7f51f00b2650 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.104+0000 7f51f6aba640 1 -- 172.21.15.42:0/2595899368 >> 172.21.15.42:0/2595899368 conn(0x7f51f009aa30 msgr2=0x7f51f00b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.104+0000 7f51f6aba640 1 -- 172.21.15.42:0/2595899368 shutdown_connections 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.104+0000 7f51f6aba640 1 -- 172.21.15.42:0/2595899368 wait complete. 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.105+0000 7f51f6aba640 1 Processor -- start 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.105+0000 7f51f6aba640 1 -- start start 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f6aba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f006c150 0x7f51f009e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f6aba640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 0x7f51f00d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f6aba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f0161ac0 0x7f51f00cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f6aba640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f51f0161ea0 con 0x7f51f006c150 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f6aba640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f51f015ece0 con 0x7f51f0161ac0 2024-09-16T01:54:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f6aba640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f51f0162020 con 0x7f51f00b43b0 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f4856640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f006c150 0x7f51f009e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f4856640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f006c150 0x7f51f009e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56604/0 (socket says 172.21.15.42:56604) 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f4856640 1 -- 172.21.15.42:0/3790413046 learned_addr learned my addr 172.21.15.42:0/3790413046 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f5057640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f0161ac0 0x7f51f00cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51effff640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 0x7f51f00d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f4856640 1 -- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 msgr2=0x7f51f00d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f4856640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 0x7f51f00d17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f4856640 1 -- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f0161ac0 msgr2=0x7f51f00cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f4856640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f0161ac0 0x7f51f00cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f4856640 1 -- 172.21.15.42:0/3790413046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f00ca6f0 con 0x7f51f006c150 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.106+0000 7f51f4856640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f006c150 0x7f51f009e730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f51e402a180 tx=0x7f51e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.107+0000 7f51ed7fa640 1 -- 172.21.15.42:0/3790413046 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4037040 con 0x7f51f006c150 2024-09-16T01:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.107+0000 7f51ed7fa640 1 -- 172.21.15.42:0/3790413046 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e4042070 con 0x7f51f006c150 2024-09-16T01:54:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.107+0000 7f51f6aba640 1 -- 172.21.15.42:0/3790413046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f00ca9d0 con 0x7f51f006c150 2024-09-16T01:54:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.107+0000 7f51ed7fa640 1 -- 172.21.15.42:0/3790413046 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4030bb0 con 0x7f51f006c150 2024-09-16T01:54:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.107+0000 7f51f6aba640 1 -- 172.21.15.42:0/3790413046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f00cb270 con 0x7f51f006c150 2024-09-16T01:54:59.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.108+0000 7f51f6aba640 1 -- 172.21.15.42:0/3790413046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f006bc10 con 0x7f51f006c150 2024-09-16T01:54:59.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.108+0000 7f51ed7fa640 1 -- 172.21.15.42:0/3790413046 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f51e4047460 con 0x7f51f006c150 2024-09-16T01:54:59.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.109+0000 7f51ed7fa640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f51d406c2b0 0x7f51d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.109+0000 7f51ed7fa640 1 -- 172.21.15.42:0/3790413046 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f51e40ac270 con 0x7f51f006c150 2024-09-16T01:54:59.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.109+0000 7f51effff640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f51d406c2b0 0x7f51d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.110+0000 7f51effff640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f51d406c2b0 0x7f51d406e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f51f009d710 tx=0x7f51dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:59.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.117+0000 7f51ed7fa640 1 -- 172.21.15.42:0/3790413046 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51e407a060 con 0x7f51f006c150 2024-09-16T01:54:59.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.293+0000 7f51f6aba640 1 -- 172.21.15.42:0/3790413046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f51f00cad60 con 0x7f51f006c150 2024-09-16T01:54:59.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.296+0000 7f51ed7fa640 1 -- 172.21.15.42:0/3790413046 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f51e40990d0 con 0x7f51f006c150 2024-09-16T01:54:59.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 -- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f51d406c2b0 msgr2=0x7f51d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f51d406c2b0 0x7f51d406e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f51f009d710 tx=0x7f51dc008040 comp rx=0 tx=0).stop 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 -- 172.21.15.42:0/3790413046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f006c150 msgr2=0x7f51f009e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f006c150 0x7f51f009e730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f51e402a180 tx=0x7f51e40046c0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 -- 172.21.15.42:0/3790413046 shutdown_connections 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f51d406c2b0 0x7f51d406e770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51f0161ac0 0x7f51f00cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51f00b43b0 0x7f51f00d17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 --2- 172.21.15.42:0/3790413046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f006c150 0x7f51f009e730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 -- 172.21.15.42:0/3790413046 >> 172.21.15.42:0/3790413046 conn(0x7f51f009aa30 msgr2=0x7f51f00b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 -- 172.21.15.42:0/3790413046 shutdown_connections 2024-09-16T01:54:59.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.299+0000 7f51f6aba640 1 -- 172.21.15.42:0/3790413046 wait complete. 2024-09-16T01:54:59.311 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:54:59.311 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:54:59.353 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:54:59.396 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:54:59.396 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:54:59.396 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:54:59.413 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:54:59.413 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:54:59.470 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:54:59.470 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:54:59.526 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:54:59.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.667+0000 7fd406598640 1 Processor -- start 2024-09-16T01:54:59.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.667+0000 7fd406598640 1 -- start start 2024-09-16T01:54:59.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.668+0000 7fd406598640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd4000d30f0 0x7fd4000b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.668+0000 7fd406598640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4000d3690 con 0x7fd4000b64c0 2024-09-16T01:54:59.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.668+0000 7fd406598640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4000d3970 con 0x7fd40015e5f0 2024-09-16T01:54:59.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.668+0000 7fd406598640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd40006d530 con 0x7fd4000d30f0 2024-09-16T01:54:59.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd404b35640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd4000b64c0 0x7fd40006d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57858/0 (socket says 172.21.15.42:57858) 2024-09-16T01:54:59.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd404b35640 1 -- 172.21.15.42:0/1738391177 learned_addr learned my addr 172.21.15.42:0/1738391177 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:54:59.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3ff7fe640 1 --2- 172.21.15.42:0/1738391177 >> v2:172.21.15.107:3300/0 conn(0x7fd4000d30f0 0x7fd4000b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038256812 0 0) 0x7fd4000d3690 con 0x7fd4000b64c0 2024-09-16T01:54:59.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3e8003520 con 0x7fd4000b64c0 2024-09-16T01:54:59.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3721385382 0 0) 0x7fd3e8003520 con 0x7fd4000b64c0 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 >> v2:172.21.15.107:3300/0 conn(0x7fd4000d30f0 msgr2=0x7fd4000b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 --2- 172.21.15.42:0/1738391177 >> v2:172.21.15.107:3300/0 conn(0x7fd4000d30f0 0x7fd4000b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 >> v1:172.21.15.107:6789/0 conn(0x7fd40015e5f0 legacy=0x7fd4000d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40006cee0 con 0x7fd4000b64c0 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7fd3f80019f0 con 0x7fd4000b64c0 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 >> v1:172.21.15.42:6789/0 conn(0x7fd4000b64c0 legacy=0x7fd40006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd3e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3e8004800 0x7fd3e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3e80051c0 0x7fd3e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd40006d530 con 0x7fd3e80039b0 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e800c060 con 0x7fd3e80051c0 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e800c260 con 0x7fd3e8004800 2024-09-16T01:54:59.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.669+0000 7fd3fffff640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd3e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.670+0000 7fd404b35640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3e80051c0 0x7fd3e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.670+0000 7fd3ff7fe640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3e8004800 0x7fd3e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.670+0000 7fd3fffff640 1 -- 172.21.15.42:0/1738391177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3e8004800 msgr2=0x7fd3e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.670+0000 7fd3fffff640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd3e8004800 0x7fd3e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.670+0000 7fd3fffff640 1 -- 172.21.15.42:0/1738391177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3e80051c0 msgr2=0x7fd3e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:54:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.670+0000 7fd3fffff640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3e80051c0 0x7fd3e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.670+0000 7fd3fffff640 1 -- 172.21.15.42:0/1738391177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e8003520 con 0x7fd3e80039b0 2024-09-16T01:54:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.670+0000 7fd404b35640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3e80051c0 0x7fd3e800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:54:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.670+0000 7fd404b35640 1 -- 172.21.15.42:0/1738391177 reap_dead start 2024-09-16T01:54:59.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.670+0000 7fd3fffff640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd3e8003dd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0001750 tx=0x7fd3e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e4cb791e44203f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:59.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.671+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0001370 con 0x7fd3e80039b0 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.671+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f00052d0 con 0x7fd3e80039b0 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.671+0000 7fd3feffd640 1 -- 172.21.15.42:0/1738391177 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f002abc0 con 0x7fd3e80039b0 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.671+0000 7fd406598640 1 -- 172.21.15.42:0/1738391177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 msgr2=0x7fd3e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.671+0000 7fd406598640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd3e8003dd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0001750 tx=0x7fd3e8005830 comp rx=0 tx=0).stop 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.671+0000 7fd406598640 1 -- 172.21.15.42:0/1738391177 shutdown_connections 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.671+0000 7fd406598640 1 --2- 172.21.15.42:0/1738391177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd3e8003dd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.671+0000 7fd406598640 1 -- 172.21.15.42:0/1738391177 >> 172.21.15.42:0/1738391177 conn(0x7fd40008bfc0 msgr2=0x7fd4000d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.672+0000 7fd406598640 1 -- 172.21.15.42:0/1738391177 shutdown_connections 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.672+0000 7fd406598640 1 -- 172.21.15.42:0/1738391177 wait complete. 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.673+0000 7fd406598640 1 Processor -- start 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.673+0000 7fd406598640 1 -- start start 2024-09-16T01:54:59.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd406598640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd4001f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd406598640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4000ca730 0x7fd4000cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd406598640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd40015d440 0x7fd40015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd406598640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd4000b5f80 con 0x7fd3e80039b0 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd406598640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd40015e9d0 con 0x7fd4000ca730 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd406598640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd4000b6100 con 0x7fd40015d440 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd4001f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd4001f7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56620/0 (socket says 172.21.15.42:56620) 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fffff640 1 -- 172.21.15.42:0/1976695830 learned_addr learned my addr 172.21.15.42:0/1976695830 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3ff7fe640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4000ca730 0x7fd4000cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd404b35640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd40015d440 0x7fd40015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fffff640 1 -- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd40015d440 msgr2=0x7fd40015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fffff640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd40015d440 0x7fd40015d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fffff640 1 -- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4000ca730 msgr2=0x7fd4000cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fffff640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4000ca730 0x7fd4000cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fffff640 1 -- 172.21.15.42:0/1976695830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4001f79c0 con 0x7fd3e80039b0 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fffff640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd4001f7480 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0001870 tx=0x7fd3f0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fcff9640 1 -- 172.21.15.42:0/1976695830 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f003f030 con 0x7fd3e80039b0 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fcff9640 1 -- 172.21.15.42:0/1976695830 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f0005480 con 0x7fd3e80039b0 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd406598640 1 -- 172.21.15.42:0/1976695830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4000c8ef0 con 0x7fd3e80039b0 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.674+0000 7fd3fcff9640 1 -- 172.21.15.42:0/1976695830 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0037040 con 0x7fd3e80039b0 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.675+0000 7fd406598640 1 -- 172.21.15.42:0/1976695830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4000c9c50 con 0x7fd3e80039b0 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.675+0000 7fd406598640 1 -- 172.21.15.42:0/1976695830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40015de00 con 0x7fd3e80039b0 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.676+0000 7fd3fcff9640 1 -- 172.21.15.42:0/1976695830 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd3f0042070 con 0x7fd3e80039b0 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.676+0000 7fd3fcff9640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3ec06c2e0 0x7fd3ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:54:59.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.677+0000 7fd3fcff9640 1 -- 172.21.15.42:0/1976695830 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd3f0007640 con 0x7fd3e80039b0 2024-09-16T01:54:59.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.677+0000 7fd3ff7fe640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3ec06c2e0 0x7fd3ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:54:59.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.677+0000 7fd3ff7fe640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3ec06c2e0 0x7fd3ec06e7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd4001e9e70 tx=0x7fd3f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:54:59.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.681+0000 7fd3fcff9640 1 -- 172.21.15.42:0/1976695830 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3f004a020 con 0x7fd3e80039b0 2024-09-16T01:54:59.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.867+0000 7fd406598640 1 -- 172.21.15.42:0/1976695830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd4000d4dd0 con 0x7fd3e80039b0 2024-09-16T01:54:59.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.868+0000 7fd3fcff9640 1 -- 172.21.15.42:0/1976695830 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fd3f0078f60 con 0x7fd3e80039b0 2024-09-16T01:54:59.869 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-16T01:54:59.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.869+0000 7fd406598640 1 -- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3ec06c2e0 msgr2=0x7fd3ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.869+0000 7fd406598640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3ec06c2e0 0x7fd3ec06e7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd4001e9e70 tx=0x7fd3f4008040 comp rx=0 tx=0).stop 2024-09-16T01:54:59.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.869+0000 7fd406598640 1 -- 172.21.15.42:0/1976695830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 msgr2=0x7fd4001f7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:54:59.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.869+0000 7fd406598640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd4001f7480 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0001870 tx=0x7fd3f0001120 comp rx=0 tx=0).stop 2024-09-16T01:54:59.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.870+0000 7fd406598640 1 -- 172.21.15.42:0/1976695830 shutdown_connections 2024-09-16T01:54:59.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.870+0000 7fd406598640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd3ec06c2e0 0x7fd3ec06e7a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.870+0000 7fd406598640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd40015d440 0x7fd40015d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.870+0000 7fd406598640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4000ca730 0x7fd4000cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.870+0000 7fd406598640 1 --2- 172.21.15.42:0/1976695830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3e80039b0 0x7fd4001f7480 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:54:59.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.870+0000 7fd406598640 1 -- 172.21.15.42:0/1976695830 >> 172.21.15.42:0/1976695830 conn(0x7fd40008bfc0 msgr2=0x7fd4000b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:54:59.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.870+0000 7fd406598640 1 -- 172.21.15.42:0/1976695830 shutdown_connections 2024-09-16T01:54:59.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:54:59.870+0000 7fd406598640 1 -- 172.21.15.42:0/1976695830 wait complete. 2024-09-16T01:54:59.882 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:54:59.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:59.882 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-16T01:54:59.909 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:54:59.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:54:59.909 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:54:59.965 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:54:59.965 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:54:59.985 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:54:59.985 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:00.044 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:55:00.044 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:00.103 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:55:00.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.206+0000 7f1b43554640 1 Processor -- start 2024-09-16T01:55:00.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.206+0000 7f1b43554640 1 -- start start 2024-09-16T01:55:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.207+0000 7f1b43554640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072700 0x7f1b3c15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.207+0000 7f1b43554640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3c146140 con 0x7f1b3c072de0 2024-09-16T01:55:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.207+0000 7f1b43554640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3c0cd740 con 0x7f1b3c072320 2024-09-16T01:55:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.207+0000 7f1b43554640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3c0cda20 con 0x7f1b3c072700 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.207+0000 7f1b40aef640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1b3c072de0 0x7f1b3c15d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57874/0 (socket says 172.21.15.42:57874) 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.207+0000 7f1b40aef640 1 -- 172.21.15.42:0/3179867844 learned_addr learned my addr 172.21.15.42:0/3179867844 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.207+0000 7f1b41af1640 1 --2- 172.21.15.42:0/3179867844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072700 0x7f1b3c15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.208+0000 7f1b3bfff640 1 -- 172.21.15.42:0/3179867844 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597952093 0 0) 0x7f1b3c146140 con 0x7f1b3c072de0 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.208+0000 7f1b3bfff640 1 -- 172.21.15.42:0/3179867844 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b24003520 con 0x7f1b3c072de0 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.208+0000 7f1b3bfff640 1 -- 172.21.15.42:0/3179867844 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760638809 0 0) 0x7f1b3c0cd740 con 0x7f1b3c072320 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.208+0000 7f1b3bfff640 1 -- 172.21.15.42:0/3179867844 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b3c146140 con 0x7f1b3c072320 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.208+0000 7f1b3bfff640 1 -- 172.21.15.42:0/3179867844 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2941240942 0 0) 0x7f1b24003520 con 0x7f1b3c072de0 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.208+0000 7f1b41af1640 1 -- 172.21.15.42:0/3179867844 >> v1:172.21.15.107:6789/0 conn(0x7f1b3c072320 legacy=0x7f1b3c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.208+0000 7f1b41af1640 1 -- 172.21.15.42:0/3179867844 >> v1:172.21.15.42:6789/0 conn(0x7f1b3c072de0 legacy=0x7f1b3c15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.208+0000 7f1b41af1640 1 -- 172.21.15.42:0/3179867844 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c0cdd00 con 0x7f1b3c072700 2024-09-16T01:55:00.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b41af1640 1 --2- 172.21.15.42:0/3179867844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072700 0x7f1b3c15d8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009dc0 tx=0x7f1b2c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b613b3b4b6aa5947 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:00.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b3bfff640 1 -- 172.21.15.42:0/3179867844 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30001670 con 0x7f1b3c072700 2024-09-16T01:55:00.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b3bfff640 1 -- 172.21.15.42:0/3179867844 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2c007540 con 0x7f1b3c072700 2024-09-16T01:55:00.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b3bfff640 1 -- 172.21.15.42:0/3179867844 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0078f0 con 0x7f1b3c072700 2024-09-16T01:55:00.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b43554640 1 -- 172.21.15.42:0/3179867844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072700 msgr2=0x7f1b3c15d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b43554640 1 --2- 172.21.15.42:0/3179867844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072700 0x7f1b3c15d8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009dc0 tx=0x7f1b2c02a5d0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b43554640 1 -- 172.21.15.42:0/3179867844 shutdown_connections 2024-09-16T01:55:00.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b43554640 1 --2- 172.21.15.42:0/3179867844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072700 0x7f1b3c15d8f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b43554640 1 -- 172.21.15.42:0/3179867844 >> 172.21.15.42:0/3179867844 conn(0x7f1b3c067d70 msgr2=0x7f1b3c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:00.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b43554640 1 -- 172.21.15.42:0/3179867844 shutdown_connections 2024-09-16T01:55:00.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.209+0000 7f1b43554640 1 -- 172.21.15.42:0/3179867844 wait complete. 2024-09-16T01:55:00.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.211+0000 7f1b43554640 1 Processor -- start 2024-09-16T01:55:00.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.211+0000 7f1b43554640 1 -- start start 2024-09-16T01:55:00.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.211+0000 7f1b43554640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072320 0x7f1b3c15bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.211+0000 7f1b43554640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b3c072700 0x7f1b3c1e7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.211+0000 7f1b43554640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b3c072de0 0x7f1b3c1e7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.211+0000 7f1b43554640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c15dfb0 con 0x7f1b3c072de0 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.211+0000 7f1b43554640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c15de30 con 0x7f1b3c072700 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.211+0000 7f1b43554640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3c15e130 con 0x7f1b3c072320 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b41af1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b3c072de0 0x7f1b3c1e7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b41af1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b3c072de0 0x7f1b3c1e7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56624/0 (socket says 172.21.15.42:56624) 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b41af1640 1 -- 172.21.15.42:0/1628658221 learned_addr learned my addr 172.21.15.42:0/1628658221 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b412f0640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072320 0x7f1b3c15bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b40aef640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b3c072700 0x7f1b3c1e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b41af1640 1 -- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072320 msgr2=0x7f1b3c15bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b41af1640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072320 0x7f1b3c15bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b41af1640 1 -- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b3c072700 msgr2=0x7f1b3c1e7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b41af1640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b3c072700 0x7f1b3c1e7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b41af1640 1 -- 172.21.15.42:0/1628658221 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c0ca4e0 con 0x7f1b3c072de0 2024-09-16T01:55:00.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b41af1640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b3c072de0 0x7f1b3c1e7c90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009ee0 tx=0x7f1b2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:00.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b39ffb640 1 -- 172.21.15.42:0/1628658221 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c040070 con 0x7f1b3c072de0 2024-09-16T01:55:00.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b39ffb640 1 -- 172.21.15.42:0/1628658221 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2c031c40 con 0x7f1b3c072de0 2024-09-16T01:55:00.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b43554640 1 -- 172.21.15.42:0/1628658221 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3c0ca7c0 con 0x7f1b3c072de0 2024-09-16T01:55:00.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.212+0000 7f1b39ffb640 1 -- 172.21.15.42:0/1628658221 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c009450 con 0x7f1b3c072de0 2024-09-16T01:55:00.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.213+0000 7f1b43554640 1 -- 172.21.15.42:0/1628658221 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3c0cad80 con 0x7f1b3c072de0 2024-09-16T01:55:00.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.213+0000 7f1b43554640 1 -- 172.21.15.42:0/1628658221 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b3c0cce60 con 0x7f1b3c072de0 2024-09-16T01:55:00.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.214+0000 7f1b39ffb640 1 -- 172.21.15.42:0/1628658221 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1b2c039040 con 0x7f1b3c072de0 2024-09-16T01:55:00.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.214+0000 7f1b39ffb640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b2806c2b0 0x7f1b2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.215+0000 7f1b39ffb640 1 -- 172.21.15.42:0/1628658221 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1b2c0ac990 con 0x7f1b3c072de0 2024-09-16T01:55:00.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.215+0000 7f1b412f0640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b2806c2b0 0x7f1b2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.215+0000 7f1b412f0640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b2806c2b0 0x7f1b2806e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b340011e0 tx=0x7f1b34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:00.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.219+0000 7f1b39ffb640 1 -- 172.21.15.42:0/1628658221 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b2c07a800 con 0x7f1b3c072de0 2024-09-16T01:55:00.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.409+0000 7f1b43554640 1 -- 172.21.15.42:0/1628658221 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1b3c0cc400 con 0x7f1b3c072de0 2024-09-16T01:55:00.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.409+0000 7f1b39ffb640 1 -- 172.21.15.42:0/1628658221 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f1b2c07eb00 con 0x7f1b3c072de0 2024-09-16T01:55:00.411 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-16T01:55:00.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 -- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b2806c2b0 msgr2=0x7f1b2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b2806c2b0 0x7f1b2806e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b340011e0 tx=0x7f1b34009040 comp rx=0 tx=0).stop 2024-09-16T01:55:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 -- 172.21.15.42:0/1628658221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b3c072de0 msgr2=0x7f1b3c1e7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b3c072de0 0x7f1b3c1e7c90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009ee0 tx=0x7f1b2c004a40 comp rx=0 tx=0).stop 2024-09-16T01:55:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 -- 172.21.15.42:0/1628658221 shutdown_connections 2024-09-16T01:55:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b2806c2b0 0x7f1b2806e770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b3c072de0 0x7f1b3c1e7c90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b3c072700 0x7f1b3c1e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 --2- 172.21.15.42:0/1628658221 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1b3c072320 0x7f1b3c15bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 -- 172.21.15.42:0/1628658221 >> 172.21.15.42:0/1628658221 conn(0x7f1b3c067d70 msgr2=0x7f1b3c144180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 -- 172.21.15.42:0/1628658221 shutdown_connections 2024-09-16T01:55:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.412+0000 7f1b43554640 1 -- 172.21.15.42:0/1628658221 wait complete. 2024-09-16T01:55:00.424 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:55:00.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:00.425 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-16T01:55:00.455 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:55:00.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:00.456 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:55:00.527 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:55:00.527 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:00.543 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:55:00.543 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:00.600 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:55:00.601 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:00.658 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:55:00.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.799+0000 7f556092a640 1 Processor -- start 2024-09-16T01:55:00.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.799+0000 7f556092a640 1 -- start start 2024-09-16T01:55:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f556092a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f555c15e5f0 0x7f555c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f556092a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f555c0d30f0 0x7f555c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f556092a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f555c0d3690 con 0x7f555c0b64c0 2024-09-16T01:55:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f556092a640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f555c06d530 con 0x7f555c0d30f0 2024-09-16T01:55:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f556092a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f555c0d3970 con 0x7f555c15e5f0 2024-09-16T01:55:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f5553fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f555c0d30f0 0x7f555c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f5553fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f555c0d30f0 0x7f555c0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56634/0 (socket says 172.21.15.42:56634) 2024-09-16T01:55:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f5553fff640 1 -- 172.21.15.42:0/674859519 learned_addr learned my addr 172.21.15.42:0/674859519 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:00.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f555a59c640 1 --2- 172.21.15.42:0/674859519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f555c15e5f0 0x7f555c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f5553fff640 1 -- 172.21.15.42:0/674859519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f555c15e5f0 msgr2=0x7f555c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:00.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f5553fff640 1 --2- 172.21.15.42:0/674859519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f555c15e5f0 0x7f555c0d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f5553fff640 1 -- 172.21.15.42:0/674859519 >> v1:172.21.15.107:6789/0 conn(0x7f555c0b64c0 legacy=0x7f555c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.800+0000 7f5553fff640 1 -- 172.21.15.42:0/674859519 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555c06cee0 con 0x7f555c0d30f0 2024-09-16T01:55:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.801+0000 7f5553fff640 1 --2- 172.21.15.42:0/674859519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0d30f0 0x7f555c0b5f80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5544009870 tx=0x7f554402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afa0bc840516bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.801+0000 7f5559d9b640 1 -- 172.21.15.42:0/674859519 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544037070 con 0x7f555c0d30f0 2024-09-16T01:55:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.801+0000 7f5559d9b640 1 -- 172.21.15.42:0/674859519 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5544032440 con 0x7f555c0d30f0 2024-09-16T01:55:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.801+0000 7f5559d9b640 1 -- 172.21.15.42:0/674859519 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544032810 con 0x7f555c0d30f0 2024-09-16T01:55:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.802+0000 7f556092a640 1 -- 172.21.15.42:0/674859519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0d30f0 msgr2=0x7f555c0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.802+0000 7f556092a640 1 --2- 172.21.15.42:0/674859519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0d30f0 0x7f555c0b5f80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5544009870 tx=0x7f554402a270 comp rx=0 tx=0).stop 2024-09-16T01:55:00.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.802+0000 7f556092a640 1 -- 172.21.15.42:0/674859519 shutdown_connections 2024-09-16T01:55:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.802+0000 7f556092a640 1 --2- 172.21.15.42:0/674859519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0d30f0 0x7f555c0b5f80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.802+0000 7f556092a640 1 --2- 172.21.15.42:0/674859519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f555c15e5f0 0x7f555c0d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.802+0000 7f556092a640 1 -- 172.21.15.42:0/674859519 >> 172.21.15.42:0/674859519 conn(0x7f555c08bfc0 msgr2=0x7f555c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.802+0000 7f556092a640 1 -- 172.21.15.42:0/674859519 shutdown_connections 2024-09-16T01:55:00.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.802+0000 7f556092a640 1 -- 172.21.15.42:0/674859519 wait complete. 2024-09-16T01:55:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.803+0000 7f556092a640 1 Processor -- start 2024-09-16T01:55:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.803+0000 7f556092a640 1 -- start start 2024-09-16T01:55:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f556092a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0b64c0 0x7f555c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f556092a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f555c0d30f0 0x7f555c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f556092a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f555c15e5f0 0x7f555c1602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f556092a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f555c0d5310 con 0x7f555c0b64c0 2024-09-16T01:55:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f556092a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f555c15e9d0 con 0x7f555c15e5f0 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f556092a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f555c06e9d0 con 0x7f555c0d30f0 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f555a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0b64c0 0x7f555c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f555a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0b64c0 0x7f555c159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56650/0 (socket says 172.21.15.42:56650) 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f555a59c640 1 -- 172.21.15.42:0/3724438723 learned_addr learned my addr 172.21.15.42:0/3724438723 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f555ad9d640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f555c15e5f0 0x7f555c1602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f5553fff640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f555c0d30f0 0x7f555c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f555a59c640 1 -- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f555c0d30f0 msgr2=0x7f555c15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f555a59c640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f555c0d30f0 0x7f555c15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f555a59c640 1 -- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f555c15e5f0 msgr2=0x7f555c1602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.804+0000 7f555a59c640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f555c15e5f0 0x7f555c1602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.805+0000 7f555a59c640 1 -- 172.21.15.42:0/3724438723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555c15f450 con 0x7f555c0b64c0 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.805+0000 7f555ad9d640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f555c15e5f0 0x7f555c1602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:00.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.805+0000 7f555a59c640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0b64c0 0x7f555c159050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f554c00d5f0 tx=0x7f554c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:00.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.805+0000 7f5552ffd640 1 -- 172.21.15.42:0/3724438723 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c0125f0 con 0x7f555c0b64c0 2024-09-16T01:55:00.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.805+0000 7f5552ffd640 1 -- 172.21.15.42:0/3724438723 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f554c019070 con 0x7f555c0b64c0 2024-09-16T01:55:00.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.805+0000 7f5552ffd640 1 -- 172.21.15.42:0/3724438723 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c0129d0 con 0x7f555c0b64c0 2024-09-16T01:55:00.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.805+0000 7f556092a640 1 -- 172.21.15.42:0/3724438723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555c15f730 con 0x7f555c0b64c0 2024-09-16T01:55:00.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.805+0000 7f556092a640 1 -- 172.21.15.42:0/3724438723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555c15fcf0 con 0x7f555c0b64c0 2024-09-16T01:55:00.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.806+0000 7f556092a640 1 -- 172.21.15.42:0/3724438723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f555c0b5f80 con 0x7f555c0b64c0 2024-09-16T01:55:00.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.806+0000 7f5552ffd640 1 -- 172.21.15.42:0/3724438723 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f554c012b70 con 0x7f555c0b64c0 2024-09-16T01:55:00.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.807+0000 7f5552ffd640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f553c06c2b0 0x7f553c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:00.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.807+0000 7f5552ffd640 1 -- 172.21.15.42:0/3724438723 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f554c08ba90 con 0x7f555c0b64c0 2024-09-16T01:55:00.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.807+0000 7f5553fff640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f553c06c2b0 0x7f553c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:00.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.808+0000 7f5553fff640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f553c06c2b0 0x7f553c06e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5544034000 tx=0x7f554402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:00.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:00.811+0000 7f5552ffd640 1 -- 172.21.15.42:0/3724438723 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f554c059f50 con 0x7f555c0b64c0 2024-09-16T01:55:01.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.000+0000 7f556092a640 1 -- 172.21.15.42:0/3724438723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f555c0d1a30 con 0x7f555c0b64c0 2024-09-16T01:55:01.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.001+0000 7f5552ffd640 1 -- 172.21.15.42:0/3724438723 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f554c059850 con 0x7f555c0b64c0 2024-09-16T01:55:01.002 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-16T01:55:01.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 -- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f553c06c2b0 msgr2=0x7f553c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f553c06c2b0 0x7f553c06e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5544034000 tx=0x7f554402e000 comp rx=0 tx=0).stop 2024-09-16T01:55:01.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 -- 172.21.15.42:0/3724438723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0b64c0 msgr2=0x7f555c159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0b64c0 0x7f555c159050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f554c00d5f0 tx=0x7f554c00dab0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 -- 172.21.15.42:0/3724438723 shutdown_connections 2024-09-16T01:55:01.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f553c06c2b0 0x7f553c06e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f555c15e5f0 0x7f555c1602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f555c0d30f0 0x7f555c15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 --2- 172.21.15.42:0/3724438723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f555c0b64c0 0x7f555c159050 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 -- 172.21.15.42:0/3724438723 >> 172.21.15.42:0/3724438723 conn(0x7f555c08bfc0 msgr2=0x7f555c0b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:01.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 -- 172.21.15.42:0/3724438723 shutdown_connections 2024-09-16T01:55:01.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.003+0000 7f556092a640 1 -- 172.21.15.42:0/3724438723 wait complete. 2024-09-16T01:55:01.015 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-16T01:55:01.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:01.016 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-16T01:55:01.042 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:55:01.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:01.043 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-16T01:55:01.099 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:55:01.099 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:01.119 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:55:01.119 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:01.178 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:55:01.178 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:01.236 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:55:01.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.339+0000 7f59b721e640 1 Processor -- start 2024-09-16T01:55:01.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.339+0000 7f59b721e640 1 -- start start 2024-09-16T01:55:01.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b721e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f59b015e760 0x7f59b006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b721e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f59b00d4fd0 0x7f59b00cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b721e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59b00d2700 con 0x7f59b00b3650 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b721e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f59b00cedb0 con 0x7f59b015e760 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b721e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f59b00cf090 con 0x7f59b00d4fd0 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b4fba640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f59b015e760 0x7f59b006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b57bb640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f59b00b3650 0x7f59b00d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57876/0 (socket says 172.21.15.42:57876) 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b57bb640 1 -- 172.21.15.42:0/145296505 learned_addr learned my addr 172.21.15.42:0/145296505 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59affff640 1 --2- 172.21.15.42:0/145296505 >> v2:172.21.15.107:3300/0 conn(0x7f59b00d4fd0 0x7f59b00cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b4fba640 1 -- 172.21.15.42:0/145296505 >> v2:172.21.15.107:3300/0 conn(0x7f59b00d4fd0 msgr2=0x7f59b00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b4fba640 1 --2- 172.21.15.42:0/145296505 >> v2:172.21.15.107:3300/0 conn(0x7f59b00d4fd0 0x7f59b00cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b4fba640 1 -- 172.21.15.42:0/145296505 >> v1:172.21.15.42:6789/0 conn(0x7f59b00b3650 legacy=0x7f59b00d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59b4fba640 1 -- 172.21.15.42:0/145296505 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b00b3c80 con 0x7f59b015e760 2024-09-16T01:55:01.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.340+0000 7f59af7fe640 1 -- 172.21.15.42:0/145296505 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382046270 0 0) 0x7f59a8001490 con 0x7f59b00b3650 2024-09-16T01:55:01.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.341+0000 7f59b4fba640 1 --2- 172.21.15.42:0/145296505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b015e760 0x7f59b006cdd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f59b008ca80 tx=0x7f59a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6af951748124dc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:01.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.341+0000 7f59af7fe640 1 -- 172.21.15.42:0/145296505 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a0037070 con 0x7f59b015e760 2024-09-16T01:55:01.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.341+0000 7f59af7fe640 1 -- 172.21.15.42:0/145296505 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a0032440 con 0x7f59b015e760 2024-09-16T01:55:01.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.341+0000 7f59af7fe640 1 -- 172.21.15.42:0/145296505 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a002ae60 con 0x7f59b015e760 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.342+0000 7f59b721e640 1 -- 172.21.15.42:0/145296505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b015e760 msgr2=0x7f59b006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.342+0000 7f59b721e640 1 --2- 172.21.15.42:0/145296505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b015e760 0x7f59b006cdd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f59b008ca80 tx=0x7f59a002a110 comp rx=0 tx=0).stop 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.342+0000 7f59b721e640 1 -- 172.21.15.42:0/145296505 shutdown_connections 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.342+0000 7f59b721e640 1 --2- 172.21.15.42:0/145296505 >> v2:172.21.15.107:3300/0 conn(0x7f59b00d4fd0 0x7f59b00cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.342+0000 7f59b721e640 1 --2- 172.21.15.42:0/145296505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b015e760 0x7f59b006cdd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.342+0000 7f59b721e640 1 -- 172.21.15.42:0/145296505 >> 172.21.15.42:0/145296505 conn(0x7f59b008bfc0 msgr2=0x7f59b00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.342+0000 7f59b721e640 1 -- 172.21.15.42:0/145296505 shutdown_connections 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.342+0000 7f59b721e640 1 -- 172.21.15.42:0/145296505 wait complete. 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.343+0000 7f59b721e640 1 Processor -- start 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.343+0000 7f59b721e640 1 -- start start 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59b721e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f59b00b3650 0x7f59b0160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59b721e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b00d4fd0 0x7f59b0156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59b721e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59b015e760 0x7f59b0157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59b721e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f59b00cff00 con 0x7f59b00d4fd0 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59b721e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f59b00cfd80 con 0x7f59b015e760 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59b721e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f59b00d35b0 con 0x7f59b00b3650 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59affff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b00d4fd0 0x7f59b0156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59affff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b00d4fd0 0x7f59b0156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56674/0 (socket says 172.21.15.42:56674) 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59affff640 1 -- 172.21.15.42:0/3540168353 learned_addr learned my addr 172.21.15.42:0/3540168353 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59b57bb640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59b015e760 0x7f59b0157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59b4fba640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f59b00b3650 0x7f59b0160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59affff640 1 -- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f59b00b3650 msgr2=0x7f59b0160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59affff640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f59b00b3650 0x7f59b0160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59affff640 1 -- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59b015e760 msgr2=0x7f59b0157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59affff640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59b015e760 0x7f59b0157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.344+0000 7f59affff640 1 -- 172.21.15.42:0/3540168353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b015ebe0 con 0x7f59b00d4fd0 2024-09-16T01:55:01.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.345+0000 7f59affff640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b00d4fd0 0x7f59b0156af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f59a400d800 tx=0x7f59a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:01.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.345+0000 7f59ad7fa640 1 -- 172.21.15.42:0/3540168353 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a400b6c0 con 0x7f59b00d4fd0 2024-09-16T01:55:01.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.345+0000 7f59ad7fa640 1 -- 172.21.15.42:0/3540168353 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a4019070 con 0x7f59b00d4fd0 2024-09-16T01:55:01.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.345+0000 7f59ad7fa640 1 -- 172.21.15.42:0/3540168353 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a400baa0 con 0x7f59b00d4fd0 2024-09-16T01:55:01.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.345+0000 7f59b721e640 1 -- 172.21.15.42:0/3540168353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b015eec0 con 0x7f59b00d4fd0 2024-09-16T01:55:01.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.345+0000 7f59b721e640 1 -- 172.21.15.42:0/3540168353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b015f480 con 0x7f59b00d4fd0 2024-09-16T01:55:01.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.346+0000 7f59b721e640 1 -- 172.21.15.42:0/3540168353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b00d3880 con 0x7f59b00d4fd0 2024-09-16T01:55:01.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.346+0000 7f59ad7fa640 1 -- 172.21.15.42:0/3540168353 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f59a400bc40 con 0x7f59b00d4fd0 2024-09-16T01:55:01.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.347+0000 7f59ad7fa640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f599c06c2b0 0x7f599c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.347+0000 7f59ad7fa640 1 -- 172.21.15.42:0/3540168353 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f59a408ba80 con 0x7f59b00d4fd0 2024-09-16T01:55:01.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.347+0000 7f59b4fba640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f599c06c2b0 0x7f599c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.348+0000 7f59b4fba640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f599c06c2b0 0x7f599c06e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f59a0034000 tx=0x7f59a002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:01.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.351+0000 7f59ad7fa640 1 -- 172.21.15.42:0/3540168353 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59a4059860 con 0x7f59b00d4fd0 2024-09-16T01:55:01.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.538+0000 7f59b721e640 1 -- 172.21.15.42:0/3540168353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f59b015db20 con 0x7f59b00d4fd0 2024-09-16T01:55:01.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.539+0000 7f59ad7fa640 1 -- 172.21.15.42:0/3540168353 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f59a4060080 con 0x7f59b00d4fd0 2024-09-16T01:55:01.540 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-16T01:55:01.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 -- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f599c06c2b0 msgr2=0x7f599c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f599c06c2b0 0x7f599c06e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f59a0034000 tx=0x7f59a002e000 comp rx=0 tx=0).stop 2024-09-16T01:55:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 -- 172.21.15.42:0/3540168353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b00d4fd0 msgr2=0x7f59b0156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b00d4fd0 0x7f59b0156af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f59a400d800 tx=0x7f59a400dcc0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 -- 172.21.15.42:0/3540168353 shutdown_connections 2024-09-16T01:55:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f599c06c2b0 0x7f599c06e770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59b015e760 0x7f59b0157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59b00d4fd0 0x7f59b0156af0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 --2- 172.21.15.42:0/3540168353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f59b00b3650 0x7f59b0160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 -- 172.21.15.42:0/3540168353 >> 172.21.15.42:0/3540168353 conn(0x7f59b008bfc0 msgr2=0x7f59b00b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 -- 172.21.15.42:0/3540168353 shutdown_connections 2024-09-16T01:55:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.541+0000 7f59b721e640 1 -- 172.21.15.42:0/3540168353 wait complete. 2024-09-16T01:55:01.553 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-16T01:55:01.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:01.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-16T01:55:01.585 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:55:01.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:01.586 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-16T01:55:01.644 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:55:01.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.745+0000 7faf0c349640 1 Processor -- start 2024-09-16T01:55:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.745+0000 7faf0c349640 1 -- start start 2024-09-16T01:55:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.746+0000 7faf0c349640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faf0415b0b0 0x7faf040cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.746+0000 7faf0c349640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faf04072d30 0x7faf0406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.746+0000 7faf0c349640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf040cd950 con 0x7faf040cd3f0 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.746+0000 7faf0c349640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7faf04072250 con 0x7faf0415b0b0 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.746+0000 7faf0c349640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faf04072530 con 0x7faf04072d30 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.747+0000 7faf0a8e6640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7faf040cd3f0 0x7faf0415edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57890/0 (socket says 172.21.15.42:57890) 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.747+0000 7faf0a0e5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faf0415b0b0 0x7faf040cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.747+0000 7faf0a8e6640 1 -- 172.21.15.42:0/157589661 learned_addr learned my addr 172.21.15.42:0/157589661 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.747+0000 7faf098e4640 1 --2- 172.21.15.42:0/157589661 >> v2:172.21.15.107:3300/0 conn(0x7faf04072d30 0x7faf0406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.747+0000 7faf0a0e5640 1 -- 172.21.15.42:0/157589661 >> v2:172.21.15.107:3300/0 conn(0x7faf04072d30 msgr2=0x7faf0406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.747+0000 7faf0a0e5640 1 --2- 172.21.15.42:0/157589661 >> v2:172.21.15.107:3300/0 conn(0x7faf04072d30 0x7faf0406f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.747+0000 7faf0a0e5640 1 -- 172.21.15.42:0/157589661 >> v1:172.21.15.42:6789/0 conn(0x7faf040cd3f0 legacy=0x7faf0415edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.747+0000 7faf0a0e5640 1 -- 172.21.15.42:0/157589661 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf04072810 con 0x7faf0415b0b0 2024-09-16T01:55:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.747+0000 7faf090e3640 1 -- 172.21.15.42:0/157589661 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441369902 0 0) 0x7faf040cd950 con 0x7faf040cd3f0 2024-09-16T01:55:01.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.748+0000 7faf0a0e5640 1 --2- 172.21.15.42:0/157589661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf0415b0b0 0x7faf040cceb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faf040d0320 tx=0x7faef402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebbacc38ba9b4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:01.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.748+0000 7faf090e3640 1 -- 172.21.15.42:0/157589661 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4007740 con 0x7faf0415b0b0 2024-09-16T01:55:01.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.748+0000 7faf090e3640 1 -- 172.21.15.42:0/157589661 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef40078e0 con 0x7faf0415b0b0 2024-09-16T01:55:01.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.748+0000 7faf090e3640 1 -- 172.21.15.42:0/157589661 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4007cb0 con 0x7faf0415b0b0 2024-09-16T01:55:01.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.748+0000 7faf0c349640 1 -- 172.21.15.42:0/157589661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf0415b0b0 msgr2=0x7faf040cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.748+0000 7faf0c349640 1 --2- 172.21.15.42:0/157589661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf0415b0b0 0x7faf040cceb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faf040d0320 tx=0x7faef402a680 comp rx=0 tx=0).stop 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.749+0000 7faf0c349640 1 -- 172.21.15.42:0/157589661 shutdown_connections 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.749+0000 7faf0c349640 1 --2- 172.21.15.42:0/157589661 >> v2:172.21.15.107:3300/0 conn(0x7faf04072d30 0x7faf0406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.749+0000 7faf0c349640 1 --2- 172.21.15.42:0/157589661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf0415b0b0 0x7faf040cceb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.749+0000 7faf0c349640 1 -- 172.21.15.42:0/157589661 >> 172.21.15.42:0/157589661 conn(0x7faf04067d70 msgr2=0x7faf0406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.749+0000 7faf0c349640 1 -- 172.21.15.42:0/157589661 shutdown_connections 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.749+0000 7faf0c349640 1 -- 172.21.15.42:0/157589661 wait complete. 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.750+0000 7faf0c349640 1 Processor -- start 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.750+0000 7faf0c349640 1 -- start start 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.750+0000 7faf0c349640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf04072d30 0x7faf040cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.750+0000 7faf0c349640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf040cd3f0 0x7faf041573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.750+0000 7faf0c349640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf0415b0b0 0x7faf040c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.750+0000 7faf0c349640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faf0415b610 con 0x7faf040cd3f0 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.750+0000 7faf0c349640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faf0415b490 con 0x7faf0415b0b0 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.750+0000 7faf0c349640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faf0406f700 con 0x7faf04072d30 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf098e4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf040cd3f0 0x7faf041573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf098e4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf040cd3f0 0x7faf041573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56684/0 (socket says 172.21.15.42:56684) 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf098e4640 1 -- 172.21.15.42:0/516322143 learned_addr learned my addr 172.21.15.42:0/516322143 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf0a0e5640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf04072d30 0x7faf040cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf0a8e6640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf0415b0b0 0x7faf040c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf098e4640 1 -- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf04072d30 msgr2=0x7faf040cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf098e4640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf04072d30 0x7faf040cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf098e4640 1 -- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf0415b0b0 msgr2=0x7faf040c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf098e4640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf0415b0b0 0x7faf040c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf098e4640 1 -- 172.21.15.42:0/516322143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf040ca1e0 con 0x7faf040cd3f0 2024-09-16T01:55:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf098e4640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf040cd3f0 0x7faf041573c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faef800d800 tx=0x7faef800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf02ffd640 1 -- 172.21.15.42:0/516322143 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef800b6c0 con 0x7faf040cd3f0 2024-09-16T01:55:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf02ffd640 1 -- 172.21.15.42:0/516322143 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef8019070 con 0x7faf040cd3f0 2024-09-16T01:55:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf0c349640 1 -- 172.21.15.42:0/516322143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf040ca4c0 con 0x7faf040cd3f0 2024-09-16T01:55:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf02ffd640 1 -- 172.21.15.42:0/516322143 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef800ba80 con 0x7faf040cd3f0 2024-09-16T01:55:01.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.751+0000 7faf0c349640 1 -- 172.21.15.42:0/516322143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf040cb810 con 0x7faf040cd3f0 2024-09-16T01:55:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.752+0000 7faf0c349640 1 -- 172.21.15.42:0/516322143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0406fa90 con 0x7faf040cd3f0 2024-09-16T01:55:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.753+0000 7faf02ffd640 1 -- 172.21.15.42:0/516322143 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faef800bc20 con 0x7faf040cd3f0 2024-09-16T01:55:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.753+0000 7faf02ffd640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7faef006c2b0 0x7faef006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.754+0000 7faf02ffd640 1 -- 172.21.15.42:0/516322143 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faef808bbb0 con 0x7faf040cd3f0 2024-09-16T01:55:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.754+0000 7faf0a0e5640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7faef006c2b0 0x7faef006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:01.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.754+0000 7faf0a0e5640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7faef006c2b0 0x7faef006e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faef4034000 tx=0x7faef4033040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.758+0000 7faf02ffd640 1 -- 172.21.15.42:0/516322143 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faef805a070 con 0x7faf040cd3f0 2024-09-16T01:55:01.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.969+0000 7faf0c349640 1 -- 172.21.15.42:0/516322143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf040cca70 con 0x7faf040cd3f0 2024-09-16T01:55:01.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.970+0000 7faf02ffd640 1 -- 172.21.15.42:0/516322143 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5231 (secure 0 0 0) 0x7faef8059970 con 0x7faf040cd3f0 2024-09-16T01:55:01.971 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:01.972 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-16T01:54:40:934131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:54:21.197115+0000","modified":"2024-09-16T01:54:40.289757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34157,"qdb_cluster":[34157]},"id":1}]} 2024-09-16T01:55:01.972 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-16T01:55:01.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 -- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7faef006c2b0 msgr2=0x7faef006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7faef006c2b0 0x7faef006e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faef4034000 tx=0x7faef4033040 comp rx=0 tx=0).stop 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 -- 172.21.15.42:0/516322143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf040cd3f0 msgr2=0x7faf041573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf040cd3f0 0x7faf041573c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faef800d800 tx=0x7faef800dcc0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 -- 172.21.15.42:0/516322143 shutdown_connections 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7faef006c2b0 0x7faef006e770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf0415b0b0 0x7faf040c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf040cd3f0 0x7faf041573c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 --2- 172.21.15.42:0/516322143 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faf04072d30 0x7faf040cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 -- 172.21.15.42:0/516322143 >> 172.21.15.42:0/516322143 conn(0x7faf04067d70 msgr2=0x7faf040b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 -- 172.21.15.42:0/516322143 shutdown_connections 2024-09-16T01:55:01.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:01.972+0000 7faf0c349640 1 -- 172.21.15.42:0/516322143 wait complete. 2024-09-16T01:55:01.984 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:02.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.085+0000 7f0e2f4e6640 1 Processor -- start 2024-09-16T01:55:02.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.086+0000 7f0e2f4e6640 1 -- start start 2024-09-16T01:55:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.086+0000 7f0e2f4e6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2815e5d0 0x7f0e280d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.086+0000 7f0e2f4e6640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e2806cec0 con 0x7f0e2809b140 2024-09-16T01:55:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.086+0000 7f0e2f4e6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e2806d1a0 con 0x7f0e2806df60 2024-09-16T01:55:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.086+0000 7f0e2f4e6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2806dad0 con 0x7f0e2815e5d0 2024-09-16T01:55:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e2da83640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0e2809b140 0x7f0e28168560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57902/0 (socket says 172.21.15.42:57902) 2024-09-16T01:55:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e2da83640 1 -- 172.21.15.42:0/546140916 learned_addr learned my addr 172.21.15.42:0/546140916 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e2d282640 1 --2- 172.21.15.42:0/546140916 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2815e5d0 0x7f0e280d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e27fff640 1 -- 172.21.15.42:0/546140916 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449260022 0 0) 0x7f0e2806cec0 con 0x7f0e2809b140 2024-09-16T01:55:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e27fff640 1 -- 172.21.15.42:0/546140916 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e10003520 con 0x7f0e2809b140 2024-09-16T01:55:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e27fff640 1 -- 172.21.15.42:0/546140916 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236842491 0 0) 0x7f0e2806d1a0 con 0x7f0e2806df60 2024-09-16T01:55:02.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e27fff640 1 -- 172.21.15.42:0/546140916 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e2806cec0 con 0x7f0e2806df60 2024-09-16T01:55:02.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e27fff640 1 -- 172.21.15.42:0/546140916 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 746722927 0 0) 0x7f0e10003520 con 0x7f0e2809b140 2024-09-16T01:55:02.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e2d282640 1 -- 172.21.15.42:0/546140916 >> v1:172.21.15.107:6789/0 conn(0x7f0e2806df60 legacy=0x7f0e2809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e2d282640 1 -- 172.21.15.42:0/546140916 >> v1:172.21.15.42:6789/0 conn(0x7f0e2809b140 legacy=0x7f0e28168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.087+0000 7f0e2d282640 1 -- 172.21.15.42:0/546140916 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2806d480 con 0x7f0e2815e5d0 2024-09-16T01:55:02.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.088+0000 7f0e2d282640 1 --2- 172.21.15.42:0/546140916 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2815e5d0 0x7f0e280d10f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0e180097d0 tx=0x7f0e1802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96023d3681fafaab server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:02.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.088+0000 7f0e27fff640 1 -- 172.21.15.42:0/546140916 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18037070 con 0x7f0e2815e5d0 2024-09-16T01:55:02.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.088+0000 7f0e27fff640 1 -- 172.21.15.42:0/546140916 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1802acc0 con 0x7f0e2815e5d0 2024-09-16T01:55:02.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.088+0000 7f0e27fff640 1 -- 172.21.15.42:0/546140916 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e200019f0 con 0x7f0e2815e5d0 2024-09-16T01:55:02.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.089+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/546140916 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2815e5d0 msgr2=0x7f0e280d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.089+0000 7f0e2f4e6640 1 --2- 172.21.15.42:0/546140916 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2815e5d0 0x7f0e280d10f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0e180097d0 tx=0x7f0e1802a230 comp rx=0 tx=0).stop 2024-09-16T01:55:02.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.089+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/546140916 shutdown_connections 2024-09-16T01:55:02.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.089+0000 7f0e2f4e6640 1 --2- 172.21.15.42:0/546140916 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2815e5d0 0x7f0e280d10f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.089+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/546140916 >> 172.21.15.42:0/546140916 conn(0x7f0e280d23a0 msgr2=0x7f0e280d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:02.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.089+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/546140916 shutdown_connections 2024-09-16T01:55:02.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.089+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/546140916 wait complete. 2024-09-16T01:55:02.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.090+0000 7f0e2f4e6640 1 Processor -- start 2024-09-16T01:55:02.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.090+0000 7f0e2f4e6640 1 -- start start 2024-09-16T01:55:02.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2f4e6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2806df60 0x7f0e28155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2f4e6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e2809b140 0x7f0e280c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2f4e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e2815e5d0 0x7f0e280b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2f4e6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2815eb30 con 0x7f0e2815e5d0 2024-09-16T01:55:02.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2f4e6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2815e9b0 con 0x7f0e2809b140 2024-09-16T01:55:02.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2f4e6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0e280d1630 con 0x7f0e2806df60 2024-09-16T01:55:02.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2da83640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e2815e5d0 0x7f0e280b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2da83640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e2815e5d0 0x7f0e280b6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56688/0 (socket says 172.21.15.42:56688) 2024-09-16T01:55:02.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2da83640 1 -- 172.21.15.42:0/1843546314 learned_addr learned my addr 172.21.15.42:0/1843546314 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:02.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2d282640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2806df60 0x7f0e28155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2ca81640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e2809b140 0x7f0e280c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2da83640 1 -- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2806df60 msgr2=0x7f0e28155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2da83640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2806df60 0x7f0e28155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2da83640 1 -- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e2809b140 msgr2=0x7f0e280c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2da83640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e2809b140 0x7f0e280c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2da83640 1 -- 172.21.15.42:0/1843546314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e280c6130 con 0x7f0e2815e5d0 2024-09-16T01:55:02.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.091+0000 7f0e2da83640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e2815e5d0 0x7f0e280b6d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0e20001f60 tx=0x7f0e2000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:02.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.092+0000 7f0e25ffb640 1 -- 172.21.15.42:0/1843546314 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20017070 con 0x7f0e2815e5d0 2024-09-16T01:55:02.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.092+0000 7f0e25ffb640 1 -- 172.21.15.42:0/1843546314 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e20012400 con 0x7f0e2815e5d0 2024-09-16T01:55:02.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.092+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/1843546314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e280c6410 con 0x7f0e2815e5d0 2024-09-16T01:55:02.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.092+0000 7f0e25ffb640 1 -- 172.21.15.42:0/1843546314 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e200127f0 con 0x7f0e2815e5d0 2024-09-16T01:55:02.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.092+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/1843546314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e280c69d0 con 0x7f0e2815e5d0 2024-09-16T01:55:02.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.093+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/1843546314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e280d10f0 con 0x7f0e2815e5d0 2024-09-16T01:55:02.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.093+0000 7f0e25ffb640 1 -- 172.21.15.42:0/1843546314 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0e2001a070 con 0x7f0e2815e5d0 2024-09-16T01:55:02.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.094+0000 7f0e25ffb640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0e1406c2b0 0x7f0e1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.094+0000 7f0e25ffb640 1 -- 172.21.15.42:0/1843546314 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0e2008b580 con 0x7f0e2815e5d0 2024-09-16T01:55:02.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.094+0000 7f0e2d282640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0e1406c2b0 0x7f0e1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.094+0000 7f0e2d282640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0e1406c2b0 0x7f0e1406e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0e18034000 tx=0x7f0e1802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:02.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.098+0000 7f0e25ffb640 1 -- 172.21.15.42:0/1843546314 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e200593f0 con 0x7f0e2815e5d0 2024-09-16T01:55:02.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.310+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/1843546314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e28070ea0 con 0x7f0e2815e5d0 2024-09-16T01:55:02.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.310+0000 7f0e25ffb640 1 -- 172.21.15.42:0/1843546314 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5231 (secure 0 0 0) 0x7f0e2005d6f0 con 0x7f0e2815e5d0 2024-09-16T01:55:02.312 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:02.312 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-16T01:54:40:934131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:54:21.197115+0000","modified":"2024-09-16T01:54:40.289757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34157,"qdb_cluster":[34157]},"id":1}]} 2024-09-16T01:55:02.312 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-16T01:55:02.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0e1406c2b0 msgr2=0x7f0e1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0e1406c2b0 0x7f0e1406e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0e18034000 tx=0x7f0e1802e000 comp rx=0 tx=0).stop 2024-09-16T01:55:02.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/1843546314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e2815e5d0 msgr2=0x7f0e280b6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e2815e5d0 0x7f0e280b6d00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0e20001f60 tx=0x7f0e2000cf90 comp rx=0 tx=0).stop 2024-09-16T01:55:02.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/1843546314 shutdown_connections 2024-09-16T01:55:02.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0e1406c2b0 0x7f0e1406e770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e2815e5d0 0x7f0e280b6d00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e2809b140 0x7f0e280c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 --2- 172.21.15.42:0/1843546314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e2806df60 0x7f0e28155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/1843546314 >> 172.21.15.42:0/1843546314 conn(0x7f0e280d23a0 msgr2=0x7f0e280d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:02.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/1843546314 shutdown_connections 2024-09-16T01:55:02.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.313+0000 7f0e2f4e6640 1 -- 172.21.15.42:0/1843546314 wait complete. 2024-09-16T01:55:02.325 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:55:02.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.426+0000 7febfbf4b640 1 Processor -- start 2024-09-16T01:55:02.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.426+0000 7febfbf4b640 1 -- start start 2024-09-16T01:55:02.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.427+0000 7febfbf4b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7febf4072d30 0x7febf406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.427+0000 7febfbf4b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7febf406f700 0x7febf415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.427+0000 7febfbf4b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febf406fae0 con 0x7febf415b300 2024-09-16T01:55:02.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.427+0000 7febfbf4b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7febf40728a0 con 0x7febf406f700 2024-09-16T01:55:02.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.427+0000 7febfbf4b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7febf40cdbe0 con 0x7febf4072d30 2024-09-16T01:55:02.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.427+0000 7febfa4e8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7febf406f700 0x7febf415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.427+0000 7febfa4e8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7febf406f700 0x7febf415b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56690/0 (socket says 172.21.15.42:56690) 2024-09-16T01:55:02.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.427+0000 7febfa4e8640 1 -- 172.21.15.42:0/2991795671 learned_addr learned my addr 172.21.15.42:0/2991795671 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:02.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.428+0000 7febf94e6640 1 --2- 172.21.15.42:0/2991795671 >> v2:172.21.15.107:3300/0 conn(0x7febf4072d30 0x7febf406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.428+0000 7febfa4e8640 1 -- 172.21.15.42:0/2991795671 >> v2:172.21.15.107:3300/0 conn(0x7febf4072d30 msgr2=0x7febf406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:02.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.428+0000 7febfa4e8640 1 --2- 172.21.15.42:0/2991795671 >> v2:172.21.15.107:3300/0 conn(0x7febf4072d30 0x7febf406f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.428+0000 7febfa4e8640 1 -- 172.21.15.42:0/2991795671 >> v1:172.21.15.107:6789/0 conn(0x7febf415b300 legacy=0x7febf40cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:02.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.428+0000 7febfa4e8640 1 -- 172.21.15.42:0/2991795671 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf40cd900 con 0x7febf406f700 2024-09-16T01:55:02.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.428+0000 7febf94e6640 1 --2- 172.21.15.42:0/2991795671 >> v2:172.21.15.107:3300/0 conn(0x7febf4072d30 0x7febf406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:02.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.428+0000 7febfa4e8640 1 --2- 172.21.15.42:0/2991795671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 0x7febf415b6e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7febf40b57c0 tx=0x7febe402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70032fb90259319e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febf8ce5640 1 -- 172.21.15.42:0/2991795671 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4036070 con 0x7febf406f700 2024-09-16T01:55:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febf8ce5640 1 -- 172.21.15.42:0/2991795671 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe4031600 con 0x7febf406f700 2024-09-16T01:55:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febf8ce5640 1 -- 172.21.15.42:0/2991795671 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe40319d0 con 0x7febf406f700 2024-09-16T01:55:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febfbf4b640 1 -- 172.21.15.42:0/2991795671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 msgr2=0x7febf415b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febfbf4b640 1 --2- 172.21.15.42:0/2991795671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 0x7febf415b6e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7febf40b57c0 tx=0x7febe402a660 comp rx=0 tx=0).stop 2024-09-16T01:55:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febfbf4b640 1 -- 172.21.15.42:0/2991795671 shutdown_connections 2024-09-16T01:55:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febfbf4b640 1 --2- 172.21.15.42:0/2991795671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 0x7febf415b6e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febfbf4b640 1 --2- 172.21.15.42:0/2991795671 >> v2:172.21.15.107:3300/0 conn(0x7febf4072d30 0x7febf406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febfbf4b640 1 -- 172.21.15.42:0/2991795671 >> 172.21.15.42:0/2991795671 conn(0x7febf4067d70 msgr2=0x7febf406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febfbf4b640 1 -- 172.21.15.42:0/2991795671 shutdown_connections 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.429+0000 7febfbf4b640 1 -- 172.21.15.42:0/2991795671 wait complete. 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.430+0000 7febfbf4b640 1 Processor -- start 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.431+0000 7febfbf4b640 1 -- start start 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.431+0000 7febfbf4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 0x7febf4141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.431+0000 7febfbf4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4072d30 0x7febf4157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.431+0000 7febfbf4b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febf415b300 0x7febf41551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.431+0000 7febfbf4b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7febf40cd5c0 con 0x7febf406f700 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.431+0000 7febfbf4b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7febf4072530 con 0x7febf4072d30 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.431+0000 7febfbf4b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7febf40cffe0 con 0x7febf415b300 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.431+0000 7febf9ce7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 0x7febf4141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.431+0000 7febf9ce7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 0x7febf4141d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56700/0 (socket says 172.21.15.42:56700) 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.431+0000 7febf9ce7640 1 -- 172.21.15.42:0/4091470338 learned_addr learned my addr 172.21.15.42:0/4091470338 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf94e6640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4072d30 0x7febf4157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febfa4e8640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febf415b300 0x7febf41551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf9ce7640 1 -- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febf415b300 msgr2=0x7febf41551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf9ce7640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febf415b300 0x7febf41551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf9ce7640 1 -- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4072d30 msgr2=0x7febf4157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf9ce7640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4072d30 0x7febf4157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf9ce7640 1 -- 172.21.15.42:0/4091470338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf41422d0 con 0x7febf406f700 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febfa4e8640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febf415b300 0x7febf41551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf94e6640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4072d30 0x7febf4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf9ce7640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 0x7febf4141d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7febec00c430 tx=0x7febec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf27fc640 1 -- 172.21.15.42:0/4091470338 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec011790 con 0x7febf406f700 2024-09-16T01:55:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf27fc640 1 -- 172.21.15.42:0/4091470338 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febec017070 con 0x7febf406f700 2024-09-16T01:55:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febf27fc640 1 -- 172.21.15.42:0/4091470338 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec011bb0 con 0x7febf406f700 2024-09-16T01:55:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febfbf4b640 1 -- 172.21.15.42:0/4091470338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf41584f0 con 0x7febf406f700 2024-09-16T01:55:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.432+0000 7febfbf4b640 1 -- 172.21.15.42:0/4091470338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf4156780 con 0x7febf406f700 2024-09-16T01:55:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.433+0000 7febfbf4b640 1 -- 172.21.15.42:0/4091470338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf40b5890 con 0x7febf406f700 2024-09-16T01:55:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.434+0000 7febf27fc640 1 -- 172.21.15.42:0/4091470338 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7febec01c460 con 0x7febf406f700 2024-09-16T01:55:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.434+0000 7febf27fc640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febe006c2e0 0x7febe006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.434+0000 7febf27fc640 1 -- 172.21.15.42:0/4091470338 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7febec08b6c0 con 0x7febf406f700 2024-09-16T01:55:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.434+0000 7febf94e6640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febe006c2e0 0x7febe006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.435+0000 7febf94e6640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febe006c2e0 0x7febe006e7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febe8006fd0 tx=0x7febe8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:02.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.438+0000 7febf27fc640 1 -- 172.21.15.42:0/4091470338 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7febec059a70 con 0x7febf406f700 2024-09-16T01:55:02.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.617+0000 7febfbf4b640 1 -- 172.21.15.42:0/4091470338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febf415c020 con 0x7febf406f700 2024-09-16T01:55:02.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.618+0000 7febf27fc640 1 -- 172.21.15.42:0/4091470338 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18586 (secure 0 0 0) 0x7febec059370 con 0x7febf406f700 2024-09-16T01:55:02.620 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:02.620 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:54:26.227596+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:55:02.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 -- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febe006c2e0 msgr2=0x7febe006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febe006c2e0 0x7febe006e7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febe8006fd0 tx=0x7febe8008040 comp rx=0 tx=0).stop 2024-09-16T01:55:02.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 -- 172.21.15.42:0/4091470338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 msgr2=0x7febf4141d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 0x7febf4141d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7febec00c430 tx=0x7febec00c8f0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 -- 172.21.15.42:0/4091470338 shutdown_connections 2024-09-16T01:55:02.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febe006c2e0 0x7febe006e7a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febf415b300 0x7febf41551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4072d30 0x7febf4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 --2- 172.21.15.42:0/4091470338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf406f700 0x7febf4141d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 -- 172.21.15.42:0/4091470338 >> 172.21.15.42:0/4091470338 conn(0x7febf4067d70 msgr2=0x7febf406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:02.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 -- 172.21.15.42:0/4091470338 shutdown_connections 2024-09-16T01:55:02.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.620+0000 7febfbf4b640 1 -- 172.21.15.42:0/4091470338 wait complete. 2024-09-16T01:55:02.633 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:55:02.633 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:02.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.733+0000 7fbd8fd91640 1 Processor -- start 2024-09-16T01:55:02.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.733+0000 7fbd8fd91640 1 -- start start 2024-09-16T01:55:02.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.734+0000 7fbd8fd91640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbd88161c80 0x7fbd8806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.734+0000 7fbd8fd91640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbd88162060 0x7fbd880b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.734+0000 7fbd8fd91640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8806e870 con 0x7fbd880b64b0 2024-09-16T01:55:02.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.734+0000 7fbd8fd91640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8806d9f0 con 0x7fbd88161c80 2024-09-16T01:55:02.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.734+0000 7fbd8fd91640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8806dcd0 con 0x7fbd88162060 2024-09-16T01:55:02.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.734+0000 7fbd8db2d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbd88161c80 0x7fbd8806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.734+0000 7fbd8db2d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbd88161c80 0x7fbd8806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56702/0 (socket says 172.21.15.42:56702) 2024-09-16T01:55:02.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.734+0000 7fbd8db2d640 1 -- 172.21.15.42:0/1232741080 learned_addr learned my addr 172.21.15.42:0/1232741080 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:02.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.735+0000 7fbd8d32c640 1 --2- 172.21.15.42:0/1232741080 >> v2:172.21.15.107:3300/0 conn(0x7fbd88162060 0x7fbd880b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.735+0000 7fbd8db2d640 1 -- 172.21.15.42:0/1232741080 >> v2:172.21.15.107:3300/0 conn(0x7fbd88162060 msgr2=0x7fbd880b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:02.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.735+0000 7fbd8db2d640 1 --2- 172.21.15.42:0/1232741080 >> v2:172.21.15.107:3300/0 conn(0x7fbd88162060 0x7fbd880b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.735+0000 7fbd8db2d640 1 -- 172.21.15.42:0/1232741080 >> v1:172.21.15.107:6789/0 conn(0x7fbd880b64b0 legacy=0x7fbd88162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:02.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.735+0000 7fbd8db2d640 1 -- 172.21.15.42:0/1232741080 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8806dfb0 con 0x7fbd88161c80 2024-09-16T01:55:02.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.735+0000 7fbd8d32c640 1 --2- 172.21.15.42:0/1232741080 >> v2:172.21.15.107:3300/0 conn(0x7fbd88162060 0x7fbd880b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:02.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.735+0000 7fbd8db2d640 1 --2- 172.21.15.42:0/1232741080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 0x7fbd8806e330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbd8808e830 tx=0x7fbd8402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c646eb621af68c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.735+0000 7fbd8cb2b640 1 -- 172.21.15.42:0/1232741080 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84037070 con 0x7fbd88161c80 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.736+0000 7fbd8cb2b640 1 -- 172.21.15.42:0/1232741080 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd84032440 con 0x7fbd88161c80 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.736+0000 7fbd8cb2b640 1 -- 172.21.15.42:0/1232741080 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84032810 con 0x7fbd88161c80 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.736+0000 7fbd8fd91640 1 -- 172.21.15.42:0/1232741080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 msgr2=0x7fbd8806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.736+0000 7fbd8fd91640 1 --2- 172.21.15.42:0/1232741080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 0x7fbd8806e330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbd8808e830 tx=0x7fbd8402a230 comp rx=0 tx=0).stop 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.736+0000 7fbd8fd91640 1 -- 172.21.15.42:0/1232741080 shutdown_connections 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.736+0000 7fbd8fd91640 1 --2- 172.21.15.42:0/1232741080 >> v2:172.21.15.107:3300/0 conn(0x7fbd88162060 0x7fbd880b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.736+0000 7fbd8fd91640 1 --2- 172.21.15.42:0/1232741080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 0x7fbd8806e330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.736+0000 7fbd8fd91640 1 -- 172.21.15.42:0/1232741080 >> 172.21.15.42:0/1232741080 conn(0x7fbd880d44f0 msgr2=0x7fbd880d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.736+0000 7fbd8fd91640 1 -- 172.21.15.42:0/1232741080 shutdown_connections 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.736+0000 7fbd8fd91640 1 -- 172.21.15.42:0/1232741080 wait complete. 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.737+0000 7fbd8fd91640 1 Processor -- start 2024-09-16T01:55:02.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.737+0000 7fbd8fd91640 1 -- start start 2024-09-16T01:55:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8fd91640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd880b64b0 0x7fbd881f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8fd91640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 0x7fbd88156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8fd91640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd88162060 0x7fbd8815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8fd91640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbd880d2a10 con 0x7fbd88161c80 2024-09-16T01:55:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8fd91640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbd880d2890 con 0x7fbd88162060 2024-09-16T01:55:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8fd91640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbd880b6960 con 0x7fbd880b64b0 2024-09-16T01:55:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8d32c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 0x7fbd88156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8d32c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 0x7fbd88156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56708/0 (socket says 172.21.15.42:56708) 2024-09-16T01:55:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8d32c640 1 -- 172.21.15.42:0/388367940 learned_addr learned my addr 172.21.15.42:0/388367940 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8e32e640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd88162060 0x7fbd8815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8db2d640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd880b64b0 0x7fbd881f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8d32c640 1 -- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd880b64b0 msgr2=0x7fbd881f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8d32c640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd880b64b0 0x7fbd881f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8d32c640 1 -- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd88162060 msgr2=0x7fbd8815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.738+0000 7fbd8d32c640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd88162060 0x7fbd8815ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.739+0000 7fbd8d32c640 1 -- 172.21.15.42:0/388367940 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd880c92c0 con 0x7fbd88161c80 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.739+0000 7fbd8e32e640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd88162060 0x7fbd8815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.739+0000 7fbd8d32c640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 0x7fbd88156640 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00c7c0 tx=0x7fbd7c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.739+0000 7fbd7a7fc640 1 -- 172.21.15.42:0/388367940 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c015070 con 0x7fbd88161c80 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.739+0000 7fbd7a7fc640 1 -- 172.21.15.42:0/388367940 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c007820 con 0x7fbd88161c80 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.739+0000 7fbd7a7fc640 1 -- 172.21.15.42:0/388367940 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c007bf0 con 0x7fbd88161c80 2024-09-16T01:55:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.739+0000 7fbd8fd91640 1 -- 172.21.15.42:0/388367940 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd880c7e80 con 0x7fbd88161c80 2024-09-16T01:55:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.739+0000 7fbd8fd91640 1 -- 172.21.15.42:0/388367940 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd880c8440 con 0x7fbd88161c80 2024-09-16T01:55:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.740+0000 7fbd8fd91640 1 -- 172.21.15.42:0/388367940 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd880ba450 con 0x7fbd88161c80 2024-09-16T01:55:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.740+0000 7fbd7a7fc640 1 -- 172.21.15.42:0/388367940 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd7c018070 con 0x7fbd88161c80 2024-09-16T01:55:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.741+0000 7fbd7a7fc640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbd6c06c2b0 0x7fbd6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.741+0000 7fbd7a7fc640 1 -- 172.21.15.42:0/388367940 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbd7c08b650 con 0x7fbd88161c80 2024-09-16T01:55:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.741+0000 7fbd8db2d640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbd6c06c2b0 0x7fbd6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:02.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.742+0000 7fbd8db2d640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbd6c06c2b0 0x7fbd6c06e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbd84034000 tx=0x7fbd8402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:02.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.745+0000 7fbd7a7fc640 1 -- 172.21.15.42:0/388367940 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd880c92c0 con 0x7fbd88161c80 2024-09-16T01:55:02.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.956+0000 7fbd8fd91640 1 -- 172.21.15.42:0/388367940 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd880d31f0 con 0x7fbd88161c80 2024-09-16T01:55:02.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.956+0000 7fbd7a7fc640 1 -- 172.21.15.42:0/388367940 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5231 (secure 0 0 0) 0x7fbd7c059a80 con 0x7fbd88161c80 2024-09-16T01:55:02.958 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:02.958 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-16T01:54:40:934131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:54:21.197115+0000","modified":"2024-09-16T01:54:40.289757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34157,"qdb_cluster":[34157]},"id":1}]} 2024-09-16T01:55:02.958 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-16T01:55:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 -- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbd6c06c2b0 msgr2=0x7fbd6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbd6c06c2b0 0x7fbd6c06e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbd84034000 tx=0x7fbd8402e000 comp rx=0 tx=0).stop 2024-09-16T01:55:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 -- 172.21.15.42:0/388367940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 msgr2=0x7fbd88156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 0x7fbd88156640 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00c7c0 tx=0x7fbd7c00cc80 comp rx=0 tx=0).stop 2024-09-16T01:55:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 -- 172.21.15.42:0/388367940 shutdown_connections 2024-09-16T01:55:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbd6c06c2b0 0x7fbd6c06e770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd88162060 0x7fbd8815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd88161c80 0x7fbd88156640 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 --2- 172.21.15.42:0/388367940 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd880b64b0 0x7fbd881f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:02.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 -- 172.21.15.42:0/388367940 >> 172.21.15.42:0/388367940 conn(0x7fbd880d44f0 msgr2=0x7fbd880b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:02.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 -- 172.21.15.42:0/388367940 shutdown_connections 2024-09-16T01:55:02.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:02.958+0000 7fbd8fd91640 1 -- 172.21.15.42:0/388367940 wait complete. 2024-09-16T01:55:02.971 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.076+0000 7fe1196a6640 1 Processor -- start 2024-09-16T01:55:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.076+0000 7fe1196a6640 1 -- start start 2024-09-16T01:55:03.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.077+0000 7fe1196a6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe1140b43f0 0x7fe11409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.077+0000 7fe1196a6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe1140b5050 0x7fe11415b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.077+0000 7fe1196a6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1140b3830 con 0x7fe11415b340 2024-09-16T01:55:03.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.077+0000 7fe1196a6640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe1140b5bd0 con 0x7fe1140b43f0 2024-09-16T01:55:03.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.077+0000 7fe1196a6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe1140b5610 con 0x7fe1140b5050 2024-09-16T01:55:03.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.077+0000 7fe1127fc640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe1140b43f0 0x7fe11409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.077+0000 7fe1127fc640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe1140b43f0 0x7fe11409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56720/0 (socket says 172.21.15.42:56720) 2024-09-16T01:55:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.077+0000 7fe1127fc640 1 -- 172.21.15.42:0/3087433271 learned_addr learned my addr 172.21.15.42:0/3087433271 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.077+0000 7fe1137fe640 1 --2- 172.21.15.42:0/3087433271 >> v2:172.21.15.107:3300/0 conn(0x7fe1140b5050 0x7fe11415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.078+0000 7fe1127fc640 1 -- 172.21.15.42:0/3087433271 >> v2:172.21.15.107:3300/0 conn(0x7fe1140b5050 msgr2=0x7fe11415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.078+0000 7fe1127fc640 1 --2- 172.21.15.42:0/3087433271 >> v2:172.21.15.107:3300/0 conn(0x7fe1140b5050 0x7fe11415b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.078+0000 7fe1127fc640 1 -- 172.21.15.42:0/3087433271 >> v1:172.21.15.107:6789/0 conn(0x7fe11415b340 legacy=0x7fe1140b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.078+0000 7fe1127fc640 1 -- 172.21.15.42:0/3087433271 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1140b58f0 con 0x7fe1140b43f0 2024-09-16T01:55:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.078+0000 7fe1137fe640 1 --2- 172.21.15.42:0/3087433271 >> v2:172.21.15.107:3300/0 conn(0x7fe1140b5050 0x7fe11415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.078+0000 7fe1127fc640 1 --2- 172.21.15.42:0/3087433271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1140b43f0 0x7fe11409aa30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe1140719c0 tx=0x7fe10802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2a4bbff2ff81d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe111ffb640 1 -- 172.21.15.42:0/3087433271 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108033640 con 0x7fe1140b43f0 2024-09-16T01:55:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe111ffb640 1 -- 172.21.15.42:0/3087433271 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe108038070 con 0x7fe1140b43f0 2024-09-16T01:55:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe111ffb640 1 -- 172.21.15.42:0/3087433271 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108033a00 con 0x7fe1140b43f0 2024-09-16T01:55:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe1196a6640 1 -- 172.21.15.42:0/3087433271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1140b43f0 msgr2=0x7fe11409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe1196a6640 1 --2- 172.21.15.42:0/3087433271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1140b43f0 0x7fe11409aa30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe1140719c0 tx=0x7fe10802c8b0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe1196a6640 1 -- 172.21.15.42:0/3087433271 shutdown_connections 2024-09-16T01:55:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe1196a6640 1 --2- 172.21.15.42:0/3087433271 >> v2:172.21.15.107:3300/0 conn(0x7fe1140b5050 0x7fe11415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe1196a6640 1 --2- 172.21.15.42:0/3087433271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1140b43f0 0x7fe11409aa30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe1196a6640 1 -- 172.21.15.42:0/3087433271 >> 172.21.15.42:0/3087433271 conn(0x7fe114073490 msgr2=0x7fe1140b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe1196a6640 1 -- 172.21.15.42:0/3087433271 shutdown_connections 2024-09-16T01:55:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.079+0000 7fe1196a6640 1 -- 172.21.15.42:0/3087433271 wait complete. 2024-09-16T01:55:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.081+0000 7fe1196a6640 1 Processor -- start 2024-09-16T01:55:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.081+0000 7fe1196a6640 1 -- start start 2024-09-16T01:55:03.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.081+0000 7fe1196a6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1140b43f0 0x7fe1140d0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.081+0000 7fe1196a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1140b5050 0x7fe1141558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.081+0000 7fe1196a6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe11415b340 0x7fe1141530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.081+0000 7fe1196a6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1140cdb30 con 0x7fe11415b340 2024-09-16T01:55:03.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.081+0000 7fe1196a6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe11415d8f0 con 0x7fe1140b5050 2024-09-16T01:55:03.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.081+0000 7fe1196a6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe1140cdcb0 con 0x7fe1140b43f0 2024-09-16T01:55:03.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.081+0000 7fe1137fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe11415b340 0x7fe1141530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1137fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe11415b340 0x7fe1141530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56726/0 (socket says 172.21.15.42:56726) 2024-09-16T01:55:03.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1137fe640 1 -- 172.21.15.42:0/858854271 learned_addr learned my addr 172.21.15.42:0/858854271 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:03.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1127fc640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1140b5050 0x7fe1141558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe112ffd640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1140b43f0 0x7fe1140d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1137fe640 1 -- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1140b43f0 msgr2=0x7fe1140d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1137fe640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1140b43f0 0x7fe1140d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1137fe640 1 -- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1140b5050 msgr2=0x7fe1141558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1137fe640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1140b5050 0x7fe1141558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1137fe640 1 -- 172.21.15.42:0/858854271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1140ceeb0 con 0x7fe11415b340 2024-09-16T01:55:03.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1137fe640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe11415b340 0x7fe1141530b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009fa0 tx=0x7fe10c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:03.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe0fb7fe640 1 -- 172.21.15.42:0/858854271 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c01a070 con 0x7fe11415b340 2024-09-16T01:55:03.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe0fb7fe640 1 -- 172.21.15.42:0/858854271 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10c003bb0 con 0x7fe11415b340 2024-09-16T01:55:03.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1196a6640 1 -- 172.21.15.42:0/858854271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1140cf170 con 0x7fe11415b340 2024-09-16T01:55:03.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe0fb7fe640 1 -- 172.21.15.42:0/858854271 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c004030 con 0x7fe11415b340 2024-09-16T01:55:03.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.082+0000 7fe1196a6640 1 -- 172.21.15.42:0/858854271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1140cf730 con 0x7fe11415b340 2024-09-16T01:55:03.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.083+0000 7fe1196a6640 1 -- 172.21.15.42:0/858854271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe11409aa30 con 0x7fe11415b340 2024-09-16T01:55:03.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.084+0000 7fe0fb7fe640 1 -- 172.21.15.42:0/858854271 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe10c01d070 con 0x7fe11415b340 2024-09-16T01:55:03.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.084+0000 7fe0fb7fe640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe10006c2e0 0x7fe10006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.084+0000 7fe0fb7fe640 1 -- 172.21.15.42:0/858854271 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe10c08ba80 con 0x7fe11415b340 2024-09-16T01:55:03.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.085+0000 7fe112ffd640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe10006c2e0 0x7fe10006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.085+0000 7fe112ffd640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe10006c2e0 0x7fe10006e7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe1040016e0 tx=0x7fe104009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:03.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.089+0000 7fe0fb7fe640 1 -- 172.21.15.42:0/858854271 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe10c010070 con 0x7fe11415b340 2024-09-16T01:55:03.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.307+0000 7fe1196a6640 1 -- 172.21.15.42:0/858854271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe114157250 con 0x7fe11415b340 2024-09-16T01:55:03.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.308+0000 7fe0fb7fe640 1 -- 172.21.15.42:0/858854271 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5231 (secure 0 0 0) 0x7fe10c0597a0 con 0x7fe11415b340 2024-09-16T01:55:03.309 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:03.309 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-16T01:54:40:934131+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/1169043609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1169043609},{"type":"v1","addr":"172.21.15.42:6834","nonce":1169043609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1624265111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1624265111},{"type":"v1","addr":"172.21.15.42:6835","nonce":1624265111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2378165142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2378165142},{"type":"v1","addr":"172.21.15.107:6836","nonce":2378165142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:54:21.197115+0000","modified":"2024-09-16T01:54:40.289757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/2229527903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2229527903},{"type":"v1","addr":"172.21.15.107:6837","nonce":2229527903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34157,"qdb_cluster":[34157]},"id":1}]} 2024-09-16T01:55:03.310 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-16T01:55:03.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 -- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe10006c2e0 msgr2=0x7fe10006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe10006c2e0 0x7fe10006e7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe1040016e0 tx=0x7fe104009040 comp rx=0 tx=0).stop 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 -- 172.21.15.42:0/858854271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe11415b340 msgr2=0x7fe1141530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe11415b340 0x7fe1141530b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009fa0 tx=0x7fe10c00d560 comp rx=0 tx=0).stop 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 -- 172.21.15.42:0/858854271 shutdown_connections 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe10006c2e0 0x7fe10006e7a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe11415b340 0x7fe1141530b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1140b5050 0x7fe1141558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 --2- 172.21.15.42:0/858854271 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe1140b43f0 0x7fe1140d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 -- 172.21.15.42:0/858854271 >> 172.21.15.42:0/858854271 conn(0x7fe114073490 msgr2=0x7fe1141563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 -- 172.21.15.42:0/858854271 shutdown_connections 2024-09-16T01:55:03.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.310+0000 7fe1196a6640 1 -- 172.21.15.42:0/858854271 wait complete. 2024-09-16T01:55:03.322 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:55:03.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.422+0000 7f2d28b1a640 1 Processor -- start 2024-09-16T01:55:03.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.423+0000 7f2d28b1a640 1 -- start start 2024-09-16T01:55:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.423+0000 7f2d28b1a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 0x7f2d240b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.423+0000 7f2d28b1a640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d2406d9f0 con 0x7f2d24161c80 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.423+0000 7f2d28b1a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d2406dcd0 con 0x7f2d240b64b0 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.423+0000 7f2d28b1a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2d2406dfb0 con 0x7f2d24162060 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.424+0000 7f2d2259c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2d24161c80 0x7f2d2406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57908/0 (socket says 172.21.15.42:57908) 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.424+0000 7f2d2259c640 1 -- 172.21.15.42:0/3254396584 learned_addr learned my addr 172.21.15.42:0/3254396584 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.424+0000 7f2d21d9b640 1 --2- 172.21.15.42:0/3254396584 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 0x7f2d240b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.424+0000 7f2d2159a640 1 -- 172.21.15.42:0/3254396584 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 140503844 0 0) 0x7f2d2406d9f0 con 0x7f2d24161c80 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.424+0000 7f2d2159a640 1 -- 172.21.15.42:0/3254396584 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d0c003520 con 0x7f2d24161c80 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.424+0000 7f2d21d9b640 1 -- 172.21.15.42:0/3254396584 >> v1:172.21.15.107:6789/0 conn(0x7f2d240b64b0 legacy=0x7f2d240cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.424+0000 7f2d2159a640 1 -- 172.21.15.42:0/3254396584 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 100491427 0 0) 0x7f2d2406dcd0 con 0x7f2d240b64b0 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.424+0000 7f2d21d9b640 1 -- 172.21.15.42:0/3254396584 >> v1:172.21.15.42:6789/0 conn(0x7f2d24161c80 legacy=0x7f2d2406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.424+0000 7f2d21d9b640 1 -- 172.21.15.42:0/3254396584 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d240d2890 con 0x7f2d24162060 2024-09-16T01:55:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.425+0000 7f2d21d9b640 1 --2- 172.21.15.42:0/3254396584 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 0x7f2d240b5f70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d180097d0 tx=0x7f2d1802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d12fcd24edcea2c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.425+0000 7f2d2159a640 1 -- 172.21.15.42:0/3254396584 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18037070 con 0x7f2d24162060 2024-09-16T01:55:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.425+0000 7f2d2159a640 1 -- 172.21.15.42:0/3254396584 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d18032440 con 0x7f2d24162060 2024-09-16T01:55:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.425+0000 7f2d2159a640 1 -- 172.21.15.42:0/3254396584 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d180327f0 con 0x7f2d24162060 2024-09-16T01:55:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.426+0000 7f2d28b1a640 1 -- 172.21.15.42:0/3254396584 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 msgr2=0x7f2d240b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.426+0000 7f2d28b1a640 1 --2- 172.21.15.42:0/3254396584 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 0x7f2d240b5f70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d180097d0 tx=0x7f2d1802a210 comp rx=0 tx=0).stop 2024-09-16T01:55:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.426+0000 7f2d28b1a640 1 -- 172.21.15.42:0/3254396584 shutdown_connections 2024-09-16T01:55:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.426+0000 7f2d28b1a640 1 --2- 172.21.15.42:0/3254396584 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 0x7f2d240b5f70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.426+0000 7f2d28b1a640 1 -- 172.21.15.42:0/3254396584 >> 172.21.15.42:0/3254396584 conn(0x7f2d240d44f0 msgr2=0x7f2d240d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.426+0000 7f2d28b1a640 1 -- 172.21.15.42:0/3254396584 shutdown_connections 2024-09-16T01:55:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.426+0000 7f2d28b1a640 1 -- 172.21.15.42:0/3254396584 wait complete. 2024-09-16T01:55:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.427+0000 7f2d28b1a640 1 Processor -- start 2024-09-16T01:55:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.427+0000 7f2d28b1a640 1 -- start start 2024-09-16T01:55:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d28b1a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d240b64b0 0x7f2d241f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d28b1a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d24161c80 0x7f2d240b9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d28b1a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 0x7f2d240b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d28b1a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2d240b6cf0 con 0x7f2d24161c80 2024-09-16T01:55:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d28b1a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2d240b6b70 con 0x7f2d240b64b0 2024-09-16T01:55:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d28b1a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2d240cf8f0 con 0x7f2d24162060 2024-09-16T01:55:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d21d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d24161c80 0x7f2d240b9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d21d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d24161c80 0x7f2d240b9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56734/0 (socket says 172.21.15.42:56734) 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d21d9b640 1 -- 172.21.15.42:0/2918200367 learned_addr learned my addr 172.21.15.42:0/2918200367 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d2259c640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d240b64b0 0x7f2d241f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d22d9d640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 0x7f2d240b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d21d9b640 1 -- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 msgr2=0x7f2d240b9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d21d9b640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 0x7f2d240b9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d21d9b640 1 -- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d240b64b0 msgr2=0x7f2d241f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d21d9b640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d240b64b0 0x7f2d241f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.428+0000 7f2d21d9b640 1 -- 172.21.15.42:0/2918200367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d240ba1f0 con 0x7f2d24161c80 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.429+0000 7f2d21d9b640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d24161c80 0x7f2d240b9650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d18035040 tx=0x7f2d180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.429+0000 7f2d12ffd640 1 -- 172.21.15.42:0/2918200367 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18037050 con 0x7f2d24161c80 2024-09-16T01:55:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.429+0000 7f2d12ffd640 1 -- 172.21.15.42:0/2918200367 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d18038040 con 0x7f2d24161c80 2024-09-16T01:55:03.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.429+0000 7f2d28b1a640 1 -- 172.21.15.42:0/2918200367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d241485d0 con 0x7f2d24161c80 2024-09-16T01:55:03.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.429+0000 7f2d12ffd640 1 -- 172.21.15.42:0/2918200367 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18006e10 con 0x7f2d24161c80 2024-09-16T01:55:03.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.429+0000 7f2d28b1a640 1 -- 172.21.15.42:0/2918200367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d24148b90 con 0x7f2d24161c80 2024-09-16T01:55:03.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.430+0000 7f2d28b1a640 1 -- 172.21.15.42:0/2918200367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2406dcd0 con 0x7f2d24161c80 2024-09-16T01:55:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.430+0000 7f2d12ffd640 1 -- 172.21.15.42:0/2918200367 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2d18045020 con 0x7f2d24161c80 2024-09-16T01:55:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.431+0000 7f2d12ffd640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2d0406c2b0 0x7f2d0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.431+0000 7f2d12ffd640 1 -- 172.21.15.42:0/2918200367 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2d180ab9c0 con 0x7f2d24161c80 2024-09-16T01:55:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.431+0000 7f2d2259c640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2d0406c2b0 0x7f2d0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.431+0000 7f2d2259c640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2d0406c2b0 0x7f2d0406e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d14000f60 tx=0x7f2d14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:03.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.435+0000 7f2d12ffd640 1 -- 172.21.15.42:0/2918200367 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d180ade20 con 0x7f2d24161c80 2024-09-16T01:55:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.611+0000 7f2d28b1a640 1 -- 172.21.15.42:0/2918200367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d240ba470 con 0x7f2d24161c80 2024-09-16T01:55:03.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.612+0000 7f2d12ffd640 1 -- 172.21.15.42:0/2918200367 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18975 (secure 0 0 0) 0x7f2d1804c020 con 0x7f2d24161c80 2024-09-16T01:55:03.614 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:03.614 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:02.988130+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:54:19.072922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:54:20.185940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:54:23.886069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:55:03.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 -- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2d0406c2b0 msgr2=0x7f2d0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2d0406c2b0 0x7f2d0406e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d14000f60 tx=0x7f2d14009040 comp rx=0 tx=0).stop 2024-09-16T01:55:03.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 -- 172.21.15.42:0/2918200367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d24161c80 msgr2=0x7f2d240b9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d24161c80 0x7f2d240b9650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d18035040 tx=0x7f2d180046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 -- 172.21.15.42:0/2918200367 shutdown_connections 2024-09-16T01:55:03.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2d0406c2b0 0x7f2d0406e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2d24162060 0x7f2d240b9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2d24161c80 0x7f2d240b9650 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 --2- 172.21.15.42:0/2918200367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2d240b64b0 0x7f2d241f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 -- 172.21.15.42:0/2918200367 >> 172.21.15.42:0/2918200367 conn(0x7f2d240d44f0 msgr2=0x7f2d241562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:03.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 -- 172.21.15.42:0/2918200367 shutdown_connections 2024-09-16T01:55:03.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.614+0000 7f2d28b1a640 1 -- 172.21.15.42:0/2918200367 wait complete. 2024-09-16T01:55:03.627 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:55:03.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.730+0000 7ff31e7d6640 1 Processor -- start 2024-09-16T01:55:03.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.730+0000 7ff31e7d6640 1 -- start start 2024-09-16T01:55:03.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.730+0000 7ff31e7d6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff318162060 0x7ff3180b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.730+0000 7ff31e7d6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff3180b64b0 0x7ff3180b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.730+0000 7ff31e7d6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff31806d9f0 con 0x7ff318161c80 2024-09-16T01:55:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.730+0000 7ff31e7d6640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff31806dcd0 con 0x7ff3180b64b0 2024-09-16T01:55:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.730+0000 7ff31e7d6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff31806dfb0 con 0x7ff318162060 2024-09-16T01:55:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.731+0000 7ff31cd73640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff3180b64b0 0x7ff3180b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.731+0000 7ff31cd73640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff3180b64b0 0x7ff3180b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56736/0 (socket says 172.21.15.42:56736) 2024-09-16T01:55:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.731+0000 7ff31cd73640 1 -- 172.21.15.42:0/3504865003 learned_addr learned my addr 172.21.15.42:0/3504865003 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.731+0000 7ff3177fe640 1 --2- 172.21.15.42:0/3504865003 >> v2:172.21.15.107:3300/0 conn(0x7ff318162060 0x7ff3180b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.731+0000 7ff31cd73640 1 -- 172.21.15.42:0/3504865003 >> v2:172.21.15.107:3300/0 conn(0x7ff318162060 msgr2=0x7ff3180b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.731+0000 7ff31cd73640 1 --2- 172.21.15.42:0/3504865003 >> v2:172.21.15.107:3300/0 conn(0x7ff318162060 0x7ff3180b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.731+0000 7ff31cd73640 1 -- 172.21.15.42:0/3504865003 >> v1:172.21.15.107:6789/0 conn(0x7ff318161c80 legacy=0x7ff31806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.731+0000 7ff31cd73640 1 -- 172.21.15.42:0/3504865003 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3180d01f0 con 0x7ff3180b64b0 2024-09-16T01:55:03.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff31cd73640 1 --2- 172.21.15.42:0/3504865003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3180b64b0 0x7ff3180b6960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff31808e830 tx=0x7ff31002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6f8d8863ae1d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:03.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff316ffd640 1 -- 172.21.15.42:0/3504865003 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310036070 con 0x7ff3180b64b0 2024-09-16T01:55:03.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff316ffd640 1 -- 172.21.15.42:0/3504865003 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff310031600 con 0x7ff3180b64b0 2024-09-16T01:55:03.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff316ffd640 1 -- 172.21.15.42:0/3504865003 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3100319d0 con 0x7ff3180b64b0 2024-09-16T01:55:03.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff31e7d6640 1 -- 172.21.15.42:0/3504865003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3180b64b0 msgr2=0x7ff3180b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff31e7d6640 1 --2- 172.21.15.42:0/3504865003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3180b64b0 0x7ff3180b6960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff31808e830 tx=0x7ff31002a6f0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff31e7d6640 1 -- 172.21.15.42:0/3504865003 shutdown_connections 2024-09-16T01:55:03.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff31e7d6640 1 --2- 172.21.15.42:0/3504865003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3180b64b0 0x7ff3180b6960 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff31e7d6640 1 --2- 172.21.15.42:0/3504865003 >> v2:172.21.15.107:3300/0 conn(0x7ff318162060 0x7ff3180b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff31e7d6640 1 -- 172.21.15.42:0/3504865003 >> 172.21.15.42:0/3504865003 conn(0x7ff3180d44f0 msgr2=0x7ff3180d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:03.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff31e7d6640 1 -- 172.21.15.42:0/3504865003 shutdown_connections 2024-09-16T01:55:03.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.732+0000 7ff31e7d6640 1 -- 172.21.15.42:0/3504865003 wait complete. 2024-09-16T01:55:03.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.734+0000 7ff31e7d6640 1 Processor -- start 2024-09-16T01:55:03.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.734+0000 7ff31e7d6640 1 -- start start 2024-09-16T01:55:03.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.734+0000 7ff31e7d6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3180b64b0 0x7ff318159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.734+0000 7ff31e7d6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff318161c80 0x7ff3180cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.734+0000 7ff31e7d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff318162060 0x7ff31815aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.734+0000 7ff31e7d6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff3180cf1e0 con 0x7ff318162060 2024-09-16T01:55:03.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.734+0000 7ff31e7d6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff3180d2aa0 con 0x7ff3180b64b0 2024-09-16T01:55:03.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.734+0000 7ff31e7d6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff3180cf360 con 0x7ff318161c80 2024-09-16T01:55:03.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31cd73640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff318162060 0x7ff31815aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31cd73640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff318162060 0x7ff31815aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56744/0 (socket says 172.21.15.42:56744) 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31cd73640 1 -- 172.21.15.42:0/1711691616 learned_addr learned my addr 172.21.15.42:0/1711691616 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff317fff640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3180b64b0 0x7ff318159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff3177fe640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff318161c80 0x7ff3180cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31cd73640 1 -- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff318161c80 msgr2=0x7ff3180cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31cd73640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff318161c80 0x7ff3180cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31cd73640 1 -- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3180b64b0 msgr2=0x7ff318159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31cd73640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3180b64b0 0x7ff318159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31cd73640 1 -- 172.21.15.42:0/1711691616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3180cdbd0 con 0x7ff318162060 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31cd73640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff318162060 0x7ff31815aa90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff310009f40 tx=0x7ff310004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff314ff9640 1 -- 172.21.15.42:0/1711691616 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31003f020 con 0x7ff318162060 2024-09-16T01:55:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff314ff9640 1 -- 172.21.15.42:0/1711691616 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff310037040 con 0x7ff318162060 2024-09-16T01:55:03.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31e7d6640 1 -- 172.21.15.42:0/1711691616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3180cdeb0 con 0x7ff318162060 2024-09-16T01:55:03.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff314ff9640 1 -- 172.21.15.42:0/1711691616 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310036070 con 0x7ff318162060 2024-09-16T01:55:03.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.735+0000 7ff31e7d6640 1 -- 172.21.15.42:0/1711691616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3180b74c0 con 0x7ff318162060 2024-09-16T01:55:03.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.736+0000 7ff31e7d6640 1 -- 172.21.15.42:0/1711691616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3180b5f70 con 0x7ff318162060 2024-09-16T01:55:03.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.737+0000 7ff314ff9640 1 -- 172.21.15.42:0/1711691616 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff310042020 con 0x7ff318162060 2024-09-16T01:55:03.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.737+0000 7ff314ff9640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff30406c2b0 0x7ff30406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:03.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.737+0000 7ff314ff9640 1 -- 172.21.15.42:0/1711691616 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff3100abbf0 con 0x7ff318162060 2024-09-16T01:55:03.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.738+0000 7ff317fff640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff30406c2b0 0x7ff30406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:03.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.738+0000 7ff317fff640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff30406c2b0 0x7ff30406e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff308004f60 tx=0x7ff308007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:03.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.742+0000 7ff314ff9640 1 -- 172.21.15.42:0/1711691616 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff310049030 con 0x7ff318162060 2024-09-16T01:55:03.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.952+0000 7ff31e7d6640 1 -- 172.21.15.42:0/1711691616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff3180b7690 con 0x7ff318162060 2024-09-16T01:55:03.954 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-16T01:55:03.953+0000 7fafb4c25640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:55:03.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.954+0000 7ff314ff9640 1 -- 172.21.15.42:0/1711691616 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7ff310079910 con 0x7ff318162060 2024-09-16T01:55:03.956 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:55:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 -- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff30406c2b0 msgr2=0x7ff30406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff30406c2b0 0x7ff30406e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff308004f60 tx=0x7ff308007e30 comp rx=0 tx=0).stop 2024-09-16T01:55:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 -- 172.21.15.42:0/1711691616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff318162060 msgr2=0x7ff31815aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff318162060 0x7ff31815aa90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff310009f40 tx=0x7ff310004a40 comp rx=0 tx=0).stop 2024-09-16T01:55:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 -- 172.21.15.42:0/1711691616 shutdown_connections 2024-09-16T01:55:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff30406c2b0 0x7ff30406e770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff318162060 0x7ff31815aa90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff318161c80 0x7ff3180cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 --2- 172.21.15.42:0/1711691616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3180b64b0 0x7ff318159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:03.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 -- 172.21.15.42:0/1711691616 >> 172.21.15.42:0/1711691616 conn(0x7ff3180d44f0 msgr2=0x7ff3180b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:03.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.957+0000 7ff31e7d6640 1 -- 172.21.15.42:0/1711691616 shutdown_connections 2024-09-16T01:55:03.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:03.958+0000 7ff31e7d6640 1 -- 172.21.15.42:0/1711691616 wait complete. 2024-09-16T01:55:03.962 INFO:tasks.ceph.mds.b.smithi107.stderr: -4144> 2024-09-16T01:54:27.825+0000 7fcb379f6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:55:03.972 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:55:03.994 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-09-16T01:55:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.076+0000 7f40ff627640 1 Processor -- start 2024-09-16T01:55:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.076+0000 7f40ff627640 1 -- start start 2024-09-16T01:55:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.077+0000 7f40ff627640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f8162340 0x7f40f806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.077+0000 7f40ff627640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f40f80cf280 0x7f40f8162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.077+0000 7f40ff627640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f40f8162c60 0x7f40f80d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.077+0000 7f40ff627640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f40f806de90 con 0x7f40f8162c60 2024-09-16T01:55:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.077+0000 7f40ff627640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f40f815ff70 con 0x7f40f80cf280 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.077+0000 7f40ff627640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f40f80d4d10 con 0x7f40f8162340 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.077+0000 7f40fdbc4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f40f8162c60 0x7f40f80d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.077+0000 7f40fdbc4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f40f8162c60 0x7f40f80d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56750/0 (socket says 172.21.15.42:56750) 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.077+0000 7f40fdbc4640 1 -- 172.21.15.42:0/313041647 learned_addr learned my addr 172.21.15.42:0/313041647 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.078+0000 7f40fcbc2640 1 --2- 172.21.15.42:0/313041647 >> v2:172.21.15.107:3300/0 conn(0x7f40f80cf280 0x7f40f8162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.078+0000 7f40fd3c3640 1 --2- 172.21.15.42:0/313041647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f8162340 0x7f40f806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.078+0000 7f40fdbc4640 1 -- 172.21.15.42:0/313041647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f8162340 msgr2=0x7f40f806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.078+0000 7f40fdbc4640 1 --2- 172.21.15.42:0/313041647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f8162340 0x7f40f806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.078+0000 7f40fdbc4640 1 -- 172.21.15.42:0/313041647 >> v2:172.21.15.107:3300/0 conn(0x7f40f80cf280 msgr2=0x7f40f8162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.078+0000 7f40fdbc4640 1 --2- 172.21.15.42:0/313041647 >> v2:172.21.15.107:3300/0 conn(0x7f40f80cf280 0x7f40f8162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.078+0000 7f40fdbc4640 1 -- 172.21.15.42:0/313041647 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f80d4ff0 con 0x7f40f8162c60 2024-09-16T01:55:04.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.078+0000 7f40fcbc2640 1 --2- 172.21.15.42:0/313041647 >> v2:172.21.15.107:3300/0 conn(0x7f40f80cf280 0x7f40f8162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:04.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40fdbc4640 1 --2- 172.21.15.42:0/313041647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 0x7f40f80d2990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f40f808d200 tx=0x7f40f002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853d0541bd565da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:04.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40f7fff640 1 -- 172.21.15.42:0/313041647 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f0036070 con 0x7f40f8162c60 2024-09-16T01:55:04.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40f7fff640 1 -- 172.21.15.42:0/313041647 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f0031600 con 0x7f40f8162c60 2024-09-16T01:55:04.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40f7fff640 1 -- 172.21.15.42:0/313041647 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f00319d0 con 0x7f40f8162c60 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40ff627640 1 -- 172.21.15.42:0/313041647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 msgr2=0x7f40f80d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40ff627640 1 --2- 172.21.15.42:0/313041647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 0x7f40f80d2990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f40f808d200 tx=0x7f40f002a610 comp rx=0 tx=0).stop 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40ff627640 1 -- 172.21.15.42:0/313041647 shutdown_connections 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40ff627640 1 --2- 172.21.15.42:0/313041647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 0x7f40f80d2990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40ff627640 1 --2- 172.21.15.42:0/313041647 >> v2:172.21.15.107:3300/0 conn(0x7f40f80cf280 0x7f40f8162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40ff627640 1 --2- 172.21.15.42:0/313041647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f8162340 0x7f40f806d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40ff627640 1 -- 172.21.15.42:0/313041647 >> 172.21.15.42:0/313041647 conn(0x7f40f808bfc0 msgr2=0x7f40f80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.079+0000 7f40ff627640 1 -- 172.21.15.42:0/313041647 shutdown_connections 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.080+0000 7f40ff627640 1 -- 172.21.15.42:0/313041647 wait complete. 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.081+0000 7f40ff627640 1 Processor -- start 2024-09-16T01:55:04.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.081+0000 7f40ff627640 1 -- start start 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.081+0000 7f40ff627640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f80cf280 0x7f40f80b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.081+0000 7f40ff627640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f8162340 0x7f40f815dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.081+0000 7f40ff627640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 0x7f40f80cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.081+0000 7f40ff627640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40f80cf6c0 con 0x7f40f8162c60 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.081+0000 7f40ff627640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f40f80d52d0 con 0x7f40f8162340 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.081+0000 7f40ff627640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f40f8163110 con 0x7f40f80cf280 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fdbc4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 0x7f40f80cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fdbc4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 0x7f40f80cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56762/0 (socket says 172.21.15.42:56762) 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fdbc4640 1 -- 172.21.15.42:0/3787886813 learned_addr learned my addr 172.21.15.42:0/3787886813 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fcbc2640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f8162340 0x7f40f815dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fd3c3640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f80cf280 0x7f40f80b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fdbc4640 1 -- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f80cf280 msgr2=0x7f40f80b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fdbc4640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f80cf280 0x7f40f80b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fdbc4640 1 -- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f8162340 msgr2=0x7f40f815dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fdbc4640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f8162340 0x7f40f815dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fdbc4640 1 -- 172.21.15.42:0/3787886813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f80b5b80 con 0x7f40f8162c60 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fcbc2640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f8162340 0x7f40f815dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fd3c3640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f80cf280 0x7f40f80b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40fdbc4640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 0x7f40f80cd5b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009f40 tx=0x7f40f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40f5ffb640 1 -- 172.21.15.42:0/3787886813 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f0041070 con 0x7f40f8162c60 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40f5ffb640 1 -- 172.21.15.42:0/3787886813 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f003c650 con 0x7f40f8162c60 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40ff627640 1 -- 172.21.15.42:0/3787886813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f80b5e60 con 0x7f40f8162c60 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.082+0000 7f40f5ffb640 1 -- 172.21.15.42:0/3787886813 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f0036040 con 0x7f40f8162c60 2024-09-16T01:55:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.083+0000 7f40ff627640 1 -- 172.21.15.42:0/3787886813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f80b6420 con 0x7f40f8162c60 2024-09-16T01:55:04.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.084+0000 7f40ff627640 1 -- 172.21.15.42:0/3787886813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f8162720 con 0x7f40f8162c60 2024-09-16T01:55:04.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.084+0000 7f40f5ffb640 1 -- 172.21.15.42:0/3787886813 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f40f0044070 con 0x7f40f8162c60 2024-09-16T01:55:04.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.084+0000 7f40f5ffb640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f40e406c2b0 0x7f40e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:04.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.085+0000 7f40f5ffb640 1 -- 172.21.15.42:0/3787886813 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7f40f00ac2f0 con 0x7f40f8162c60 2024-09-16T01:55:04.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.085+0000 7f40fd3c3640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f40e406c2b0 0x7f40e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:04.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.085+0000 7f40fd3c3640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f40e406c2b0 0x7f40e406e770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f40e8007d90 tx=0x7f40e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:04.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.089+0000 7f40f5ffb640 1 -- 172.21.15.42:0/3787886813 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40f0079f20 con 0x7f40f8162c60 2024-09-16T01:55:04.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.303+0000 7f40ff627640 1 -- 172.21.15.42:0/3787886813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f40f808e640 con 0x7f40f8162c60 2024-09-16T01:55:04.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:04.997+0000 7f40f5ffb640 1 -- 172.21.15.42:0/3787886813 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f40f007e220 con 0x7f40f8162c60 2024-09-16T01:55:05.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 -- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f40e406c2b0 msgr2=0x7f40e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:05.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f40e406c2b0 0x7f40e406e770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f40e8007d90 tx=0x7f40e8008040 comp rx=0 tx=0).stop 2024-09-16T01:55:05.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 -- 172.21.15.42:0/3787886813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 msgr2=0x7f40f80cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:05.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 0x7f40f80cd5b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009f40 tx=0x7f40f0004a40 comp rx=0 tx=0).stop 2024-09-16T01:55:05.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 -- 172.21.15.42:0/3787886813 shutdown_connections 2024-09-16T01:55:05.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f40e406c2b0 0x7f40e406e770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:05.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40f8162c60 0x7f40f80cd5b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:05.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40f8162340 0x7f40f815dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 --2- 172.21.15.42:0/3787886813 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40f80cf280 0x7f40f80b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 -- 172.21.15.42:0/3787886813 >> 172.21.15.42:0/3787886813 conn(0x7f40f808bfc0 msgr2=0x7f40f80b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 -- 172.21.15.42:0/3787886813 shutdown_connections 2024-09-16T01:55:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.000+0000 7f40ff627640 1 -- 172.21.15.42:0/3787886813 wait complete. 2024-09-16T01:55:05.015 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:55:05.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.127+0000 7fb4c809b640 1 Processor -- start 2024-09-16T01:55:05.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.127+0000 7fb4c809b640 1 -- start start 2024-09-16T01:55:05.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.128+0000 7fb4c809b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb4c00b4a50 0x7fb4c00cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:05.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.128+0000 7fb4c809b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00cd340 0x7fb4c00b5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:05.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.128+0000 7fb4c809b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4c00ce1a0 con 0x7fb4c00b7c30 2024-09-16T01:55:05.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.128+0000 7fb4c809b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb4c00b3010 con 0x7fb4c00b4a50 2024-09-16T01:55:05.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.128+0000 7fb4c809b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c00b32f0 con 0x7fb4c00cd340 2024-09-16T01:55:05.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.128+0000 7fb4c6638640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00cd340 0x7fb4c00b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:05.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.128+0000 7fb4c5636640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb4c00b4a50 0x7fb4c00cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:05.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.128+0000 7fb4c5e37640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb4c00b7c30 0x7fb4c00cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:58272/0 (socket says 172.21.15.42:58272) 2024-09-16T01:55:05.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.128+0000 7fb4c5e37640 1 -- 172.21.15.42:0/3275257013 learned_addr learned my addr 172.21.15.42:0/3275257013 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:05.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.128+0000 7fb4c4e35640 1 -- 172.21.15.42:0/3275257013 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598224407 0 0) 0x7fb4c00ce1a0 con 0x7fb4c00b7c30 2024-09-16T01:55:05.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.129+0000 7fb4c4e35640 1 -- 172.21.15.42:0/3275257013 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4ac003520 con 0x7fb4c00b7c30 2024-09-16T01:55:05.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.129+0000 7fb4c6638640 1 -- 172.21.15.42:0/3275257013 >> v2:172.21.15.107:3300/0 conn(0x7fb4c00b4a50 msgr2=0x7fb4c00cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:05.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.129+0000 7fb4c6638640 1 --2- 172.21.15.42:0/3275257013 >> v2:172.21.15.107:3300/0 conn(0x7fb4c00b4a50 0x7fb4c00cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:05.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.129+0000 7fb4c6638640 1 -- 172.21.15.42:0/3275257013 >> v1:172.21.15.107:6789/0 conn(0x7fb4c00b7c30 legacy=0x7fb4c00cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:05.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.129+0000 7fb4c6638640 1 -- 172.21.15.42:0/3275257013 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c00b35d0 con 0x7fb4c00cd340 2024-09-16T01:55:05.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.129+0000 7fb4c5636640 1 --2- 172.21.15.42:0/3275257013 >> v2:172.21.15.107:3300/0 conn(0x7fb4c00b4a50 0x7fb4c00cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.129+0000 7fb4c6638640 1 --2- 172.21.15.42:0/3275257013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00cd340 0x7fb4c00b5120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009d90 tx=0x7fb4b802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10f91c6c618f99e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c4e35640 1 -- 172.21.15.42:0/3275257013 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8031600 con 0x7fb4c00cd340 2024-09-16T01:55:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c4e35640 1 -- 172.21.15.42:0/3275257013 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4b80317a0 con 0x7fb4c00cd340 2024-09-16T01:55:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c4e35640 1 -- 172.21.15.42:0/3275257013 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8031b70 con 0x7fb4c00cd340 2024-09-16T01:55:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c809b640 1 -- 172.21.15.42:0/3275257013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00cd340 msgr2=0x7fb4c00b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c809b640 1 --2- 172.21.15.42:0/3275257013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00cd340 0x7fb4c00b5120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009d90 tx=0x7fb4b802a5d0 comp rx=0 tx=0).stop 2024-09-16T01:55:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c809b640 1 -- 172.21.15.42:0/3275257013 shutdown_connections 2024-09-16T01:55:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c809b640 1 --2- 172.21.15.42:0/3275257013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00cd340 0x7fb4c00b5120 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c809b640 1 --2- 172.21.15.42:0/3275257013 >> v2:172.21.15.107:3300/0 conn(0x7fb4c00b4a50 0x7fb4c00cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:05.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c809b640 1 -- 172.21.15.42:0/3275257013 >> 172.21.15.42:0/3275257013 conn(0x7fb4c00b3de0 msgr2=0x7fb4c00b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:05.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c809b640 1 -- 172.21.15.42:0/3275257013 shutdown_connections 2024-09-16T01:55:05.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.130+0000 7fb4c809b640 1 -- 172.21.15.42:0/3275257013 wait complete. 2024-09-16T01:55:05.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.131+0000 7fb4c809b640 1 Processor -- start 2024-09-16T01:55:05.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.131+0000 7fb4c809b640 1 -- start start 2024-09-16T01:55:05.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c809b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4c00b4a50 0x7fb4c01f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:05.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c809b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00b7c30 0x7fb4c00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:05.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c809b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c00cd340 0x7fb4c00cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:05.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c809b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c00b8190 con 0x7fb4c00cd340 2024-09-16T01:55:05.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c809b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c00b8010 con 0x7fb4c00b4a50 2024-09-16T01:55:05.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c809b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c00cd790 con 0x7fb4c00b7c30 2024-09-16T01:55:05.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c6638640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c00cd340 0x7fb4c00cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:05.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c6638640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c00cd340 0x7fb4c00cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56778/0 (socket says 172.21.15.42:56778) 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c6638640 1 -- 172.21.15.42:0/671284419 learned_addr learned my addr 172.21.15.42:0/671284419 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c5e37640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4c00b4a50 0x7fb4c01f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.132+0000 7fb4c5636640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00b7c30 0x7fb4c00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4c6638640 1 -- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00b7c30 msgr2=0x7fb4c00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4c6638640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00b7c30 0x7fb4c00cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4c6638640 1 -- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4c00b4a50 msgr2=0x7fb4c01f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4c6638640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4c00b4a50 0x7fb4c01f2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4c6638640 1 -- 172.21.15.42:0/671284419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c00cb8a0 con 0x7fb4c00cd340 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4c5e37640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4c00b4a50 0x7fb4c01f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4c6638640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c00cd340 0x7fb4c00cb360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009eb0 tx=0x7fb4b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4b67fc640 1 -- 172.21.15.42:0/671284419 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b803f070 con 0x7fb4c00cd340 2024-09-16T01:55:05.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4b67fc640 1 -- 172.21.15.42:0/671284419 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4b803b820 con 0x7fb4c00cd340 2024-09-16T01:55:05.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4c809b640 1 -- 172.21.15.42:0/671284419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c009e7c0 con 0x7fb4c00cd340 2024-09-16T01:55:05.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4b67fc640 1 -- 172.21.15.42:0/671284419 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b803bbd0 con 0x7fb4c00cd340 2024-09-16T01:55:05.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.133+0000 7fb4c809b640 1 -- 172.21.15.42:0/671284419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c009ea40 con 0x7fb4c00cd340 2024-09-16T01:55:05.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.134+0000 7fb4c809b640 1 -- 172.21.15.42:0/671284419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c00ce750 con 0x7fb4c00cd340 2024-09-16T01:55:05.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.135+0000 7fb4b67fc640 1 -- 172.21.15.42:0/671284419 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb4b804d3f0 con 0x7fb4c00cd340 2024-09-16T01:55:05.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.135+0000 7fb4b67fc640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4a406c2b0 0x7fb4a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:05.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.135+0000 7fb4b67fc640 1 -- 172.21.15.42:0/671284419 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7fb4b80acb70 con 0x7fb4c00cd340 2024-09-16T01:55:05.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.136+0000 7fb4c5e37640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4a406c2b0 0x7fb4a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:05.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.136+0000 7fb4c5e37640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4a406c2b0 0x7fb4a406e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001200 tx=0x7fb4b0000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:05.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.140+0000 7fb4b67fc640 1 -- 172.21.15.42:0/671284419 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4c009e7c0 con 0x7fb4c00cd340 2024-09-16T01:55:05.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:05.315+0000 7fb4c809b640 1 -- 172.21.15.42:0/671284419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb4c01f4fe0 con 0x7fb4c00cd340 2024-09-16T01:55:06.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.003+0000 7fb4b67fc640 1 -- 172.21.15.42:0/671284419 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7fb4b807a8c0 con 0x7fb4c00cd340 2024-09-16T01:55:06.005 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 -- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4a406c2b0 msgr2=0x7fb4a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4a406c2b0 0x7fb4a406e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001200 tx=0x7fb4b0000bc0 comp rx=0 tx=0).stop 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 -- 172.21.15.42:0/671284419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c00cd340 msgr2=0x7fb4c00cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c00cd340 0x7fb4c00cb360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009eb0 tx=0x7fb4b8004a40 comp rx=0 tx=0).stop 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 -- 172.21.15.42:0/671284419 shutdown_connections 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4a406c2b0 0x7fb4a406e770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4c00cd340 0x7fb4c00cb360 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4c00b7c30 0x7fb4c00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 --2- 172.21.15.42:0/671284419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4c00b4a50 0x7fb4c01f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 -- 172.21.15.42:0/671284419 >> 172.21.15.42:0/671284419 conn(0x7fb4c00b3de0 msgr2=0x7fb4c00d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:06.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 -- 172.21.15.42:0/671284419 shutdown_connections 2024-09-16T01:55:06.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.007+0000 7fb4c809b640 1 -- 172.21.15.42:0/671284419 wait complete. 2024-09-16T01:55:06.023 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:55:06.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.137+0000 7f31b516d640 1 Processor -- start 2024-09-16T01:55:06.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.137+0000 7f31b516d640 1 -- start start 2024-09-16T01:55:06.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31b516d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f31b0162e30 0x7f31b006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:06.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31b516d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f31b00cf280 0x7f31b00d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:06.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31b516d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b015ff70 con 0x7f31b0162340 2024-09-16T01:55:06.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31b516d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f31b006de90 con 0x7f31b0162e30 2024-09-16T01:55:06.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31b516d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f31b0163270 con 0x7f31b00cf280 2024-09-16T01:55:06.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31ae59c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f31b0162e30 0x7f31b006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:06.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31ae59c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f31b0162e30 0x7f31b006d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56792/0 (socket says 172.21.15.42:56792) 2024-09-16T01:55:06.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31ae59c640 1 -- 172.21.15.42:0/2322256267 learned_addr learned my addr 172.21.15.42:0/2322256267 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:06.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31ae59c640 1 -- 172.21.15.42:0/2322256267 >> v2:172.21.15.107:3300/0 conn(0x7f31b00cf280 msgr2=0x7f31b00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:06.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31af59e640 1 --2- 172.21.15.42:0/2322256267 >> v2:172.21.15.107:3300/0 conn(0x7f31b00cf280 0x7f31b00d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:06.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31ae59c640 1 --2- 172.21.15.42:0/2322256267 >> v2:172.21.15.107:3300/0 conn(0x7f31b00cf280 0x7f31b00d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:06.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31ae59c640 1 -- 172.21.15.42:0/2322256267 >> v1:172.21.15.107:6789/0 conn(0x7f31b0162340 legacy=0x7f31b0162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:06.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.138+0000 7f31ae59c640 1 -- 172.21.15.42:0/2322256267 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b00d4d10 con 0x7f31b0162e30 2024-09-16T01:55:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.139+0000 7f31ae59c640 1 --2- 172.21.15.42:0/2322256267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b0162e30 0x7f31b006d740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31b006c3d0 tx=0x7f31a402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b574b27e2b151b63 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.139+0000 7f31add9b640 1 -- 172.21.15.42:0/2322256267 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4004030 con 0x7f31b0162e30 2024-09-16T01:55:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.139+0000 7f31add9b640 1 -- 172.21.15.42:0/2322256267 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a40041d0 con 0x7f31b0162e30 2024-09-16T01:55:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.139+0000 7f31add9b640 1 -- 172.21.15.42:0/2322256267 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4003610 con 0x7f31b0162e30 2024-09-16T01:55:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.140+0000 7f31b516d640 1 -- 172.21.15.42:0/2322256267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b0162e30 msgr2=0x7f31b006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.140+0000 7f31b516d640 1 --2- 172.21.15.42:0/2322256267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b0162e30 0x7f31b006d740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31b006c3d0 tx=0x7f31a402a180 comp rx=0 tx=0).stop 2024-09-16T01:55:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.140+0000 7f31b516d640 1 -- 172.21.15.42:0/2322256267 shutdown_connections 2024-09-16T01:55:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.140+0000 7f31b516d640 1 --2- 172.21.15.42:0/2322256267 >> v2:172.21.15.107:3300/0 conn(0x7f31b00cf280 0x7f31b00d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:06.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.140+0000 7f31b516d640 1 --2- 172.21.15.42:0/2322256267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b0162e30 0x7f31b006d740 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:06.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.140+0000 7f31b516d640 1 -- 172.21.15.42:0/2322256267 >> 172.21.15.42:0/2322256267 conn(0x7f31b008bfc0 msgr2=0x7f31b00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:06.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.140+0000 7f31b516d640 1 -- 172.21.15.42:0/2322256267 shutdown_connections 2024-09-16T01:55:06.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.140+0000 7f31b516d640 1 -- 172.21.15.42:0/2322256267 wait complete. 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.142+0000 7f31b516d640 1 Processor -- start 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.142+0000 7f31b516d640 1 -- start start 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.142+0000 7f31b516d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b00cf280 0x7f31b00cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.142+0000 7f31b516d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31b0162340 0x7f31b00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.142+0000 7f31b516d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31b0162e30 0x7f31b00cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.142+0000 7f31b516d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31b00cf6f0 con 0x7f31b00cf280 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.142+0000 7f31b516d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f31b00d2470 con 0x7f31b0162340 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.142+0000 7f31b516d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f31b00d52d0 con 0x7f31b0162e30 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.142+0000 7f31aed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b00cf280 0x7f31b00cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31aed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b00cf280 0x7f31b00cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56806/0 (socket says 172.21.15.42:56806) 2024-09-16T01:55:06.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31aed9d640 1 -- 172.21.15.42:0/3343058356 learned_addr learned my addr 172.21.15.42:0/3343058356 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31ae59c640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31b0162340 0x7f31b00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31af59e640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31b0162e30 0x7f31b00cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31aed9d640 1 -- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31b0162e30 msgr2=0x7f31b00cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31aed9d640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31b0162e30 0x7f31b00cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31aed9d640 1 -- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31b0162340 msgr2=0x7f31b00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31aed9d640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31b0162340 0x7f31b00cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31aed9d640 1 -- 172.21.15.42:0/3343058356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b01ea5f0 con 0x7f31b00cf280 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31aed9d640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b00cf280 0x7f31b00cdf90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f31a000c410 tx=0x7f31a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31977fe640 1 -- 172.21.15.42:0/3343058356 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0017070 con 0x7f31b00cf280 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31977fe640 1 -- 172.21.15.42:0/3343058356 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a00035f0 con 0x7f31b00cf280 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31b516d640 1 -- 172.21.15.42:0/3343058356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b00cc140 con 0x7f31b00cf280 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31977fe640 1 -- 172.21.15.42:0/3343058356 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003a20 con 0x7f31b00cf280 2024-09-16T01:55:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.143+0000 7f31b516d640 1 -- 172.21.15.42:0/3343058356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b00cd790 con 0x7f31b00cf280 2024-09-16T01:55:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.144+0000 7f31b516d640 1 -- 172.21.15.42:0/3343058356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b006d740 con 0x7f31b00cf280 2024-09-16T01:55:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.145+0000 7f31977fe640 1 -- 172.21.15.42:0/3343058356 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f31a001a070 con 0x7f31b00cf280 2024-09-16T01:55:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.145+0000 7f31977fe640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f319c06c2b0 0x7f319c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:06.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.146+0000 7f31977fe640 1 -- 172.21.15.42:0/3343058356 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6383+0+0 (secure 0 0 0) 0x7f31a008aa70 con 0x7f31b00cf280 2024-09-16T01:55:06.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.146+0000 7f31ae59c640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f319c06c2b0 0x7f319c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:06.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.146+0000 7f31ae59c640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f319c06c2b0 0x7f319c06e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31a4033000 tx=0x7f31a402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.150+0000 7f31977fe640 1 -- 172.21.15.42:0/3343058356 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31a0058980 con 0x7f31b00cf280 2024-09-16T01:55:06.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:06.325+0000 7f31b516d640 1 -- 172.21.15.42:0/3343058356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f31b008e640 con 0x7f31b00cf280 2024-09-16T01:55:07.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.008+0000 7f31977fe640 1 -- 172.21.15.42:0/3343058356 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f31a005cc80 con 0x7f31b00cf280 2024-09-16T01:55:07.009 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-16T01:55:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 -- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f319c06c2b0 msgr2=0x7f319c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f319c06c2b0 0x7f319c06e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31a4033000 tx=0x7f31a402e000 comp rx=0 tx=0).stop 2024-09-16T01:55:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 -- 172.21.15.42:0/3343058356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b00cf280 msgr2=0x7f31b00cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b00cf280 0x7f31b00cdf90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f31a000c410 tx=0x7f31a000c8d0 comp rx=0 tx=0).stop 2024-09-16T01:55:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 -- 172.21.15.42:0/3343058356 shutdown_connections 2024-09-16T01:55:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f319c06c2b0 0x7f319c06e770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f31b0162e30 0x7f31b00cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f31b0162340 0x7f31b00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 --2- 172.21.15.42:0/3343058356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31b00cf280 0x7f31b00cdf90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 -- 172.21.15.42:0/3343058356 >> 172.21.15.42:0/3343058356 conn(0x7f31b008bfc0 msgr2=0x7f31b00d1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 -- 172.21.15.42:0/3343058356 shutdown_connections 2024-09-16T01:55:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.011+0000 7f31b516d640 1 -- 172.21.15.42:0/3343058356 wait complete. 2024-09-16T01:55:07.026 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-16T01:55:07.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.135+0000 7fba2e931640 1 Processor -- start 2024-09-16T01:55:07.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.135+0000 7fba2e931640 1 -- start start 2024-09-16T01:55:07.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.136+0000 7fba2e931640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280d4c10 0x7fba28162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:07.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.136+0000 7fba2e931640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba280d2600 con 0x7fba280b5f80 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.136+0000 7fba2e931640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba280b3c10 con 0x7fba280d3320 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.136+0000 7fba2e931640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fba280d5420 con 0x7fba280d4c10 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.136+0000 7fba27fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fba280b5f80 0x7fba280b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57920/0 (socket says 172.21.15.42:57920) 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.136+0000 7fba27fff640 1 -- 172.21.15.42:0/4110160667 learned_addr learned my addr 172.21.15.42:0/4110160667 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba277fe640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280d4c10 0x7fba28162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145813268 0 0) 0x7fba18001110 con 0x7fba280b5f80 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba10003520 con 0x7fba280b5f80 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3704013243 0 0) 0x7fba10003520 con 0x7fba280b5f80 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280d4c10 msgr2=0x7fba28162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280d4c10 0x7fba28162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 >> v1:172.21.15.107:6789/0 conn(0x7fba280d3320 legacy=0x7fba280ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:07.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba280d2880 con 0x7fba280b5f80 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7fba18001840 con 0x7fba280b5f80 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 >> v1:172.21.15.42:6789/0 conn(0x7fba280b5f80 legacy=0x7fba280b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba100039e0 0x7fba10003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280d4c10 0x7fba10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 0x7fba100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fba280d5420 con 0x7fba10004d40 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fba1000b9f0 con 0x7fba100039e0 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fba1000bbf0 con 0x7fba280d4c10 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba2cece640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 0x7fba100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba27fff640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba100039e0 0x7fba10003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba277fe640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280d4c10 0x7fba10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:07.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba2cece640 1 -- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280d4c10 msgr2=0x7fba10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:07.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba2cece640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280d4c10 0x7fba10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:07.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba2cece640 1 -- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba100039e0 msgr2=0x7fba10003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:07.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba2cece640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba100039e0 0x7fba10003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:07.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.137+0000 7fba2cece640 1 -- 172.21.15.42:0/4110160667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba10003520 con 0x7fba10004d40 2024-09-16T01:55:07.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.138+0000 7fba2cece640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 0x7fba100051c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fba20002130 tx=0x7fba10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7105bd2c9b78308a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:07.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.138+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20001d00 con 0x7fba10004d40 2024-09-16T01:55:07.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.138+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba20031620 con 0x7fba10004d40 2024-09-16T01:55:07.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.138+0000 7fba26ffd640 1 -- 172.21.15.42:0/4110160667 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20031a10 con 0x7fba10004d40 2024-09-16T01:55:07.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.139+0000 7fba2e931640 1 -- 172.21.15.42:0/4110160667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 msgr2=0x7fba100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:07.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.139+0000 7fba2e931640 1 --2- 172.21.15.42:0/4110160667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 0x7fba100051c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fba20002130 tx=0x7fba10005830 comp rx=0 tx=0).stop 2024-09-16T01:55:07.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.139+0000 7fba2cece640 1 -- 172.21.15.42:0/4110160667 reap_dead start 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.139+0000 7fba2e931640 1 -- 172.21.15.42:0/4110160667 shutdown_connections 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.139+0000 7fba2e931640 1 -- 172.21.15.42:0/4110160667 >> 172.21.15.42:0/4110160667 conn(0x7fba2808bfc0 msgr2=0x7fba280d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.139+0000 7fba2e931640 1 -- 172.21.15.42:0/4110160667 shutdown_connections 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.139+0000 7fba2e931640 1 -- 172.21.15.42:0/4110160667 wait complete. 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.140+0000 7fba2e931640 1 Processor -- start 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.140+0000 7fba2e931640 1 -- start start 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba2e931640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 0x7fba28152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba2e931640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba2815add0 0x7fba2815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba2e931640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280c89f0 0x7fba280c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba2e931640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fba280d2b20 con 0x7fba10004d40 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba2e931640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fba280d2e90 con 0x7fba2815add0 2024-09-16T01:55:07.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba2e931640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fba2815f690 con 0x7fba280c89f0 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba27fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 0x7fba28152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba27fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 0x7fba28152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56820/0 (socket says 172.21.15.42:56820) 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba27fff640 1 -- 172.21.15.42:0/2135938371 learned_addr learned my addr 172.21.15.42:0/2135938371 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba277fe640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba2815add0 0x7fba2815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba2cece640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280c89f0 0x7fba280c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba27fff640 1 -- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280c89f0 msgr2=0x7fba280c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.141+0000 7fba27fff640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280c89f0 0x7fba280c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.142+0000 7fba27fff640 1 -- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba2815add0 msgr2=0x7fba2815b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.142+0000 7fba27fff640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba2815add0 0x7fba2815b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.142+0000 7fba27fff640 1 -- 172.21.15.42:0/2135938371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2815b890 con 0x7fba10004d40 2024-09-16T01:55:07.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.142+0000 7fba27fff640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 0x7fba28152380 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fba18007290 tx=0x7fba18007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:07.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.142+0000 7fba24ff9640 1 -- 172.21.15.42:0/2135938371 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18004e30 con 0x7fba10004d40 2024-09-16T01:55:07.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.142+0000 7fba24ff9640 1 -- 172.21.15.42:0/2135938371 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba18018070 con 0x7fba10004d40 2024-09-16T01:55:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.142+0000 7fba2e931640 1 -- 172.21.15.42:0/2135938371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba2815bb70 con 0x7fba10004d40 2024-09-16T01:55:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.142+0000 7fba24ff9640 1 -- 172.21.15.42:0/2135938371 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1800fba0 con 0x7fba10004d40 2024-09-16T01:55:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.142+0000 7fba2e931640 1 -- 172.21.15.42:0/2135938371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba280b87e0 con 0x7fba10004d40 2024-09-16T01:55:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.143+0000 7fba2e931640 1 -- 172.21.15.42:0/2135938371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba280d37b0 con 0x7fba10004d40 2024-09-16T01:55:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.143+0000 7fba24ff9640 1 -- 172.21.15.42:0/2135938371 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fba1800fd40 con 0x7fba10004d40 2024-09-16T01:55:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.144+0000 7fba24ff9640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba1406c2e0 0x7fba1406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.144+0000 7fba24ff9640 1 -- 172.21.15.42:0/2135938371 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7fba1808b530 con 0x7fba10004d40 2024-09-16T01:55:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.144+0000 7fba277fe640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba1406c2e0 0x7fba1406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:07.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.145+0000 7fba277fe640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba1406c2e0 0x7fba1406e7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fba280d04f0 tx=0x7fba1c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:07.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.148+0000 7fba24ff9640 1 -- 172.21.15.42:0/2135938371 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba280d2600 con 0x7fba10004d40 2024-09-16T01:55:07.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:07.327+0000 7fba2e931640 1 -- 172.21.15.42:0/2135938371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fba28160d40 con 0x7fba10004d40 2024-09-16T01:55:08.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.009+0000 7fba24ff9640 1 -- 172.21.15.42:0/2135938371 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7fba18059b80 con 0x7fba10004d40 2024-09-16T01:55:08.011 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data_ec' removed 2024-09-16T01:55:08.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.013+0000 7fba2e931640 1 -- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba1406c2e0 msgr2=0x7fba1406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:08.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba1406c2e0 0x7fba1406e7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fba280d04f0 tx=0x7fba1c009190 comp rx=0 tx=0).stop 2024-09-16T01:55:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 -- 172.21.15.42:0/2135938371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 msgr2=0x7fba28152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 0x7fba28152380 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fba18007290 tx=0x7fba18007690 comp rx=0 tx=0).stop 2024-09-16T01:55:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 -- 172.21.15.42:0/2135938371 shutdown_connections 2024-09-16T01:55:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fba1406c2e0 0x7fba1406e7a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba280c89f0 0x7fba280c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba2815add0 0x7fba2815b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 --2- 172.21.15.42:0/2135938371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10004d40 0x7fba28152380 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 -- 172.21.15.42:0/2135938371 >> 172.21.15.42:0/2135938371 conn(0x7fba2808bfc0 msgr2=0x7fba280d39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 -- 172.21.15.42:0/2135938371 shutdown_connections 2024-09-16T01:55:08.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.014+0000 7fba2e931640 1 -- 172.21.15.42:0/2135938371 wait complete. 2024-09-16T01:55:08.032 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:55:08.032 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:55:08.032 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:55:08.033 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:55:08.033 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:55:08.033 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:55:08.033 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:55:08.033 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:55:08.033 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:55:08.033 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:55:08.034 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:55:08.034 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:55:08.034 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:55:08.034 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:55:08.034 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:55:08.034 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:55:08.044 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:55:08.044 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:55:08.045 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:55:08.045 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:55:08.046 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:55:08.046 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:55:08.047 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:55:08.047 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:55:08.087 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:55:08.088 DEBUG:teuthology.parallel:result is None 2024-09-16T01:55:08.088 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:55:08.088 DEBUG:teuthology.parallel:result is None 2024-09-16T01:55:08.089 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:55:08.089 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:55:08.089 DEBUG:teuthology.parallel:result is None 2024-09-16T01:55:08.090 DEBUG:teuthology.parallel:result is None 2024-09-16T01:55:08.090 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:55:08.170 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-09-16T01:55:08.170 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-09-16T01:55:08.172 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-16T01:55:08.173 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-16T01:55:08.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.204+0000 7fe88e79f640 1 Processor -- start 2024-09-16T01:55:08.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.204+0000 7fe88e79f640 1 -- start start 2024-09-16T01:55:08.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe88e79f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe888161c80 0x7fe88806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:08.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe88e79f640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe88806e870 con 0x7fe888162060 2024-09-16T01:55:08.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe88e79f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe88806d9f0 con 0x7fe8880b6680 2024-09-16T01:55:08.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe8877fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe888162060 0x7fe8880b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53060/0 (socket says 172.21.15.42:53060) 2024-09-16T01:55:08.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe8877fe640 1 -- 172.21.15.42:0/2302047498 learned_addr learned my addr 172.21.15.42:0/2302047498 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:08.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe88e79f640 1 -- 172.21.15.42:0/2302047498 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe88806dcd0 con 0x7fe888161c80 2024-09-16T01:55:08.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe887fff640 1 --2- 172.21.15.42:0/2302047498 >> v2:172.21.15.107:3300/0 conn(0x7fe888161c80 0x7fe88806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:08.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe886ffd640 1 -- 172.21.15.42:0/2302047498 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724668220 0 0) 0x7fe87c001110 con 0x7fe888162060 2024-09-16T01:55:08.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe886ffd640 1 -- 172.21.15.42:0/2302047498 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe870003520 con 0x7fe888162060 2024-09-16T01:55:08.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe886ffd640 1 -- 172.21.15.42:0/2302047498 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528622763 0 0) 0x7fe88806d9f0 con 0x7fe8880b6680 2024-09-16T01:55:08.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe886ffd640 1 -- 172.21.15.42:0/2302047498 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe87c001110 con 0x7fe8880b6680 2024-09-16T01:55:08.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe886ffd640 1 -- 172.21.15.42:0/2302047498 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4294876119 0 0) 0x7fe870003520 con 0x7fe888162060 2024-09-16T01:55:08.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe887fff640 1 -- 172.21.15.42:0/2302047498 >> v1:172.21.15.107:6789/0 conn(0x7fe8880b6680 legacy=0x7fe8880cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:08.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe887fff640 1 -- 172.21.15.42:0/2302047498 >> v1:172.21.15.42:6789/0 conn(0x7fe888162060 legacy=0x7fe8880b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:08.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.205+0000 7fe887fff640 1 -- 172.21.15.42:0/2302047498 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88806dfb0 con 0x7fe888161c80 2024-09-16T01:55:08.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.206+0000 7fe887fff640 1 --2- 172.21.15.42:0/2302047498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe888161c80 0x7fe88806e330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe8780097a0 tx=0x7fe87802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c4bee8c093eaa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:08.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.206+0000 7fe886ffd640 1 -- 172.21.15.42:0/2302047498 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878037070 con 0x7fe888161c80 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.206+0000 7fe886ffd640 1 -- 172.21.15.42:0/2302047498 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87802ac50 con 0x7fe888161c80 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.206+0000 7fe886ffd640 1 -- 172.21.15.42:0/2302047498 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c001840 con 0x7fe888161c80 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.207+0000 7fe88e79f640 1 -- 172.21.15.42:0/2302047498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe888161c80 msgr2=0x7fe88806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.207+0000 7fe88e79f640 1 --2- 172.21.15.42:0/2302047498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe888161c80 0x7fe88806e330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe8780097a0 tx=0x7fe87802a1c0 comp rx=0 tx=0).stop 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.207+0000 7fe88e79f640 1 -- 172.21.15.42:0/2302047498 shutdown_connections 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.207+0000 7fe88e79f640 1 --2- 172.21.15.42:0/2302047498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe888161c80 0x7fe88806e330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.207+0000 7fe88e79f640 1 -- 172.21.15.42:0/2302047498 >> 172.21.15.42:0/2302047498 conn(0x7fe8880d44f0 msgr2=0x7fe8880d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.207+0000 7fe88e79f640 1 -- 172.21.15.42:0/2302047498 shutdown_connections 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.207+0000 7fe88e79f640 1 -- 172.21.15.42:0/2302047498 wait complete. 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.208+0000 7fe88e79f640 1 Processor -- start 2024-09-16T01:55:08.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.208+0000 7fe88e79f640 1 -- start start 2024-09-16T01:55:08.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe88e79f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8880b6680 0x7fe8881f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:08.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe88e79f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe888161c80 0x7fe8881f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe88e79f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe888162060 0x7fe8881603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe88e79f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880b6b30 con 0x7fe8880b6680 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe88e79f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880d2aa0 con 0x7fe888162060 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe88e79f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe8880b6cb0 con 0x7fe888161c80 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe887fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8880b6680 0x7fe8881f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe887fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8880b6680 0x7fe8881f3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35884/0 (socket says 172.21.15.42:35884) 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe887fff640 1 -- 172.21.15.42:0/741437585 learned_addr learned my addr 172.21.15.42:0/741437585 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe8877fe640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe888161c80 0x7fe8881f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.209+0000 7fe88cd3c640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe888162060 0x7fe8881603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe887fff640 1 -- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe888161c80 msgr2=0x7fe8881f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe887fff640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe888161c80 0x7fe8881f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:08.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe887fff640 1 -- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe888162060 msgr2=0x7fe8881603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:08.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe887fff640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe888162060 0x7fe8881603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:08.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe887fff640 1 -- 172.21.15.42:0/741437585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8880cba50 con 0x7fe8880b6680 2024-09-16T01:55:08.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe887fff640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8880b6680 0x7fe8881f3fd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe878035040 tx=0x7fe8780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:08.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe884ff9640 1 -- 172.21.15.42:0/741437585 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878041020 con 0x7fe8880b6680 2024-09-16T01:55:08.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe88e79f640 1 -- 172.21.15.42:0/741437585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8880cbd30 con 0x7fe8880b6680 2024-09-16T01:55:08.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe884ff9640 1 -- 172.21.15.42:0/741437585 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87803d420 con 0x7fe8880b6680 2024-09-16T01:55:08.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe884ff9640 1 -- 172.21.15.42:0/741437585 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878037040 con 0x7fe8880b6680 2024-09-16T01:55:08.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.210+0000 7fe88e79f640 1 -- 172.21.15.42:0/741437585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8880cc2f0 con 0x7fe8880b6680 2024-09-16T01:55:08.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.211+0000 7fe88e79f640 1 -- 172.21.15.42:0/741437585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88806e330 con 0x7fe8880b6680 2024-09-16T01:55:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.212+0000 7fe884ff9640 1 -- 172.21.15.42:0/741437585 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe878044020 con 0x7fe8880b6680 2024-09-16T01:55:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.212+0000 7fe884ff9640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe87406c2b0 0x7fe87406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.212+0000 7fe884ff9640 1 -- 172.21.15.42:0/741437585 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5335+0+0 (secure 0 0 0) 0x7fe8780ab6b0 con 0x7fe8880b6680 2024-09-16T01:55:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.213+0000 7fe8877fe640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe87406c2b0 0x7fe87406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.213+0000 7fe8877fe640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe87406c2b0 0x7fe87406e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe8880d2220 tx=0x7fe87c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:08.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.217+0000 7fe884ff9640 1 -- 172.21.15.42:0/741437585 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe87804b030 con 0x7fe8880b6680 2024-09-16T01:55:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:08.404+0000 7fe88e79f640 1 -- 172.21.15.42:0/741437585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe88806bda0 con 0x7fe8880b6680 2024-09-16T01:55:09.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.030+0000 7fe884ff9640 1 -- 172.21.15.42:0/741437585 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7fe878079f10 con 0x7fe8880b6680 2024-09-16T01:55:09.032 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-16T01:55:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 -- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe87406c2b0 msgr2=0x7fe87406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe87406c2b0 0x7fe87406e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe8880d2220 tx=0x7fe87c009040 comp rx=0 tx=0).stop 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 -- 172.21.15.42:0/741437585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8880b6680 msgr2=0x7fe8881f3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8880b6680 0x7fe8881f3fd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe878035040 tx=0x7fe8780046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 -- 172.21.15.42:0/741437585 shutdown_connections 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe87406c2b0 0x7fe87406e770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe888162060 0x7fe8881603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe888161c80 0x7fe8881f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 --2- 172.21.15.42:0/741437585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8880b6680 0x7fe8881f3fd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 -- 172.21.15.42:0/741437585 >> 172.21.15.42:0/741437585 conn(0x7fe8880d44f0 msgr2=0x7fe8880b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 -- 172.21.15.42:0/741437585 shutdown_connections 2024-09-16T01:55:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.033+0000 7fe88e79f640 1 -- 172.21.15.42:0/741437585 wait complete. 2024-09-16T01:55:09.051 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:55:09.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.154+0000 7f8385c65640 1 Processor -- start 2024-09-16T01:55:09.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.154+0000 7f8385c65640 1 -- start start 2024-09-16T01:55:09.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.155+0000 7f8385c65640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f838015e760 0x7f838006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.155+0000 7f8385c65640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800d4fd0 0x7f83800cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.155+0000 7f8385c65640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83800d2700 con 0x7f83800b3650 2024-09-16T01:55:09.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.155+0000 7f8385c65640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f83800cedb0 con 0x7f838015e760 2024-09-16T01:55:09.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.155+0000 7f8385c65640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f83800cf090 con 0x7f83800d4fd0 2024-09-16T01:55:09.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.155+0000 7f837effd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800d4fd0 0x7f83800cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.155+0000 7f837f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f838015e760 0x7f838006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.155+0000 7f837ffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f83800b3650 0x7f83800d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:54178/0 (socket says 172.21.15.42:54178) 2024-09-16T01:55:09.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.155+0000 7f837ffff640 1 -- 172.21.15.42:0/909023622 learned_addr learned my addr 172.21.15.42:0/909023622 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.156+0000 7f837effd640 1 -- 172.21.15.42:0/909023622 >> v2:172.21.15.107:3300/0 conn(0x7f838015e760 msgr2=0x7f838006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.156+0000 7f837effd640 1 --2- 172.21.15.42:0/909023622 >> v2:172.21.15.107:3300/0 conn(0x7f838015e760 0x7f838006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.156+0000 7f837effd640 1 -- 172.21.15.42:0/909023622 >> v1:172.21.15.107:6789/0 conn(0x7f83800b3650 legacy=0x7f83800d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.156+0000 7f837effd640 1 -- 172.21.15.42:0/909023622 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83800b3c80 con 0x7f83800d4fd0 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.156+0000 7f837e7fc640 1 -- 172.21.15.42:0/909023622 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367773350 0 0) 0x7f8378001490 con 0x7f83800b3650 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.156+0000 7f837f7fe640 1 --2- 172.21.15.42:0/909023622 >> v2:172.21.15.107:3300/0 conn(0x7f838015e760 0x7f838006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f837effd640 1 --2- 172.21.15.42:0/909023622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800d4fd0 0x7f83800cf5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8368009790 tx=0x7f836802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce8eae26b85f6efe server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f837e7fc640 1 -- 172.21.15.42:0/909023622 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368037070 con 0x7f83800d4fd0 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f837e7fc640 1 -- 172.21.15.42:0/909023622 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836802ae50 con 0x7f83800d4fd0 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f837e7fc640 1 -- 172.21.15.42:0/909023622 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368032660 con 0x7f83800d4fd0 2024-09-16T01:55:09.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f8385c65640 1 -- 172.21.15.42:0/909023622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800d4fd0 msgr2=0x7f83800cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f8385c65640 1 --2- 172.21.15.42:0/909023622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800d4fd0 0x7f83800cf5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8368009790 tx=0x7f836802a100 comp rx=0 tx=0).stop 2024-09-16T01:55:09.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f8385c65640 1 -- 172.21.15.42:0/909023622 shutdown_connections 2024-09-16T01:55:09.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f8385c65640 1 --2- 172.21.15.42:0/909023622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800d4fd0 0x7f83800cf5b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f8385c65640 1 --2- 172.21.15.42:0/909023622 >> v2:172.21.15.107:3300/0 conn(0x7f838015e760 0x7f838006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f8385c65640 1 -- 172.21.15.42:0/909023622 >> 172.21.15.42:0/909023622 conn(0x7f838008bfc0 msgr2=0x7f83800d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:09.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f8385c65640 1 -- 172.21.15.42:0/909023622 shutdown_connections 2024-09-16T01:55:09.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.157+0000 7f8385c65640 1 -- 172.21.15.42:0/909023622 wait complete. 2024-09-16T01:55:09.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.158+0000 7f8385c65640 1 Processor -- start 2024-09-16T01:55:09.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.159+0000 7f8385c65640 1 -- start start 2024-09-16T01:55:09.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.159+0000 7f8385c65640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800b3650 0x7f8380148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.159+0000 7f8385c65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83800d4fd0 0x7f83801f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.159+0000 7f8385c65640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838015e760 0x7f83801f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.159+0000 7f8385c65640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83800cfe80 con 0x7f83800d4fd0 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.159+0000 7f8385c65640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f83800cfd00 con 0x7f838015e760 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.159+0000 7f8385c65640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f83800d35b0 con 0x7f83800b3650 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83800d4fd0 0x7f83801f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837effd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83800d4fd0 0x7f83801f3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35892/0 (socket says 172.21.15.42:35892) 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837effd640 1 -- 172.21.15.42:0/3162271795 learned_addr learned my addr 172.21.15.42:0/3162271795 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837f7fe640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800b3650 0x7f8380148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837ffff640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838015e760 0x7f83801f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837effd640 1 -- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800b3650 msgr2=0x7f8380148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837effd640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800b3650 0x7f8380148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837effd640 1 -- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838015e760 msgr2=0x7f83801f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837effd640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838015e760 0x7f83801f43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837effd640 1 -- 172.21.15.42:0/3162271795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838015aaf0 con 0x7f83800d4fd0 2024-09-16T01:55:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f837effd640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83800d4fd0 0x7f83801f3ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8368000c00 tx=0x7f83680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f8377fff640 1 -- 172.21.15.42:0/3162271795 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368037040 con 0x7f83800d4fd0 2024-09-16T01:55:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f8377fff640 1 -- 172.21.15.42:0/3162271795 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368004030 con 0x7f83800d4fd0 2024-09-16T01:55:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f8385c65640 1 -- 172.21.15.42:0/3162271795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838015add0 con 0x7f83800d4fd0 2024-09-16T01:55:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f8377fff640 1 -- 172.21.15.42:0/3162271795 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368004400 con 0x7f83800d4fd0 2024-09-16T01:55:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.160+0000 7f8385c65640 1 -- 172.21.15.42:0/3162271795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8380161ad0 con 0x7f83800d4fd0 2024-09-16T01:55:09.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.161+0000 7f8385c65640 1 -- 172.21.15.42:0/3162271795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83800d3930 con 0x7f83800d4fd0 2024-09-16T01:55:09.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.162+0000 7f8377fff640 1 -- 172.21.15.42:0/3162271795 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8368005990 con 0x7f83800d4fd0 2024-09-16T01:55:09.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.162+0000 7f8377fff640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f836006c2b0 0x7f836006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.162+0000 7f8377fff640 1 -- 172.21.15.42:0/3162271795 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f83680ab820 con 0x7f83800d4fd0 2024-09-16T01:55:09.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.162+0000 7f837f7fe640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f836006c2b0 0x7f836006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.163+0000 7f837f7fe640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f836006c2b0 0x7f836006e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8370009560 tx=0x7f8370009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:09.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.166+0000 7f8377fff640 1 -- 172.21.15.42:0/3162271795 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8368079b00 con 0x7f83800d4fd0 2024-09-16T01:55:09.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.405+0000 7f8385c65640 1 -- 172.21.15.42:0/3162271795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f83800b6d20 con 0x7f83800d4fd0 2024-09-16T01:55:09.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.406+0000 7f8377fff640 1 -- 172.21.15.42:0/3162271795 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) ==== 80+0+6645 (secure 0 0 0) 0x7f836807de00 con 0x7f83800d4fd0 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmMcjXCxAAT1mJYvmGTz3j/gt9V7UZSg==", 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-16T01:55:09.408 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmVSvlFxAA+JMa7tU+TmIufSm1H40/nw==", 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmzDcLExAATadyYI33hfeB5hgeHu78rQ==", 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmJPBuHxAAl4Bgbbslzm974J8HK3/0ZA==", 2024-09-16T01:55:09.410 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCRj+dm608ZChAAlxPChkfdzKXeHCIJ8BHu/w==", 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:09.411 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCUj+dmJdZ0DBAA7uQZ9GIuniJqny516zliSw==", 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.412 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCXj+dmtAqWHhAAaGW9phi3HiWZRv0OCDonuA==", 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCaj+dmZSnzIRAAk6WnucLW3q5dz9FKZxhXtA==", 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:09.413 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQChj+dmxUS9ABAApVKUWA3LGNafeCQDiPKH9w==", 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.414 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCkj+dmzCBvAxAAffM0asgUVUoQR8Lkproybg==", 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCnj+dmgHOUFBAAfSU6pxHqw51D/id51CzAww==", 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:09.415 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCqj+dmrBcXNBAAPCT+sn6Mx/1J5ItdLD7tbw==", 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dm96TxJBAAoZCGS2uSu2E2+xtA9fj+5g==", 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmkOUKLhAA+aD+mHe1UrKoAJ1cuqb6Yg==", 2024-09-16T01:55:09.417 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dm4JjPKhAAvfE6+QyfNHcahc6uzs34Zg==", 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-16T01:55:09.418 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dm4eSVMxAAP1P9R5DYorQup0ujBbfe0A==", 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCOj+dmooQvKxAARATh0bGqJJM+BLRIoIX3iw==", 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-mds", 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQC2j+dmGmmdAhAAyiZgL+hdaRTltSMOWxCgcQ==", 2024-09-16T01:55:09.420 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-mds" 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-mgr", 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQC2j+dmEpudAhAAJ2FR4x2+bx03aDctfpY8GA==", 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-osd", 2024-09-16T01:55:09.421 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQC2j+dmRKmdAhAAqeHkobIyH/XPfYoabLhf+w==", 2024-09-16T01:55:09.422 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.422 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-osd" 2024-09-16T01:55:09.422 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.422 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-rbd", 2024-09-16T01:55:09.422 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQC2j+dmDbGdAhAAr68KQetUy0PGnOmVi4AfVQ==", 2024-09-16T01:55:09.422 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.422 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQC2j+dmmb2dAhAAXKWuczD0ZrAzWhYRQdcpQg==", 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-rgw", 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQC2j+dmV8WdAhAAxIF/UgULHfaphDAkJggHAw==", 2024-09-16T01:55:09.423 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmJqF8CBAACeom3ua2ACe+FRyBfxqCnA==", 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:09.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:09.425 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-16T01:55:09.425 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmvS++BBAAz/uguUBb9FImHUTqjWn+aQ==", 2024-09-16T01:55:09.425 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:09.425 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-16T01:55:09.425 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-16T01:55:09.425 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:09.425 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.425 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:09.425 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-16T01:55:09.425 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:55:09.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 -- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f836006c2b0 msgr2=0x7f836006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f836006c2b0 0x7f836006e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8370009560 tx=0x7f8370009190 comp rx=0 tx=0).stop 2024-09-16T01:55:09.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 -- 172.21.15.42:0/3162271795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83800d4fd0 msgr2=0x7f83801f3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83800d4fd0 0x7f83801f3ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8368000c00 tx=0x7f83680046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 -- 172.21.15.42:0/3162271795 shutdown_connections 2024-09-16T01:55:09.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f836006c2b0 0x7f836006e770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f838015e760 0x7f83801f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83800d4fd0 0x7f83801f3ea0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 --2- 172.21.15.42:0/3162271795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f83800b3650 0x7f8380148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 -- 172.21.15.42:0/3162271795 >> 172.21.15.42:0/3162271795 conn(0x7f838008bfc0 msgr2=0x7f83800d3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:09.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 -- 172.21.15.42:0/3162271795 shutdown_connections 2024-09-16T01:55:09.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.408+0000 7f8385c65640 1 -- 172.21.15.42:0/3162271795 wait complete. 2024-09-16T01:55:09.428 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-16T01:55:09.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.533+0000 7fb24bb98640 1 Processor -- start 2024-09-16T01:55:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.533+0000 7fb24bb98640 1 -- start start 2024-09-16T01:55:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb24bb98640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb24415e740 0x7fb2440d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb24bb98640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 0x7fb24406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb24bb98640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb24406d4c0 0x7fb24406d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb24bb98640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fb24415eb20 con 0x7fb24415e740 2024-09-16T01:55:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb24bb98640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb24406d260 con 0x7fb24406d4c0 2024-09-16T01:55:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb24bb98640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb2440d0780 con 0x7fb24409b690 2024-09-16T01:55:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb249934640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb24415e740 0x7fb2440d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb249934640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb24415e740 0x7fb2440d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35908/0 (socket says 172.21.15.42:35908) 2024-09-16T01:55:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb249934640 1 -- 172.21.15.42:0/1750767856 learned_addr learned my addr 172.21.15.42:0/1750767856 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb249133640 1 --2- 172.21.15.42:0/1750767856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 0x7fb24406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.534+0000 7fb24a135640 1 --2- 172.21.15.42:0/1750767856 >> v2:172.21.15.107:3300/0 conn(0x7fb24406d4c0 0x7fb24406d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.535+0000 7fb249934640 1 -- 172.21.15.42:0/1750767856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 msgr2=0x7fb24406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.535+0000 7fb249934640 1 --2- 172.21.15.42:0/1750767856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 0x7fb24406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.535+0000 7fb249934640 1 -- 172.21.15.42:0/1750767856 >> v2:172.21.15.107:3300/0 conn(0x7fb24406d4c0 msgr2=0x7fb24406d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.535+0000 7fb249934640 1 --2- 172.21.15.42:0/1750767856 >> v2:172.21.15.107:3300/0 conn(0x7fb24406d4c0 0x7fb24406d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.535+0000 7fb249934640 1 -- 172.21.15.42:0/1750767856 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2440d0a60 con 0x7fb24415e740 2024-09-16T01:55:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.535+0000 7fb24a135640 1 --2- 172.21.15.42:0/1750767856 >> v2:172.21.15.107:3300/0 conn(0x7fb24406d4c0 0x7fb24406d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:09.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.535+0000 7fb249934640 1 --2- 172.21.15.42:0/1750767856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 0x7fb2440d1540 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb244163240 tx=0x7fb24002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5c8c5f7898311f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.535+0000 7fb248932640 1 -- 172.21.15.42:0/1750767856 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240037070 con 0x7fb24415e740 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb248932640 1 -- 172.21.15.42:0/1750767856 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb240032440 con 0x7fb24415e740 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb248932640 1 -- 172.21.15.42:0/1750767856 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240032810 con 0x7fb24415e740 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb24bb98640 1 -- 172.21.15.42:0/1750767856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 msgr2=0x7fb2440d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb24bb98640 1 --2- 172.21.15.42:0/1750767856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 0x7fb2440d1540 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb244163240 tx=0x7fb24002a2a0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb24bb98640 1 -- 172.21.15.42:0/1750767856 shutdown_connections 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb24bb98640 1 --2- 172.21.15.42:0/1750767856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 0x7fb24406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb24bb98640 1 --2- 172.21.15.42:0/1750767856 >> v2:172.21.15.107:3300/0 conn(0x7fb24406d4c0 0x7fb24406d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb24bb98640 1 --2- 172.21.15.42:0/1750767856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 0x7fb2440d1540 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb24bb98640 1 -- 172.21.15.42:0/1750767856 >> 172.21.15.42:0/1750767856 conn(0x7fb2440d23a0 msgr2=0x7fb2440d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb24bb98640 1 -- 172.21.15.42:0/1750767856 shutdown_connections 2024-09-16T01:55:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.536+0000 7fb24bb98640 1 -- 172.21.15.42:0/1750767856 wait complete. 2024-09-16T01:55:09.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.537+0000 7fb24bb98640 1 Processor -- start 2024-09-16T01:55:09.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.537+0000 7fb24bb98640 1 -- start start 2024-09-16T01:55:09.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.538+0000 7fb24bb98640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb24406d4c0 0x7fb2440b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.538+0000 7fb24bb98640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 0x7fb2440c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.538+0000 7fb24bb98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 0x7fb24415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.538+0000 7fb24bb98640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb24409ba90 con 0x7fb24415e740 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.538+0000 7fb24bb98640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440d1020 con 0x7fb24406d4c0 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.538+0000 7fb24bb98640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb24406de30 con 0x7fb24409b690 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.538+0000 7fb24a135640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 0x7fb24415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.538+0000 7fb24a135640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 0x7fb24415d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35916/0 (socket says 172.21.15.42:35916) 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.538+0000 7fb24a135640 1 -- 172.21.15.42:0/833128320 learned_addr learned my addr 172.21.15.42:0/833128320 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.538+0000 7fb249133640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 0x7fb2440c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb249934640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb24406d4c0 0x7fb2440b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb24a135640 1 -- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 msgr2=0x7fb2440c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb24a135640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 0x7fb2440c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb24a135640 1 -- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb24406d4c0 msgr2=0x7fb2440b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb24a135640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb24406d4c0 0x7fb2440b7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb24a135640 1 -- 172.21.15.42:0/833128320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24415dc90 con 0x7fb24415e740 2024-09-16T01:55:09.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb249133640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 0x7fb2440c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:09.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb249934640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb24406d4c0 0x7fb2440b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:09.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb24a135640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 0x7fb24415d750 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009fa0 tx=0x7fb23c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:09.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb2367fc640 1 -- 172.21.15.42:0/833128320 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c01a070 con 0x7fb24415e740 2024-09-16T01:55:09.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb2367fc640 1 -- 172.21.15.42:0/833128320 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c003bb0 con 0x7fb24415e740 2024-09-16T01:55:09.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb2367fc640 1 -- 172.21.15.42:0/833128320 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c004030 con 0x7fb24415e740 2024-09-16T01:55:09.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb24bb98640 1 -- 172.21.15.42:0/833128320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2440c9bc0 con 0x7fb24415e740 2024-09-16T01:55:09.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.539+0000 7fb24bb98640 1 -- 172.21.15.42:0/833128320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2440ca180 con 0x7fb24415e740 2024-09-16T01:55:09.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.540+0000 7fb24bb98640 1 -- 172.21.15.42:0/833128320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24406d8f0 con 0x7fb24415e740 2024-09-16T01:55:09.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.541+0000 7fb2367fc640 1 -- 172.21.15.42:0/833128320 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb23c01d070 con 0x7fb24415e740 2024-09-16T01:55:09.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.541+0000 7fb2367fc640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb22806c2b0 0x7fb22806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.541+0000 7fb2367fc640 1 -- 172.21.15.42:0/833128320 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fb23c08b5c0 con 0x7fb24415e740 2024-09-16T01:55:09.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.541+0000 7fb249934640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb22806c2b0 0x7fb22806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.542+0000 7fb249934640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb22806c2b0 0x7fb22806e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb240034000 tx=0x7fb24002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:09.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.545+0000 7fb2367fc640 1 -- 172.21.15.42:0/833128320 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb23c010070 con 0x7fb24415e740 2024-09-16T01:55:09.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.790+0000 7fb24bb98640 1 -- 172.21.15.42:0/833128320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fb2440b2070 con 0x7fb24415e740 2024-09-16T01:55:09.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.792+0000 7fb2367fc640 1 -- 172.21.15.42:0/833128320 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fb23c059ef0 con 0x7fb24415e740 2024-09-16T01:55:09.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 -- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb22806c2b0 msgr2=0x7fb22806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb22806c2b0 0x7fb22806e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb240034000 tx=0x7fb24002e000 comp rx=0 tx=0).stop 2024-09-16T01:55:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 -- 172.21.15.42:0/833128320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 msgr2=0x7fb24415d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 0x7fb24415d750 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009fa0 tx=0x7fb23c00d560 comp rx=0 tx=0).stop 2024-09-16T01:55:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 -- 172.21.15.42:0/833128320 shutdown_connections 2024-09-16T01:55:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb22806c2b0 0x7fb22806e770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24415e740 0x7fb24415d750 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb24409b690 0x7fb2440c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 --2- 172.21.15.42:0/833128320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb24406d4c0 0x7fb2440b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 -- 172.21.15.42:0/833128320 >> 172.21.15.42:0/833128320 conn(0x7fb2440d23a0 msgr2=0x7fb2440b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 -- 172.21.15.42:0/833128320 shutdown_connections 2024-09-16T01:55:09.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.795+0000 7fb24bb98640 1 -- 172.21.15.42:0/833128320 wait complete. 2024-09-16T01:55:09.807 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-16T01:55:09.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.911+0000 7f8b473c4640 1 Processor -- start 2024-09-16T01:55:09.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.912+0000 7f8b473c4640 1 -- start start 2024-09-16T01:55:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.912+0000 7f8b473c4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b4015b340 0x7f8b4009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b473c4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 0x7f8b400b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b473c4640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b400b3830 con 0x7f8b400b4e80 2024-09-16T01:55:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b473c4640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f8b400b5bd0 con 0x7f8b4015b340 2024-09-16T01:55:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b473c4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b400b5610 con 0x7f8b400b43f0 2024-09-16T01:55:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b45160640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b4015b340 0x7f8b4009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b45160640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b4015b340 0x7f8b4009aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35924/0 (socket says 172.21.15.42:35924) 2024-09-16T01:55:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b45160640 1 -- 172.21.15.42:0/3274384484 learned_addr learned my addr 172.21.15.42:0/3274384484 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b4495f640 1 --2- 172.21.15.42:0/3274384484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 0x7f8b400b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b45160640 1 -- 172.21.15.42:0/3274384484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 msgr2=0x7f8b400b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b45160640 1 --2- 172.21.15.42:0/3274384484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 0x7f8b400b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b45160640 1 -- 172.21.15.42:0/3274384484 >> v1:172.21.15.107:6789/0 conn(0x7f8b400b4e80 legacy=0x7f8b4015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b45160640 1 -- 172.21.15.42:0/3274384484 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b400b58f0 con 0x7f8b4015b340 2024-09-16T01:55:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.913+0000 7f8b4495f640 1 --2- 172.21.15.42:0/3274384484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 0x7f8b400b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.914+0000 7f8b45160640 1 --2- 172.21.15.42:0/3274384484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b4015b340 0x7f8b4009aa30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6eea8e7216e6451 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:09.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.914+0000 7f8b37fff640 1 -- 172.21.15.42:0/3274384484 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c037070 con 0x7f8b4015b340 2024-09-16T01:55:09.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.914+0000 7f8b37fff640 1 -- 172.21.15.42:0/3274384484 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3c02ae50 con 0x7f8b4015b340 2024-09-16T01:55:09.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.914+0000 7f8b37fff640 1 -- 172.21.15.42:0/3274384484 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c032860 con 0x7f8b4015b340 2024-09-16T01:55:09.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.914+0000 7f8b473c4640 1 -- 172.21.15.42:0/3274384484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b4015b340 msgr2=0x7f8b4009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.914+0000 7f8b473c4640 1 --2- 172.21.15.42:0/3274384484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b4015b340 0x7f8b4009aa30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c02a300 comp rx=0 tx=0).stop 2024-09-16T01:55:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.914+0000 7f8b473c4640 1 -- 172.21.15.42:0/3274384484 shutdown_connections 2024-09-16T01:55:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.914+0000 7f8b473c4640 1 --2- 172.21.15.42:0/3274384484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 0x7f8b400b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.914+0000 7f8b473c4640 1 --2- 172.21.15.42:0/3274384484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b4015b340 0x7f8b4009aa30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.915+0000 7f8b473c4640 1 -- 172.21.15.42:0/3274384484 >> 172.21.15.42:0/3274384484 conn(0x7f8b40073490 msgr2=0x7f8b400b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.915+0000 7f8b473c4640 1 -- 172.21.15.42:0/3274384484 shutdown_connections 2024-09-16T01:55:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.915+0000 7f8b473c4640 1 -- 172.21.15.42:0/3274384484 wait complete. 2024-09-16T01:55:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.916+0000 7f8b473c4640 1 Processor -- start 2024-09-16T01:55:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.916+0000 7f8b473c4640 1 -- start start 2024-09-16T01:55:09.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b473c4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 0x7f8b4014a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b473c4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b400b4e80 0x7f8b40147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b473c4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4015b340 0x7f8b4013fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b473c4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b400b5310 con 0x7f8b400b4e80 2024-09-16T01:55:09.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b473c4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4015d8f0 con 0x7f8b4015b340 2024-09-16T01:55:09.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b473c4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4015c730 con 0x7f8b400b43f0 2024-09-16T01:55:09.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b4495f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b400b4e80 0x7f8b40147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b4495f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b400b4e80 0x7f8b40147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35936/0 (socket says 172.21.15.42:35936) 2024-09-16T01:55:09.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b4495f640 1 -- 172.21.15.42:0/1479955083 learned_addr learned my addr 172.21.15.42:0/1479955083 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:09.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b45160640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 0x7f8b4014a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b45961640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4015b340 0x7f8b4013fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b4495f640 1 -- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 msgr2=0x7f8b4014a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b4495f640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 0x7f8b4014a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b4495f640 1 -- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4015b340 msgr2=0x7f8b4013fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:09.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b4495f640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4015b340 0x7f8b4013fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:09.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b4495f640 1 -- 172.21.15.42:0/1479955083 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b40149180 con 0x7f8b400b4e80 2024-09-16T01:55:09.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b4495f640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b400b4e80 0x7f8b40147980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000e730 tx=0x7f8b3000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:09.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b35ffb640 1 -- 172.21.15.42:0/1479955083 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000f040 con 0x7f8b400b4e80 2024-09-16T01:55:09.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b35ffb640 1 -- 172.21.15.42:0/1479955083 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b30004230 con 0x7f8b400b4e80 2024-09-16T01:55:09.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.917+0000 7f8b473c4640 1 -- 172.21.15.42:0/1479955083 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b40149420 con 0x7f8b400b4e80 2024-09-16T01:55:09.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.918+0000 7f8b35ffb640 1 -- 172.21.15.42:0/1479955083 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000ee40 con 0x7f8b400b4e80 2024-09-16T01:55:09.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.918+0000 7f8b473c4640 1 -- 172.21.15.42:0/1479955083 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b40149cc0 con 0x7f8b400b4e80 2024-09-16T01:55:09.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.919+0000 7f8b473c4640 1 -- 172.21.15.42:0/1479955083 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b401495f0 con 0x7f8b400b4e80 2024-09-16T01:55:09.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.919+0000 7f8b35ffb640 1 -- 172.21.15.42:0/1479955083 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8b3000c6d0 con 0x7f8b400b4e80 2024-09-16T01:55:09.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.919+0000 7f8b35ffb640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b2406c2b0 0x7f8b2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:09.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.919+0000 7f8b35ffb640 1 -- 172.21.15.42:0/1479955083 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f8b3008aea0 con 0x7f8b400b4e80 2024-09-16T01:55:09.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.920+0000 7f8b45160640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b2406c2b0 0x7f8b2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:09.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.920+0000 7f8b45160640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b2406c2b0 0x7f8b2406e770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c034000 tx=0x7f8b3c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:09.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:09.924+0000 7f8b35ffb640 1 -- 172.21.15.42:0/1479955083 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b30017020 con 0x7f8b400b4e80 2024-09-16T01:55:10.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.168+0000 7f8b473c4640 1 -- 172.21.15.42:0/1479955083 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f8b400cecb0 con 0x7f8b400b4e80 2024-09-16T01:55:10.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.171+0000 7f8b35ffb640 1 -- 172.21.15.42:0/1479955083 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f8b30059180 con 0x7f8b400b4e80 2024-09-16T01:55:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 -- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b2406c2b0 msgr2=0x7f8b2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b2406c2b0 0x7f8b2406e770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c034000 tx=0x7f8b3c02e000 comp rx=0 tx=0).stop 2024-09-16T01:55:10.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 -- 172.21.15.42:0/1479955083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b400b4e80 msgr2=0x7f8b40147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b400b4e80 0x7f8b40147980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000e730 tx=0x7f8b3000ebf0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 -- 172.21.15.42:0/1479955083 shutdown_connections 2024-09-16T01:55:10.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b2406c2b0 0x7f8b2406e770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b4015b340 0x7f8b4013fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b400b4e80 0x7f8b40147980 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 --2- 172.21.15.42:0/1479955083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b400b43f0 0x7f8b4014a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 -- 172.21.15.42:0/1479955083 >> 172.21.15.42:0/1479955083 conn(0x7f8b40073490 msgr2=0x7f8b4014c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:10.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 -- 172.21.15.42:0/1479955083 shutdown_connections 2024-09-16T01:55:10.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.173+0000 7f8b473c4640 1 -- 172.21.15.42:0/1479955083 wait complete. 2024-09-16T01:55:10.185 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-16T01:55:10.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.288+0000 7f44c20fa640 1 Processor -- start 2024-09-16T01:55:10.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.288+0000 7f44c20fa640 1 -- start start 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44c20fa640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 0x7f44bc0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44c20fa640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f44bc06dbd0 0x7f44bc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44c20fa640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44bc06e040 con 0x7f44bc09b690 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44c20fa640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f44bc15eb20 con 0x7f44bc06dbd0 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44c20fa640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f44bc06d260 con 0x7f44bc15e740 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44bbfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f44bc06dbd0 0x7f44bc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44baffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f44bc09b690 0x7f44bc06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53070/0 (socket says 172.21.15.42:53070) 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44baffd640 1 -- 172.21.15.42:0/238801981 learned_addr learned my addr 172.21.15.42:0/238801981 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44bb7fe640 1 --2- 172.21.15.42:0/238801981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 0x7f44bc0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44bbfff640 1 -- 172.21.15.42:0/238801981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 msgr2=0x7f44bc0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44bbfff640 1 --2- 172.21.15.42:0/238801981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 0x7f44bc0d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44bbfff640 1 -- 172.21.15.42:0/238801981 >> v1:172.21.15.42:6789/0 conn(0x7f44bc09b690 legacy=0x7f44bc06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44bbfff640 1 -- 172.21.15.42:0/238801981 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc0d0780 con 0x7f44bc06dbd0 2024-09-16T01:55:10.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44ba7fc640 1 -- 172.21.15.42:0/238801981 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146568957 0 0) 0x7f44bc06e040 con 0x7f44bc09b690 2024-09-16T01:55:10.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.289+0000 7f44bb7fe640 1 --2- 172.21.15.42:0/238801981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 0x7f44bc0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:10.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.290+0000 7f44bbfff640 1 --2- 172.21.15.42:0/238801981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 0x7f44bc06cd20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009dc0 tx=0x7f44b402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be37215532013385 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:10.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.290+0000 7f44ba7fc640 1 -- 172.21.15.42:0/238801981 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b4007740 con 0x7f44bc06dbd0 2024-09-16T01:55:10.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.290+0000 7f44ba7fc640 1 -- 172.21.15.42:0/238801981 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b40078e0 con 0x7f44bc06dbd0 2024-09-16T01:55:10.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.290+0000 7f44ba7fc640 1 -- 172.21.15.42:0/238801981 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b4007cb0 con 0x7f44bc06dbd0 2024-09-16T01:55:10.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.291+0000 7f44c20fa640 1 -- 172.21.15.42:0/238801981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 msgr2=0x7f44bc06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.291+0000 7f44c20fa640 1 --2- 172.21.15.42:0/238801981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 0x7f44bc06cd20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009dc0 tx=0x7f44b402a710 comp rx=0 tx=0).stop 2024-09-16T01:55:10.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.291+0000 7f44c20fa640 1 -- 172.21.15.42:0/238801981 shutdown_connections 2024-09-16T01:55:10.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.291+0000 7f44c20fa640 1 --2- 172.21.15.42:0/238801981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 0x7f44bc06cd20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.291+0000 7f44c20fa640 1 --2- 172.21.15.42:0/238801981 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 0x7f44bc0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.291+0000 7f44c20fa640 1 -- 172.21.15.42:0/238801981 >> 172.21.15.42:0/238801981 conn(0x7f44bc0d23a0 msgr2=0x7f44bc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:10.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.291+0000 7f44c20fa640 1 -- 172.21.15.42:0/238801981 shutdown_connections 2024-09-16T01:55:10.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.291+0000 7f44c20fa640 1 -- 172.21.15.42:0/238801981 wait complete. 2024-09-16T01:55:10.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.292+0000 7f44c20fa640 1 Processor -- start 2024-09-16T01:55:10.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.292+0000 7f44c20fa640 1 -- start start 2024-09-16T01:55:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44c20fa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 0x7f44bc0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44c20fa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44bc09b690 0x7f44bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44c20fa640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 0x7f44bc157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44c20fa640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc0d1020 con 0x7f44bc06dbd0 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44c20fa640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc0d0d40 con 0x7f44bc09b690 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44c20fa640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f44bc09ba90 con 0x7f44bc15e740 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 0x7f44bc0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 0x7f44bc0c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35946/0 (socket says 172.21.15.42:35946) 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44bb7fe640 1 -- 172.21.15.42:0/34983793 learned_addr learned my addr 172.21.15.42:0/34983793 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44bbfff640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 0x7f44bc157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44baffd640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44bc09b690 0x7f44bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44bb7fe640 1 -- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 msgr2=0x7f44bc157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44bb7fe640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 0x7f44bc157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44bb7fe640 1 -- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44bc09b690 msgr2=0x7f44bc0b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44bb7fe640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44bc09b690 0x7f44bc0b77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44bb7fe640 1 -- 172.21.15.42:0/34983793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc0c6260 con 0x7f44bc06dbd0 2024-09-16T01:55:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.293+0000 7f44bb7fe640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 0x7f44bc0c8d70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c7f0 tx=0x7f44ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:10.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.294+0000 7f44b3fff640 1 -- 172.21.15.42:0/34983793 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac015070 con 0x7f44bc06dbd0 2024-09-16T01:55:10.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.294+0000 7f44b3fff640 1 -- 172.21.15.42:0/34983793 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ac007a30 con 0x7f44bc06dbd0 2024-09-16T01:55:10.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.294+0000 7f44b3fff640 1 -- 172.21.15.42:0/34983793 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac007e00 con 0x7f44bc06dbd0 2024-09-16T01:55:10.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.294+0000 7f44c20fa640 1 -- 172.21.15.42:0/34983793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44bc0b7fd0 con 0x7f44bc06dbd0 2024-09-16T01:55:10.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.294+0000 7f44c20fa640 1 -- 172.21.15.42:0/34983793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44bc1e84a0 con 0x7f44bc06dbd0 2024-09-16T01:55:10.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.295+0000 7f44c20fa640 1 -- 172.21.15.42:0/34983793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44bc06cd20 con 0x7f44bc06dbd0 2024-09-16T01:55:10.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.295+0000 7f44b3fff640 1 -- 172.21.15.42:0/34983793 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f44ac018070 con 0x7f44bc06dbd0 2024-09-16T01:55:10.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.295+0000 7f44b3fff640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f449c06c2b0 0x7f449c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.296+0000 7f44b3fff640 1 -- 172.21.15.42:0/34983793 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f44ac08b120 con 0x7f44bc06dbd0 2024-09-16T01:55:10.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.296+0000 7f44baffd640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f449c06c2b0 0x7f449c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.296+0000 7f44baffd640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f449c06c2b0 0x7f449c06e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f44bc071cd0 tx=0x7f44a4007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:10.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.300+0000 7f44b3fff640 1 -- 172.21.15.42:0/34983793 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44bc0c6260 con 0x7f44bc06dbd0 2024-09-16T01:55:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.544+0000 7f44c20fa640 1 -- 172.21.15.42:0/34983793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f44bc0d1cb0 con 0x7f44bc06dbd0 2024-09-16T01:55:10.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.546+0000 7f44b3fff640 1 -- 172.21.15.42:0/34983793 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f44ac059490 con 0x7f44bc06dbd0 2024-09-16T01:55:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 -- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f449c06c2b0 msgr2=0x7f449c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f449c06c2b0 0x7f449c06e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f44bc071cd0 tx=0x7f44a4007d50 comp rx=0 tx=0).stop 2024-09-16T01:55:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 -- 172.21.15.42:0/34983793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 msgr2=0x7f44bc0c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 0x7f44bc0c8d70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c7f0 tx=0x7f44ac00cbf0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 -- 172.21.15.42:0/34983793 shutdown_connections 2024-09-16T01:55:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f449c06c2b0 0x7f449c06e770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f44bc15e740 0x7f44bc157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44bc09b690 0x7f44bc0b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 --2- 172.21.15.42:0/34983793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44bc06dbd0 0x7f44bc0c8d70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 -- 172.21.15.42:0/34983793 >> 172.21.15.42:0/34983793 conn(0x7f44bc0d23a0 msgr2=0x7f44bc0ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:10.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 -- 172.21.15.42:0/34983793 shutdown_connections 2024-09-16T01:55:10.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.548+0000 7f44c20fa640 1 -- 172.21.15.42:0/34983793 wait complete. 2024-09-16T01:55:10.560 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-16T01:55:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.662+0000 7f76714f1640 1 Processor -- start 2024-09-16T01:55:10.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.662+0000 7f76714f1640 1 -- start start 2024-09-16T01:55:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f76714f1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f766c0cfcc0 0x7f766c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f76714f1640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f766c0d2700 con 0x7f766c0d4fd0 2024-09-16T01:55:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f76714f1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f766c0cedb0 con 0x7f766c15e760 2024-09-16T01:55:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f76714f1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f766c0cf090 con 0x7f766c0cfcc0 2024-09-16T01:55:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f766b7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f766c0d4fd0 0x7f766c0d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53078/0 (socket says 172.21.15.42:53078) 2024-09-16T01:55:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f766b7fe640 1 -- 172.21.15.42:0/1582270049 learned_addr learned my addr 172.21.15.42:0/1582270049 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1390594754 0 0) 0x7f7664001110 con 0x7f766c0d4fd0 2024-09-16T01:55:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f766a7fc640 1 --2- 172.21.15.42:0/1582270049 >> v2:172.21.15.107:3300/0 conn(0x7f766c0cfcc0 0x7f766c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7654003520 con 0x7f766c0d4fd0 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2053415978 0 0) 0x7f7654003520 con 0x7f766c0d4fd0 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.663+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 >> v2:172.21.15.107:3300/0 conn(0x7f766c0cfcc0 msgr2=0x7f766c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 --2- 172.21.15.42:0/1582270049 >> v2:172.21.15.107:3300/0 conn(0x7f766c0cfcc0 0x7f766c06cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 >> v1:172.21.15.107:6789/0 conn(0x7f766c15e760 legacy=0x7f766c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c0b3c80 con 0x7f766c0d4fd0 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f7664001840 con 0x7f766c0d4fd0 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 >> v1:172.21.15.42:6789/0 conn(0x7f766c0d4fd0 legacy=0x7f766c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76540039b0 0x7f7654003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654004800 0x7f7654004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76540051c0 0x7f765400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f766c0cf090 con 0x7f7654004800 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f765400c110 con 0x7f76540039b0 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f765400c310 con 0x7f76540051c0 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f766a7fc640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654004800 0x7f7654004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f766affd640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76540039b0 0x7f7654003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f766b7fe640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76540051c0 0x7f765400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f766a7fc640 1 -- 172.21.15.42:0/1582270049 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76540051c0 msgr2=0x7f765400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f766a7fc640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f76540051c0 0x7f765400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f766a7fc640 1 -- 172.21.15.42:0/1582270049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76540039b0 msgr2=0x7f7654003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f766a7fc640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76540039b0 0x7f7654003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f766a7fc640 1 -- 172.21.15.42:0/1582270049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7654003520 con 0x7f7654004800 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.664+0000 7f766b7fe640 1 -- 172.21.15.42:0/1582270049 reap_dead start 2024-09-16T01:55:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.665+0000 7f766a7fc640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654004800 0x7f7654004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f766000ba10 tx=0x7f7654005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b14dbab2070afeb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:10.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.665+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766000b5e0 con 0x7f7654004800 2024-09-16T01:55:10.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.665+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766002adb0 con 0x7f7654004800 2024-09-16T01:55:10.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.665+0000 7f7669ffb640 1 -- 172.21.15.42:0/1582270049 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660005bb0 con 0x7f7654004800 2024-09-16T01:55:10.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.665+0000 7f76714f1640 1 -- 172.21.15.42:0/1582270049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654004800 msgr2=0x7f7654004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.665+0000 7f76714f1640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654004800 0x7f7654004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f766000ba10 tx=0x7f7654005830 comp rx=0 tx=0).stop 2024-09-16T01:55:10.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.665+0000 7f76714f1640 1 -- 172.21.15.42:0/1582270049 shutdown_connections 2024-09-16T01:55:10.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.665+0000 7f76714f1640 1 --2- 172.21.15.42:0/1582270049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654004800 0x7f7654004c80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.665+0000 7f76714f1640 1 -- 172.21.15.42:0/1582270049 >> 172.21.15.42:0/1582270049 conn(0x7f766c08bfc0 msgr2=0x7f766c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:10.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.666+0000 7f76714f1640 1 -- 172.21.15.42:0/1582270049 shutdown_connections 2024-09-16T01:55:10.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.666+0000 7f76714f1640 1 -- 172.21.15.42:0/1582270049 wait complete. 2024-09-16T01:55:10.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.667+0000 7f76714f1640 1 Processor -- start 2024-09-16T01:55:10.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.667+0000 7f76714f1640 1 -- start start 2024-09-16T01:55:10.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f76714f1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7654004800 0x7f766c159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f76714f1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f766c0b95d0 0x7f766c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f76714f1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c1f5340 0x7f766c157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f76714f1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f766c06cdd0 con 0x7f766c0b95d0 2024-09-16T01:55:10.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f76714f1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f766c0b3860 con 0x7f766c1f5340 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f76714f1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f766c06cf50 con 0x7f7654004800 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f766c0b95d0 0x7f766c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f766c0b95d0 0x7f766c153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35960/0 (socket says 172.21.15.42:35960) 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766a7fc640 1 -- 172.21.15.42:0/1900434471 learned_addr learned my addr 172.21.15.42:0/1900434471 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766affd640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7654004800 0x7f766c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766b7fe640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c1f5340 0x7f766c157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766a7fc640 1 -- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7654004800 msgr2=0x7f766c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766a7fc640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7654004800 0x7f766c159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766a7fc640 1 -- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c1f5340 msgr2=0x7f766c157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766a7fc640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c1f5340 0x7f766c157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766a7fc640 1 -- 172.21.15.42:0/1900434471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c0b9a90 con 0x7f766c0b95d0 2024-09-16T01:55:10.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f766a7fc640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f766c0b95d0 0x7f766c153590 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f766000bb00 tx=0x7f7660004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.668+0000 7f76537fe640 1 -- 172.21.15.42:0/1900434471 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660045070 con 0x7f766c0b95d0 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.669+0000 7f76537fe640 1 -- 172.21.15.42:0/1900434471 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766002abb0 con 0x7f766c0b95d0 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.669+0000 7f76714f1640 1 -- 172.21.15.42:0/1900434471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766c158c60 con 0x7f766c0b95d0 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.669+0000 7f76537fe640 1 -- 172.21.15.42:0/1900434471 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660006270 con 0x7f766c0b95d0 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.669+0000 7f76714f1640 1 -- 172.21.15.42:0/1900434471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f766c159220 con 0x7f766c0b95d0 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.669+0000 7f76714f1640 1 -- 172.21.15.42:0/1900434471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f766c0b6d20 con 0x7f766c0b95d0 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.670+0000 7f76537fe640 1 -- 172.21.15.42:0/1900434471 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7660048070 con 0x7f766c0b95d0 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.670+0000 7f76537fe640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f765806c2b0 0x7f765806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.671+0000 7f76537fe640 1 -- 172.21.15.42:0/1900434471 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f76600aab10 con 0x7f766c0b95d0 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.671+0000 7f766affd640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f765806c2b0 0x7f765806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:10.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.671+0000 7f766affd640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f765806c2b0 0x7f765806e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f765c000f80 tx=0x7f765c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:10.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.675+0000 7f76537fe640 1 -- 172.21.15.42:0/1900434471 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7660078df0 con 0x7f766c0b95d0 2024-09-16T01:55:10.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.914+0000 7f76714f1640 1 -- 172.21.15.42:0/1900434471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f766c0d39c0 con 0x7f766c0b95d0 2024-09-16T01:55:10.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.916+0000 7f76537fe640 1 -- 172.21.15.42:0/1900434471 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f766007d0f0 con 0x7f766c0b95d0 2024-09-16T01:55:10.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 -- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f765806c2b0 msgr2=0x7f765806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f765806c2b0 0x7f765806e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f765c000f80 tx=0x7f765c009040 comp rx=0 tx=0).stop 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 -- 172.21.15.42:0/1900434471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f766c0b95d0 msgr2=0x7f766c153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f766c0b95d0 0x7f766c153590 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f766000bb00 tx=0x7f7660004730 comp rx=0 tx=0).stop 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 -- 172.21.15.42:0/1900434471 shutdown_connections 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f765806c2b0 0x7f765806e770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f766c1f5340 0x7f766c157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f766c0b95d0 0x7f766c153590 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 --2- 172.21.15.42:0/1900434471 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7654004800 0x7f766c159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 -- 172.21.15.42:0/1900434471 >> 172.21.15.42:0/1900434471 conn(0x7f766c08bfc0 msgr2=0x7f766c0b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 -- 172.21.15.42:0/1900434471 shutdown_connections 2024-09-16T01:55:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:10.918+0000 7f76714f1640 1 -- 172.21.15.42:0/1900434471 wait complete. 2024-09-16T01:55:10.930 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-16T01:55:11.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.032+0000 7f369e680640 1 Processor -- start 2024-09-16T01:55:11.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.032+0000 7f369e680640 1 -- start start 2024-09-16T01:55:11.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f369e680640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f369815b300 0x7f36980cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f369e680640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36980cd3f0 0x7f369806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f369e680640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3698072d30 0x7f369806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f369e680640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f36980728a0 con 0x7f369815b300 2024-09-16T01:55:11.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f369e680640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f36980cdbe0 con 0x7f3698072d30 2024-09-16T01:55:11.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f369e680640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36980cd900 con 0x7f36980cd3f0 2024-09-16T01:55:11.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f3697fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f369815b300 0x7f36980cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f3697fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f369815b300 0x7f36980cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35976/0 (socket says 172.21.15.42:35976) 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f3697fff640 1 -- 172.21.15.42:0/3428499579 learned_addr learned my addr 172.21.15.42:0/3428499579 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f36977fe640 1 --2- 172.21.15.42:0/3428499579 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36980cd3f0 0x7f369806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.033+0000 7f369cc1d640 1 --2- 172.21.15.42:0/3428499579 >> v2:172.21.15.107:3300/0 conn(0x7f3698072d30 0x7f369806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.034+0000 7f3697fff640 1 -- 172.21.15.42:0/3428499579 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36980cd3f0 msgr2=0x7f369806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.034+0000 7f3697fff640 1 --2- 172.21.15.42:0/3428499579 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36980cd3f0 0x7f369806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.034+0000 7f3697fff640 1 -- 172.21.15.42:0/3428499579 >> v2:172.21.15.107:3300/0 conn(0x7f3698072d30 msgr2=0x7f369806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.034+0000 7f3697fff640 1 --2- 172.21.15.42:0/3428499579 >> v2:172.21.15.107:3300/0 conn(0x7f3698072d30 0x7f369806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.034+0000 7f3697fff640 1 -- 172.21.15.42:0/3428499579 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3698072250 con 0x7f369815b300 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.034+0000 7f369cc1d640 1 --2- 172.21.15.42:0/3428499579 >> v2:172.21.15.107:3300/0 conn(0x7f3698072d30 0x7f369806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.034+0000 7f3697fff640 1 --2- 172.21.15.42:0/3428499579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 0x7f36980cceb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3698072040 tx=0x7f368802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4645ca2206d06c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.034+0000 7f3696ffd640 1 -- 172.21.15.42:0/3428499579 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3688037070 con 0x7f369815b300 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f3696ffd640 1 -- 172.21.15.42:0/3428499579 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3688032440 con 0x7f369815b300 2024-09-16T01:55:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f3696ffd640 1 -- 172.21.15.42:0/3428499579 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3688032810 con 0x7f369815b300 2024-09-16T01:55:11.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f369e680640 1 -- 172.21.15.42:0/3428499579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 msgr2=0x7f36980cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f369e680640 1 --2- 172.21.15.42:0/3428499579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 0x7f36980cceb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3698072040 tx=0x7f368802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f369e680640 1 -- 172.21.15.42:0/3428499579 shutdown_connections 2024-09-16T01:55:11.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f369e680640 1 --2- 172.21.15.42:0/3428499579 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36980cd3f0 0x7f369806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f369e680640 1 --2- 172.21.15.42:0/3428499579 >> v2:172.21.15.107:3300/0 conn(0x7f3698072d30 0x7f369806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f369e680640 1 --2- 172.21.15.42:0/3428499579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 0x7f36980cceb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f369e680640 1 -- 172.21.15.42:0/3428499579 >> 172.21.15.42:0/3428499579 conn(0x7f3698067d70 msgr2=0x7f369806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f369e680640 1 -- 172.21.15.42:0/3428499579 shutdown_connections 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.035+0000 7f369e680640 1 -- 172.21.15.42:0/3428499579 wait complete. 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.037+0000 7f369e680640 1 Processor -- start 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.037+0000 7f369e680640 1 -- start start 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369e680640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3698072d30 0x7f36981f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369e680640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36980cd3f0 0x7f36981f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369e680640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 0x7f3698147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369e680640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36980d0160 con 0x7f369815b300 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369e680640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f36980cffe0 con 0x7f3698072d30 2024-09-16T01:55:11.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369e680640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36980b3c40 con 0x7f36980cd3f0 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369cc1d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 0x7f3698147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369cc1d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 0x7f3698147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35988/0 (socket says 172.21.15.42:35988) 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369cc1d640 1 -- 172.21.15.42:0/1555148030 learned_addr learned my addr 172.21.15.42:0/1555148030 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f3697fff640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3698072d30 0x7f36981f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f36977fe640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36980cd3f0 0x7f36981f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369cc1d640 1 -- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36980cd3f0 msgr2=0x7f36981f3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369cc1d640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36980cd3f0 0x7f36981f3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369cc1d640 1 -- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3698072d30 msgr2=0x7f36981f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369cc1d640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3698072d30 0x7f36981f8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369cc1d640 1 -- 172.21.15.42:0/1555148030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36981585c0 con 0x7f369815b300 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369cc1d640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 0x7f3698147d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3690007e40 tx=0x7f369000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:11.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f3694ff9640 1 -- 172.21.15.42:0/1555148030 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369001a070 con 0x7f369815b300 2024-09-16T01:55:11.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f3694ff9640 1 -- 172.21.15.42:0/1555148030 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3690003b90 con 0x7f369815b300 2024-09-16T01:55:11.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369e680640 1 -- 172.21.15.42:0/1555148030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3698158000 con 0x7f369815b300 2024-09-16T01:55:11.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f3694ff9640 1 -- 172.21.15.42:0/1555148030 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369000de80 con 0x7f369815b300 2024-09-16T01:55:11.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.038+0000 7f369e680640 1 -- 172.21.15.42:0/1555148030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3698147510 con 0x7f369815b300 2024-09-16T01:55:11.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.040+0000 7f369e680640 1 -- 172.21.15.42:0/1555148030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369815d000 con 0x7f369815b300 2024-09-16T01:55:11.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.040+0000 7f3694ff9640 1 -- 172.21.15.42:0/1555148030 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f369001d070 con 0x7f369815b300 2024-09-16T01:55:11.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.040+0000 7f3694ff9640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f368406c2b0 0x7f368406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.041+0000 7f3694ff9640 1 -- 172.21.15.42:0/1555148030 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f369008b450 con 0x7f369815b300 2024-09-16T01:55:11.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.041+0000 7f3697fff640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f368406c2b0 0x7f368406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.041+0000 7f3697fff640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f368406c2b0 0x7f368406e770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3688034000 tx=0x7f368802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:11.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.045+0000 7f3694ff9640 1 -- 172.21.15.42:0/1555148030 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3690010070 con 0x7f369815b300 2024-09-16T01:55:11.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.289+0000 7f369e680640 1 -- 172.21.15.42:0/1555148030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f369815cd20 con 0x7f369815b300 2024-09-16T01:55:11.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.291+0000 7f3694ff9640 1 -- 172.21.15.42:0/1555148030 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v10) ==== 97+0+0 (secure 0 0 0) 0x7f3690059730 con 0x7f369815b300 2024-09-16T01:55:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 -- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f368406c2b0 msgr2=0x7f368406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f368406c2b0 0x7f368406e770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3688034000 tx=0x7f368802e000 comp rx=0 tx=0).stop 2024-09-16T01:55:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 -- 172.21.15.42:0/1555148030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 msgr2=0x7f3698147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 0x7f3698147d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3690007e40 tx=0x7f369000d4a0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 -- 172.21.15.42:0/1555148030 shutdown_connections 2024-09-16T01:55:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f368406c2b0 0x7f368406e770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369815b300 0x7f3698147d10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36980cd3f0 0x7f36981f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 --2- 172.21.15.42:0/1555148030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3698072d30 0x7f36981f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 -- 172.21.15.42:0/1555148030 >> 172.21.15.42:0/1555148030 conn(0x7f3698067d70 msgr2=0x7f36980cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 -- 172.21.15.42:0/1555148030 shutdown_connections 2024-09-16T01:55:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.293+0000 7f369e680640 1 -- 172.21.15.42:0/1555148030 wait complete. 2024-09-16T01:55:11.305 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-16T01:55:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.407+0000 7f36857a1640 1 Processor -- start 2024-09-16T01:55:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.407+0000 7f36857a1640 1 -- start start 2024-09-16T01:55:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.408+0000 7f36857a1640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f368009aa30 0x7f36800b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.408+0000 7f36857a1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36800b3760 0x7f368009ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.408+0000 7f36857a1640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f368009b350 con 0x7f368006cd20 2024-09-16T01:55:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.408+0000 7f36857a1640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f36800d0670 con 0x7f368009aa30 2024-09-16T01:55:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.408+0000 7f36857a1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f36800b2790 con 0x7f36800b3760 2024-09-16T01:55:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.408+0000 7f367effd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f368009aa30 0x7f36800b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.408+0000 7f367f7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f368006cd20 0x7f36800d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53082/0 (socket says 172.21.15.42:53082) 2024-09-16T01:55:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.408+0000 7f367f7fe640 1 -- 172.21.15.42:0/1675040533 learned_addr learned my addr 172.21.15.42:0/1675040533 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.409+0000 7f367e7fc640 1 --2- 172.21.15.42:0/1675040533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36800b3760 0x7f368009ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.409+0000 7f367dffb640 1 -- 172.21.15.42:0/1675040533 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398496883 0 0) 0x7f368009b350 con 0x7f368006cd20 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.409+0000 7f367dffb640 1 -- 172.21.15.42:0/1675040533 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f366c003520 con 0x7f368006cd20 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.409+0000 7f367effd640 1 -- 172.21.15.42:0/1675040533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36800b3760 msgr2=0x7f368009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.409+0000 7f367effd640 1 --2- 172.21.15.42:0/1675040533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36800b3760 0x7f368009ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.409+0000 7f367effd640 1 -- 172.21.15.42:0/1675040533 >> v1:172.21.15.42:6789/0 conn(0x7f368006cd20 legacy=0x7f36800d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.409+0000 7f367effd640 1 -- 172.21.15.42:0/1675040533 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36800b2a70 con 0x7f368009aa30 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f367effd640 1 --2- 172.21.15.42:0/1675040533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368009aa30 0x7f36800b3030 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f36780097a0 tx=0x7f367802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fcb6a4b683f666 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f367dffb640 1 -- 172.21.15.42:0/1675040533 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678037070 con 0x7f368009aa30 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f367dffb640 1 -- 172.21.15.42:0/1675040533 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367802ae50 con 0x7f368009aa30 2024-09-16T01:55:11.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f367dffb640 1 -- 172.21.15.42:0/1675040533 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678032660 con 0x7f368009aa30 2024-09-16T01:55:11.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f36857a1640 1 -- 172.21.15.42:0/1675040533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368009aa30 msgr2=0x7f36800b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f36857a1640 1 --2- 172.21.15.42:0/1675040533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368009aa30 0x7f36800b3030 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f36780097a0 tx=0x7f367802a100 comp rx=0 tx=0).stop 2024-09-16T01:55:11.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f36857a1640 1 -- 172.21.15.42:0/1675040533 shutdown_connections 2024-09-16T01:55:11.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f36857a1640 1 --2- 172.21.15.42:0/1675040533 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f36800b3760 0x7f368009ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f36857a1640 1 --2- 172.21.15.42:0/1675040533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368009aa30 0x7f36800b3030 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f36857a1640 1 -- 172.21.15.42:0/1675040533 >> 172.21.15.42:0/1675040533 conn(0x7f36800d23a0 msgr2=0x7f36800d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:11.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f36857a1640 1 -- 172.21.15.42:0/1675040533 shutdown_connections 2024-09-16T01:55:11.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.410+0000 7f36857a1640 1 -- 172.21.15.42:0/1675040533 wait complete. 2024-09-16T01:55:11.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.412+0000 7f36857a1640 1 Processor -- start 2024-09-16T01:55:11.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.412+0000 7f36857a1640 1 -- start start 2024-09-16T01:55:11.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.412+0000 7f36857a1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f368006cd20 0x7f3680151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f36857a1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f368009aa30 0x7f3680162200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f36857a1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36800b3760 0x7f3680162740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f36857a1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f368015fca0 con 0x7f36800b3760 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f36857a1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f36800d08a0 con 0x7f368009aa30 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f36857a1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f368015fe20 con 0x7f368006cd20 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36800b3760 0x7f3680162740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36800b3760 0x7f3680162740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36014/0 (socket says 172.21.15.42:36014) 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367f7fe640 1 -- 172.21.15.42:0/725780615 learned_addr learned my addr 172.21.15.42:0/725780615 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367effd640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f368006cd20 0x7f3680151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367e7fc640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f368009aa30 0x7f3680162200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367f7fe640 1 -- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f368006cd20 msgr2=0x7f3680151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367f7fe640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f368006cd20 0x7f3680151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367f7fe640 1 -- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f368009aa30 msgr2=0x7f3680162200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367f7fe640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f368009aa30 0x7f3680162200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367f7fe640 1 -- 172.21.15.42:0/725780615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3680152e30 con 0x7f36800b3760 2024-09-16T01:55:11.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f367f7fe640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36800b3760 0x7f3680162740 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f367000caa0 tx=0x7f367000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:11.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f36777fe640 1 -- 172.21.15.42:0/725780615 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670017070 con 0x7f36800b3760 2024-09-16T01:55:11.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f36777fe640 1 -- 172.21.15.42:0/725780615 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367000ac00 con 0x7f36800b3760 2024-09-16T01:55:11.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f36857a1640 1 -- 172.21.15.42:0/725780615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3680153110 con 0x7f36800b3760 2024-09-16T01:55:11.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f36777fe640 1 -- 172.21.15.42:0/725780615 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670012400 con 0x7f36800b3760 2024-09-16T01:55:11.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.413+0000 7f36857a1640 1 -- 172.21.15.42:0/725780615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36801536d0 con 0x7f36800b3760 2024-09-16T01:55:11.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.414+0000 7f36857a1640 1 -- 172.21.15.42:0/725780615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36800d1fe0 con 0x7f36800b3760 2024-09-16T01:55:11.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.415+0000 7f36777fe640 1 -- 172.21.15.42:0/725780615 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f367001a070 con 0x7f36800b3760 2024-09-16T01:55:11.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.416+0000 7f36777fe640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f366006c2b0 0x7f366006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.416+0000 7f36777fe640 1 -- 172.21.15.42:0/725780615 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f367008af10 con 0x7f36800b3760 2024-09-16T01:55:11.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.416+0000 7f367effd640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f366006c2b0 0x7f366006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.416+0000 7f367effd640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f366006c2b0 0x7f366006e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3678034000 tx=0x7f367802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:11.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.420+0000 7f36777fe640 1 -- 172.21.15.42:0/725780615 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36700591f0 con 0x7f36800b3760 2024-09-16T01:55:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.664+0000 7f36857a1640 1 -- 172.21.15.42:0/725780615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f36800b3cb0 con 0x7f36800b3760 2024-09-16T01:55:11.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.666+0000 7f36777fe640 1 -- 172.21.15.42:0/725780615 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f367005d4f0 con 0x7f36800b3760 2024-09-16T01:55:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 -- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f366006c2b0 msgr2=0x7f366006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f366006c2b0 0x7f366006e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3678034000 tx=0x7f367802e000 comp rx=0 tx=0).stop 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 -- 172.21.15.42:0/725780615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36800b3760 msgr2=0x7f3680162740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36800b3760 0x7f3680162740 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f367000caa0 tx=0x7f367000cf60 comp rx=0 tx=0).stop 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 -- 172.21.15.42:0/725780615 shutdown_connections 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f366006c2b0 0x7f366006e770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36800b3760 0x7f3680162740 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f368009aa30 0x7f3680162200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 --2- 172.21.15.42:0/725780615 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f368006cd20 0x7f3680151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 -- 172.21.15.42:0/725780615 >> 172.21.15.42:0/725780615 conn(0x7f36800d23a0 msgr2=0x7f36800d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 -- 172.21.15.42:0/725780615 shutdown_connections 2024-09-16T01:55:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.669+0000 7f36857a1640 1 -- 172.21.15.42:0/725780615 wait complete. 2024-09-16T01:55:11.681 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:55:11.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.782+0000 7fcb7a7b7640 1 Processor -- start 2024-09-16T01:55:11.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.782+0000 7fcb7a7b7640 1 -- start start 2024-09-16T01:55:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb7a7b7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcb7415e740 0x7fcb740d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb7a7b7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcb7409b690 0x7fcb7406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb7a7b7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb740d0780 con 0x7fcb7406d4c0 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb7a7b7640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7415eb20 con 0x7fcb7415e740 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb7a7b7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7406d260 con 0x7fcb7409b690 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb73fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcb7415e740 0x7fcb740d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb73fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcb7415e740 0x7fcb740d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36018/0 (socket says 172.21.15.42:36018) 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb73fff640 1 -- 172.21.15.42:0/2542787289 learned_addr learned my addr 172.21.15.42:0/2542787289 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb73fff640 1 -- 172.21.15.42:0/2542787289 >> v2:172.21.15.107:3300/0 conn(0x7fcb7409b690 msgr2=0x7fcb7406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb73fff640 1 --2- 172.21.15.42:0/2542787289 >> v2:172.21.15.107:3300/0 conn(0x7fcb7409b690 0x7fcb7406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb73fff640 1 -- 172.21.15.42:0/2542787289 >> v1:172.21.15.107:6789/0 conn(0x7fcb7406d4c0 legacy=0x7fcb7406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.783+0000 7fcb73fff640 1 -- 172.21.15.42:0/2542787289 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb740d0a60 con 0x7fcb7415e740 2024-09-16T01:55:11.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.784+0000 7fcb73fff640 1 --2- 172.21.15.42:0/2542787289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7415e740 0x7fcb740d1540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcb740691b0 tx=0x7fcb6402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74dcdcb0ccfcb04 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.784+0000 7fcb72ffd640 1 -- 172.21.15.42:0/2542787289 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64037070 con 0x7fcb7415e740 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.784+0000 7fcb72ffd640 1 -- 172.21.15.42:0/2542787289 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb64032440 con 0x7fcb7415e740 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.784+0000 7fcb72ffd640 1 -- 172.21.15.42:0/2542787289 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64032810 con 0x7fcb7415e740 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.785+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/2542787289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7415e740 msgr2=0x7fcb740d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.785+0000 7fcb7a7b7640 1 --2- 172.21.15.42:0/2542787289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7415e740 0x7fcb740d1540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcb740691b0 tx=0x7fcb6402a2c0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.785+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/2542787289 shutdown_connections 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.785+0000 7fcb7a7b7640 1 --2- 172.21.15.42:0/2542787289 >> v2:172.21.15.107:3300/0 conn(0x7fcb7409b690 0x7fcb7406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.785+0000 7fcb7a7b7640 1 --2- 172.21.15.42:0/2542787289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7415e740 0x7fcb740d1540 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.785+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/2542787289 >> 172.21.15.42:0/2542787289 conn(0x7fcb740d23a0 msgr2=0x7fcb740d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.785+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/2542787289 shutdown_connections 2024-09-16T01:55:11.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.785+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/2542787289 wait complete. 2024-09-16T01:55:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.786+0000 7fcb7a7b7640 1 Processor -- start 2024-09-16T01:55:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.786+0000 7fcb7a7b7640 1 -- start start 2024-09-16T01:55:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb7a7b7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb7406d4c0 0x7fcb7415b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb7a7b7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7409b690 0x7fcb740c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb7a7b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb7415e740 0x7fcb741f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb7a7b7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7409bac0 con 0x7fcb7409b690 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb7a7b7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcb740d1020 con 0x7fcb7415e740 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb7a7b7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7406dfe0 con 0x7fcb7406d4c0 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb737fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7409b690 0x7fcb740c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb737fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7409b690 0x7fcb740c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36028/0 (socket says 172.21.15.42:36028) 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb737fe640 1 -- 172.21.15.42:0/1050211456 learned_addr learned my addr 172.21.15.42:0/1050211456 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb73fff640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb7406d4c0 0x7fcb7415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb78d54640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb7415e740 0x7fcb741f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb737fe640 1 -- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb7406d4c0 msgr2=0x7fcb7415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb737fe640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb7406d4c0 0x7fcb7415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb737fe640 1 -- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb7415e740 msgr2=0x7fcb741f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb737fe640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb7415e740 0x7fcb741f4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb737fe640 1 -- 172.21.15.42:0/1050211456 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7415bd80 con 0x7fcb7409b690 2024-09-16T01:55:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.787+0000 7fcb737fe640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7409b690 0x7fcb740c9470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800b4a0 tx=0x7fcb6800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.788+0000 7fcb70ff9640 1 -- 172.21.15.42:0/1050211456 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68014070 con 0x7fcb7409b690 2024-09-16T01:55:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.788+0000 7fcb70ff9640 1 -- 172.21.15.42:0/1050211456 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb68010610 con 0x7fcb7409b690 2024-09-16T01:55:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.788+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/1050211456 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb741f53a0 con 0x7fcb7409b690 2024-09-16T01:55:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.788+0000 7fcb70ff9640 1 -- 172.21.15.42:0/1050211456 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68010a00 con 0x7fcb7409b690 2024-09-16T01:55:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.788+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/1050211456 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb740b5440 con 0x7fcb7409b690 2024-09-16T01:55:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.788+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/1050211456 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7406cd20 con 0x7fcb7409b690 2024-09-16T01:55:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.789+0000 7fcb70ff9640 1 -- 172.21.15.42:0/1050211456 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcb68017070 con 0x7fcb7409b690 2024-09-16T01:55:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.789+0000 7fcb70ff9640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fcb6006c2b0 0x7fcb6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.790+0000 7fcb70ff9640 1 -- 172.21.15.42:0/1050211456 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fcb6808ad30 con 0x7fcb7409b690 2024-09-16T01:55:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.790+0000 7fcb73fff640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fcb6006c2b0 0x7fcb6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:11.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.790+0000 7fcb73fff640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fcb6006c2b0 0x7fcb6006e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb64034000 tx=0x7fcb6402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:11.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.794+0000 7fcb70ff9640 1 -- 172.21.15.42:0/1050211456 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb680595c0 con 0x7fcb7409b690 2024-09-16T01:55:11.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.969+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/1050211456 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcb740d1cb0 con 0x7fcb7409b690 2024-09-16T01:55:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.969+0000 7fcb70ff9640 1 -- 172.21.15.42:0/1050211456 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) ==== 84+0+65 (secure 0 0 0) 0x7fcb68058ec0 con 0x7fcb7409b690 2024-09-16T01:55:11.971 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:11.971 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-16T01:55:11.971 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:11.971 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-16T01:55:11.971 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-16T01:55:11.971 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:11.971 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-16T01:55:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fcb6006c2b0 msgr2=0x7fcb6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fcb6006c2b0 0x7fcb6006e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb64034000 tx=0x7fcb6402e000 comp rx=0 tx=0).stop 2024-09-16T01:55:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/1050211456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7409b690 msgr2=0x7fcb740c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7409b690 0x7fcb740c9470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800b4a0 tx=0x7fcb6800b960 comp rx=0 tx=0).stop 2024-09-16T01:55:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/1050211456 shutdown_connections 2024-09-16T01:55:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fcb6006c2b0 0x7fcb6006e770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb7415e740 0x7fcb741f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7409b690 0x7fcb740c9470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 --2- 172.21.15.42:0/1050211456 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcb7406d4c0 0x7fcb7415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:11.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/1050211456 >> 172.21.15.42:0/1050211456 conn(0x7fcb740d23a0 msgr2=0x7fcb7406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:11.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/1050211456 shutdown_connections 2024-09-16T01:55:11.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:11.971+0000 7fcb7a7b7640 1 -- 172.21.15.42:0/1050211456 wait complete. 2024-09-16T01:55:11.984 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:55:11.984 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:55:12.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.090+0000 7f95aa359640 1 Processor -- start 2024-09-16T01:55:12.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.090+0000 7f95aa359640 1 -- start start 2024-09-16T01:55:12.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.091+0000 7f95aa359640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f95a4161a20 0x7f95a40d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:12.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.091+0000 7f95aa359640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40cf330 0x7f95a406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:12.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.091+0000 7f95aa359640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a40d1830 con 0x7f95a40d1420 2024-09-16T01:55:12.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.091+0000 7f95aa359640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f95a40cf760 con 0x7f95a4161a20 2024-09-16T01:55:12.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.091+0000 7f95aa359640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f95a4161e00 con 0x7f95a40cf330 2024-09-16T01:55:12.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.091+0000 7f95a3fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f95a4161a20 0x7f95a40d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:12.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.091+0000 7f95a88f6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40cf330 0x7f95a406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:12.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.091+0000 7f95a37fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f95a40d1420 0x7f95a40cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:54218/0 (socket says 172.21.15.42:54218) 2024-09-16T01:55:12.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.091+0000 7f95a37fe640 1 -- 172.21.15.42:0/4264704841 learned_addr learned my addr 172.21.15.42:0/4264704841 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:12.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.092+0000 7f95a3fff640 1 -- 172.21.15.42:0/4264704841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40cf330 msgr2=0x7f95a406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.092+0000 7f95a3fff640 1 --2- 172.21.15.42:0/4264704841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40cf330 0x7f95a406d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.092+0000 7f95a3fff640 1 -- 172.21.15.42:0/4264704841 >> v1:172.21.15.107:6789/0 conn(0x7f95a40d1420 legacy=0x7f95a40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.092+0000 7f95a3fff640 1 -- 172.21.15.42:0/4264704841 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a40cf980 con 0x7f95a4161a20 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.092+0000 7f95a88f6640 1 --2- 172.21.15.42:0/4264704841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40cf330 0x7f95a406d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.092+0000 7f95a3fff640 1 --2- 172.21.15.42:0/4264704841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95a4161a20 0x7f95a40d0ee0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f95940097d0 tx=0x7f959402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e6f16ea44d71091 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95a2ffd640 1 -- 172.21.15.42:0/4264704841 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594037070 con 0x7f95a4161a20 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95a2ffd640 1 -- 172.21.15.42:0/4264704841 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9594032440 con 0x7f95a4161a20 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95a2ffd640 1 -- 172.21.15.42:0/4264704841 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594032810 con 0x7f95a4161a20 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95aa359640 1 -- 172.21.15.42:0/4264704841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95a4161a20 msgr2=0x7f95a40d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95aa359640 1 --2- 172.21.15.42:0/4264704841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95a4161a20 0x7f95a40d0ee0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f95940097d0 tx=0x7f959402a1c0 comp rx=0 tx=0).stop 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95aa359640 1 -- 172.21.15.42:0/4264704841 shutdown_connections 2024-09-16T01:55:12.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95aa359640 1 --2- 172.21.15.42:0/4264704841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40cf330 0x7f95a406d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:12.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95aa359640 1 --2- 172.21.15.42:0/4264704841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95a4161a20 0x7f95a40d0ee0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:12.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95aa359640 1 -- 172.21.15.42:0/4264704841 >> 172.21.15.42:0/4264704841 conn(0x7f95a409d850 msgr2=0x7f95a408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:12.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95aa359640 1 -- 172.21.15.42:0/4264704841 shutdown_connections 2024-09-16T01:55:12.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.093+0000 7f95aa359640 1 -- 172.21.15.42:0/4264704841 wait complete. 2024-09-16T01:55:12.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.094+0000 7f95aa359640 1 Processor -- start 2024-09-16T01:55:12.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.095+0000 7f95aa359640 1 -- start start 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.095+0000 7f95aa359640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a40cf330 0x7f95a4145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.095+0000 7f95aa359640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40d1420 0x7f95a40b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.095+0000 7f95aa359640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95a4161a20 0x7f95a41500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.095+0000 7f95aa359640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f95a40cff00 con 0x7f95a40cf330 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.095+0000 7f95aa359640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f95a406d050 con 0x7f95a4161a20 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.095+0000 7f95aa359640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f95a406d2f0 con 0x7f95a40d1420 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.095+0000 7f95a3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a40cf330 0x7f95a4145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a40cf330 0x7f95a4145760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36038/0 (socket says 172.21.15.42:36038) 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a3fff640 1 -- 172.21.15.42:0/3018675625 learned_addr learned my addr 172.21.15.42:0/3018675625 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a37fe640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40d1420 0x7f95a40b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a88f6640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95a4161a20 0x7f95a41500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:12.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a3fff640 1 -- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40d1420 msgr2=0x7f95a40b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a3fff640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40d1420 0x7f95a40b8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a3fff640 1 -- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95a4161a20 msgr2=0x7f95a41500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a3fff640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95a4161a20 0x7f95a41500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a3fff640 1 -- 172.21.15.42:0/3018675625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a40b94e0 con 0x7f95a40cf330 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a3fff640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a40cf330 0x7f95a4145760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9594035040 tx=0x7f95940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a0ff9640 1 -- 172.21.15.42:0/3018675625 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594041020 con 0x7f95a40cf330 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a0ff9640 1 -- 172.21.15.42:0/3018675625 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9594030680 con 0x7f95a40cf330 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95a0ff9640 1 -- 172.21.15.42:0/3018675625 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594037040 con 0x7f95a40cf330 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95aa359640 1 -- 172.21.15.42:0/3018675625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a40b97c0 con 0x7f95a40cf330 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.096+0000 7f95aa359640 1 -- 172.21.15.42:0/3018675625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a4154310 con 0x7f95a40cf330 2024-09-16T01:55:12.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.097+0000 7f95aa359640 1 -- 172.21.15.42:0/3018675625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a40b9ce0 con 0x7f95a40cf330 2024-09-16T01:55:12.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.098+0000 7f95a0ff9640 1 -- 172.21.15.42:0/3018675625 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9594044020 con 0x7f95a40cf330 2024-09-16T01:55:12.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.098+0000 7f95a0ff9640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f959006c2b0 0x7f959006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:12.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.098+0000 7f95a0ff9640 1 -- 172.21.15.42:0/3018675625 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f95940ab910 con 0x7f95a40cf330 2024-09-16T01:55:12.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.098+0000 7f95a37fe640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f959006c2b0 0x7f959006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:12.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.099+0000 7f95a37fe640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f959006c2b0 0x7f959006e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f95a40c7b50 tx=0x7f9598009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:12.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.103+0000 7f95a0ff9640 1 -- 172.21.15.42:0/3018675625 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f959404b030 con 0x7f95a40cf330 2024-09-16T01:55:12.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:12.279+0000 7f95aa359640 1 -- 172.21.15.42:0/3018675625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f95a40b1800 con 0x7f95a40cf330 2024-09-16T01:55:13.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.038+0000 7f95a0ff9640 1 -- 172.21.15.42:0/3018675625 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) ==== 138+0+0 (secure 0 0 0) 0x7f959407a250 con 0x7f95a40cf330 2024-09-16T01:55:13.040 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-16T01:55:13.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.043+0000 7f95aa359640 1 -- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f959006c2b0 msgr2=0x7f959006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:13.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.043+0000 7f95aa359640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f959006c2b0 0x7f959006e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f95a40c7b50 tx=0x7f9598009040 comp rx=0 tx=0).stop 2024-09-16T01:55:13.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.043+0000 7f95aa359640 1 -- 172.21.15.42:0/3018675625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a40cf330 msgr2=0x7f95a4145760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:13.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.043+0000 7f95aa359640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a40cf330 0x7f95a4145760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9594035040 tx=0x7f95940046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:13.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.045+0000 7f95aa359640 1 -- 172.21.15.42:0/3018675625 shutdown_connections 2024-09-16T01:55:13.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.045+0000 7f95aa359640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f959006c2b0 0x7f959006e770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:13.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.045+0000 7f95aa359640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95a4161a20 0x7f95a41500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:13.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.045+0000 7f95aa359640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f95a40d1420 0x7f95a40b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:13.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.045+0000 7f95aa359640 1 --2- 172.21.15.42:0/3018675625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95a40cf330 0x7f95a4145760 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:13.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.045+0000 7f95aa359640 1 -- 172.21.15.42:0/3018675625 >> 172.21.15.42:0/3018675625 conn(0x7f95a409d850 msgr2=0x7f95a40d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:13.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.045+0000 7f95aa359640 1 -- 172.21.15.42:0/3018675625 shutdown_connections 2024-09-16T01:55:13.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.045+0000 7f95aa359640 1 -- 172.21.15.42:0/3018675625 wait complete. 2024-09-16T01:55:13.062 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.176+0000 7fb276398640 1 Processor -- start 2024-09-16T01:55:13.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.176+0000 7fb276398640 1 -- start start 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb276398640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb27015e620 0x7fb2700affe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb276398640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb2700b05a0 0x7fb2700b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb276398640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2700700c0 con 0x7fb2700ae140 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb276398640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fb270070c40 con 0x7fb27015e620 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb276398640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb270070f20 con 0x7fb2700b05a0 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb26ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb27015e620 0x7fb2700affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb26ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb27015e620 0x7fb2700affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36042/0 (socket says 172.21.15.42:36042) 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb26ffff640 1 -- 172.21.15.42:0/974622070 learned_addr learned my addr 172.21.15.42:0/974622070 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb26f7fe640 1 --2- 172.21.15.42:0/974622070 >> v2:172.21.15.107:3300/0 conn(0x7fb2700b05a0 0x7fb2700b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb26ffff640 1 -- 172.21.15.42:0/974622070 >> v2:172.21.15.107:3300/0 conn(0x7fb2700b05a0 msgr2=0x7fb2700b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb26ffff640 1 --2- 172.21.15.42:0/974622070 >> v2:172.21.15.107:3300/0 conn(0x7fb2700b05a0 0x7fb2700b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:13.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb26ffff640 1 -- 172.21.15.42:0/974622070 >> v1:172.21.15.107:6789/0 conn(0x7fb2700ae140 legacy=0x7fb27006f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:13.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb26ffff640 1 -- 172.21.15.42:0/974622070 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2700b4160 con 0x7fb27015e620 2024-09-16T01:55:13.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.177+0000 7fb26f7fe640 1 --2- 172.21.15.42:0/974622070 >> v2:172.21.15.107:3300/0 conn(0x7fb2700b05a0 0x7fb2700b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:13.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.178+0000 7fb26ffff640 1 --2- 172.21.15.42:0/974622070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb27015e620 0x7fb2700affe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb2700b0aa0 tx=0x7fb26002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87ec7e074f116f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:13.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.178+0000 7fb26effd640 1 -- 172.21.15.42:0/974622070 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260037070 con 0x7fb27015e620 2024-09-16T01:55:13.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.178+0000 7fb26effd640 1 -- 172.21.15.42:0/974622070 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb260032440 con 0x7fb27015e620 2024-09-16T01:55:13.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.178+0000 7fb26effd640 1 -- 172.21.15.42:0/974622070 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260032810 con 0x7fb27015e620 2024-09-16T01:55:13.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.179+0000 7fb276398640 1 -- 172.21.15.42:0/974622070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb27015e620 msgr2=0x7fb2700affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:13.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.179+0000 7fb276398640 1 --2- 172.21.15.42:0/974622070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb27015e620 0x7fb2700affe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb2700b0aa0 tx=0x7fb26002a270 comp rx=0 tx=0).stop 2024-09-16T01:55:13.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.179+0000 7fb276398640 1 -- 172.21.15.42:0/974622070 shutdown_connections 2024-09-16T01:55:13.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.179+0000 7fb276398640 1 --2- 172.21.15.42:0/974622070 >> v2:172.21.15.107:3300/0 conn(0x7fb2700b05a0 0x7fb2700b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:13.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.179+0000 7fb276398640 1 --2- 172.21.15.42:0/974622070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb27015e620 0x7fb2700affe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:13.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.179+0000 7fb276398640 1 -- 172.21.15.42:0/974622070 >> 172.21.15.42:0/974622070 conn(0x7fb2700b6680 msgr2=0x7fb2700b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:13.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.179+0000 7fb276398640 1 -- 172.21.15.42:0/974622070 shutdown_connections 2024-09-16T01:55:13.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.179+0000 7fb276398640 1 -- 172.21.15.42:0/974622070 wait complete. 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.180+0000 7fb276398640 1 Processor -- start 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.180+0000 7fb276398640 1 -- start start 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb276398640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2700ae140 0x7fb27014bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb276398640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2700b05a0 0x7fb2700b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb276398640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb27015b610 0x7fb27015d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb276398640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb27006c8f0 con 0x7fb2700ae140 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb276398640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb2700ae5d0 con 0x7fb27015b610 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb276398640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb2700b47b0 con 0x7fb2700b05a0 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2700ae140 0x7fb27014bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2700ae140 0x7fb27014bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36052/0 (socket says 172.21.15.42:36052) 2024-09-16T01:55:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb26ffff640 1 -- 172.21.15.42:0/3623037477 learned_addr learned my addr 172.21.15.42:0/3623037477 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb26f7fe640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2700b05a0 0x7fb2700b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb274935640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb27015b610 0x7fb27015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb26ffff640 1 -- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2700b05a0 msgr2=0x7fb2700b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb26ffff640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2700b05a0 0x7fb2700b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.181+0000 7fb26ffff640 1 -- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb27015b610 msgr2=0x7fb27015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.182+0000 7fb26ffff640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb27015b610 0x7fb27015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.182+0000 7fb26ffff640 1 -- 172.21.15.42:0/3623037477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27015bb20 con 0x7fb2700ae140 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.182+0000 7fb26f7fe640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2700b05a0 0x7fb2700b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.182+0000 7fb274935640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb27015b610 0x7fb27015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.182+0000 7fb26ffff640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2700ae140 0x7fb27014bc00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb26002a2b0 tx=0x7fb2600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.182+0000 7fb26cff9640 1 -- 172.21.15.42:0/3623037477 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260041020 con 0x7fb2700ae140 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.182+0000 7fb26cff9640 1 -- 172.21.15.42:0/3623037477 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2600306c0 con 0x7fb2700ae140 2024-09-16T01:55:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.182+0000 7fb26cff9640 1 -- 172.21.15.42:0/3623037477 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260037040 con 0x7fb2700ae140 2024-09-16T01:55:13.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.182+0000 7fb276398640 1 -- 172.21.15.42:0/3623037477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27015be00 con 0x7fb2700ae140 2024-09-16T01:55:13.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.182+0000 7fb276398640 1 -- 172.21.15.42:0/3623037477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27015c3c0 con 0x7fb2700ae140 2024-09-16T01:55:13.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.183+0000 7fb276398640 1 -- 172.21.15.42:0/3623037477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2700b6b90 con 0x7fb2700ae140 2024-09-16T01:55:13.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.184+0000 7fb26cff9640 1 -- 172.21.15.42:0/3623037477 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb260044020 con 0x7fb2700ae140 2024-09-16T01:55:13.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.184+0000 7fb26cff9640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb25c06c2b0 0x7fb25c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:13.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.184+0000 7fb26cff9640 1 -- 172.21.15.42:0/3623037477 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5619+0+0 (secure 0 0 0) 0x7fb2600abc30 con 0x7fb2700ae140 2024-09-16T01:55:13.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.184+0000 7fb26f7fe640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb25c06c2b0 0x7fb25c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:13.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.185+0000 7fb26f7fe640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb25c06c2b0 0x7fb25c06e770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb264006fd0 tx=0x7fb264008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:13.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.189+0000 7fb26cff9640 1 -- 172.21.15.42:0/3623037477 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb26004b030 con 0x7fb2700ae140 2024-09-16T01:55:13.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:13.363+0000 7fb276398640 1 -- 172.21.15.42:0/3623037477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb2700b60c0 con 0x7fb2700ae140 2024-09-16T01:55:14.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.045+0000 7fb26cff9640 1 -- 172.21.15.42:0/3623037477 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) ==== 170+0+0 (secure 0 0 0) 0x7fb26007a400 con 0x7fb2700ae140 2024-09-16T01:55:14.046 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-16T01:55:14.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.048+0000 7fb276398640 1 -- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb25c06c2b0 msgr2=0x7fb25c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:14.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.048+0000 7fb276398640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb25c06c2b0 0x7fb25c06e770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb264006fd0 tx=0x7fb264008040 comp rx=0 tx=0).stop 2024-09-16T01:55:14.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.048+0000 7fb276398640 1 -- 172.21.15.42:0/3623037477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2700ae140 msgr2=0x7fb27014bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:14.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.048+0000 7fb276398640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2700ae140 0x7fb27014bc00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb26002a2b0 tx=0x7fb2600046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.049+0000 7fb276398640 1 -- 172.21.15.42:0/3623037477 shutdown_connections 2024-09-16T01:55:14.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.049+0000 7fb276398640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb25c06c2b0 0x7fb25c06e770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.049+0000 7fb276398640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb27015b610 0x7fb27015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.049+0000 7fb276398640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb2700b05a0 0x7fb2700b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.049+0000 7fb276398640 1 --2- 172.21.15.42:0/3623037477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2700ae140 0x7fb27014bc00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.049+0000 7fb276398640 1 -- 172.21.15.42:0/3623037477 >> 172.21.15.42:0/3623037477 conn(0x7fb2700b6680 msgr2=0x7fb27015faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:14.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.053+0000 7fb276398640 1 -- 172.21.15.42:0/3623037477 shutdown_connections 2024-09-16T01:55:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.055+0000 7fb276398640 1 -- 172.21.15.42:0/3623037477 wait complete. 2024-09-16T01:55:14.079 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:55:14.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.188+0000 7f0bb1d98640 1 Processor -- start 2024-09-16T01:55:14.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.188+0000 7f0bb1d98640 1 -- start start 2024-09-16T01:55:14.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.189+0000 7f0bb1d98640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0bac15e7f0 0x7f0bac0b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:14.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.189+0000 7f0bb1d98640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0bac0af210 0x7f0bac070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:14.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.189+0000 7f0bb1d98640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 0x7f0bac070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.189+0000 7f0bb1d98640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f0bac06cdc0 con 0x7f0bac0af210 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.189+0000 7f0bb1d98640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0bac06d0a0 con 0x7f0bac15e7f0 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.189+0000 7f0bb1d98640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac06d380 con 0x7f0bac0b7250 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.189+0000 7f0baaffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0bac0af210 0x7f0bac070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.189+0000 7f0baaffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0bac0af210 0x7f0bac070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36064/0 (socket says 172.21.15.42:36064) 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.189+0000 7f0baaffd640 1 -- 172.21.15.42:0/1841919688 learned_addr learned my addr 172.21.15.42:0/1841919688 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.189+0000 7f0babfff640 1 --2- 172.21.15.42:0/1841919688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 0x7f0bac070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.190+0000 7f0baaffd640 1 -- 172.21.15.42:0/1841919688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 msgr2=0x7f0bac070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.190+0000 7f0baaffd640 1 --2- 172.21.15.42:0/1841919688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 0x7f0bac070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.190+0000 7f0baaffd640 1 -- 172.21.15.42:0/1841919688 >> v2:172.21.15.107:3300/0 conn(0x7f0bac15e7f0 msgr2=0x7f0bac0b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.190+0000 7f0bab7fe640 1 --2- 172.21.15.42:0/1841919688 >> v2:172.21.15.107:3300/0 conn(0x7f0bac15e7f0 0x7f0bac0b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:14.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.190+0000 7f0baaffd640 1 --2- 172.21.15.42:0/1841919688 >> v2:172.21.15.107:3300/0 conn(0x7f0bac15e7f0 0x7f0bac0b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.190+0000 7f0baaffd640 1 -- 172.21.15.42:0/1841919688 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac06d660 con 0x7f0bac0af210 2024-09-16T01:55:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.190+0000 7f0babfff640 1 --2- 172.21.15.42:0/1841919688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 0x7f0bac070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.190+0000 7f0bab7fe640 1 --2- 172.21.15.42:0/1841919688 >> v2:172.21.15.107:3300/0 conn(0x7f0bac15e7f0 0x7f0bac0b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:14.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.190+0000 7f0baaffd640 1 --2- 172.21.15.42:0/1841919688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac0af210 0x7f0bac070a70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0bac073080 tx=0x7f0ba002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fbbc5e762a2ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:14.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.190+0000 7f0baa7fc640 1 -- 172.21.15.42:0/1841919688 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0037070 con 0x7f0bac0af210 2024-09-16T01:55:14.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0baa7fc640 1 -- 172.21.15.42:0/1841919688 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba0032440 con 0x7f0bac0af210 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0baa7fc640 1 -- 172.21.15.42:0/1841919688 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0032810 con 0x7f0bac0af210 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1841919688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac0af210 msgr2=0x7f0bac070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0bb1d98640 1 --2- 172.21.15.42:0/1841919688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac0af210 0x7f0bac070a70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0bac073080 tx=0x7f0ba002a1e0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1841919688 shutdown_connections 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0bb1d98640 1 --2- 172.21.15.42:0/1841919688 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 0x7f0bac070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0bb1d98640 1 --2- 172.21.15.42:0/1841919688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac0af210 0x7f0bac070a70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0bb1d98640 1 --2- 172.21.15.42:0/1841919688 >> v2:172.21.15.107:3300/0 conn(0x7f0bac15e7f0 0x7f0bac0b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1841919688 >> 172.21.15.42:0/1841919688 conn(0x7f0bac0b3f30 msgr2=0x7f0bac0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1841919688 shutdown_connections 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.191+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1841919688 wait complete. 2024-09-16T01:55:14.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.192+0000 7f0bb1d98640 1 Processor -- start 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.192+0000 7f0bb1d98640 1 -- start start 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0bb1d98640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0bac0af210 0x7f0bac158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0bb1d98640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 0x7f0bac155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0bb1d98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac15e7f0 0x7f0bac15fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0bb1d98640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac09abb0 con 0x7f0bac15e7f0 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0bb1d98640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac09aa30 con 0x7f0bac0af210 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0bb1d98640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac09ad30 con 0x7f0bac0b7250 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0babfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac15e7f0 0x7f0bac15fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0babfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac15e7f0 0x7f0bac15fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36074/0 (socket says 172.21.15.42:36074) 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0babfff640 1 -- 172.21.15.42:0/1712412989 learned_addr learned my addr 172.21.15.42:0/1712412989 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0baaffd640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 0x7f0bac155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.193+0000 7f0bab7fe640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0bac0af210 0x7f0bac158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:14.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0babfff640 1 -- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 msgr2=0x7f0bac155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:14.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0babfff640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 0x7f0bac155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0babfff640 1 -- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0bac0af210 msgr2=0x7f0bac158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:14.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0babfff640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0bac0af210 0x7f0bac158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:14.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0babfff640 1 -- 172.21.15.42:0/1712412989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac0cdf00 con 0x7f0bac15e7f0 2024-09-16T01:55:14.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0babfff640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac15e7f0 0x7f0bac15fef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400cdf0 tx=0x7f0ba400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:14.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0b93fff640 1 -- 172.21.15.42:0/1712412989 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4003b90 con 0x7f0bac15e7f0 2024-09-16T01:55:14.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0b93fff640 1 -- 172.21.15.42:0/1712412989 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba4003d50 con 0x7f0bac15e7f0 2024-09-16T01:55:14.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0b93fff640 1 -- 172.21.15.42:0/1712412989 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4004260 con 0x7f0bac15e7f0 2024-09-16T01:55:14.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1712412989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bac0ce1e0 con 0x7f0bac15e7f0 2024-09-16T01:55:14.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.194+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1712412989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bac0cba10 con 0x7f0bac15e7f0 2024-09-16T01:55:14.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.195+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1712412989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bac0ce3b0 con 0x7f0bac15e7f0 2024-09-16T01:55:14.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.196+0000 7f0b93fff640 1 -- 172.21.15.42:0/1712412989 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0ba4005d10 con 0x7f0bac15e7f0 2024-09-16T01:55:14.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.196+0000 7f0b93fff640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0b9806c2b0 0x7f0b9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:14.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.196+0000 7f0b93fff640 1 -- 172.21.15.42:0/1712412989 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6001+0+0 (secure 0 0 0) 0x7f0ba408c2a0 con 0x7f0bac15e7f0 2024-09-16T01:55:14.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.197+0000 7f0bab7fe640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0b9806c2b0 0x7f0b9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:14.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.197+0000 7f0bab7fe640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0b9806c2b0 0x7f0b9806e770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00aac0 tx=0x7f0b9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:14.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.200+0000 7f0b93fff640 1 -- 172.21.15.42:0/1712412989 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ba405a370 con 0x7f0bac15e7f0 2024-09-16T01:55:14.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:14.409+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1712412989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0bac0b0410 con 0x7f0bac15e7f0 2024-09-16T01:55:15.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.057+0000 7f0b93fff640 1 -- 172.21.15.42:0/1712412989 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f0ba405e670 con 0x7f0bac15e7f0 2024-09-16T01:55:15.060 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 5 and data pool 6 2024-09-16T01:55:15.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.067+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0b9806c2b0 msgr2=0x7f0b9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.067+0000 7f0bb1d98640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0b9806c2b0 0x7f0b9806e770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00aac0 tx=0x7f0b9c008040 comp rx=0 tx=0).stop 2024-09-16T01:55:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.067+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1712412989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac15e7f0 msgr2=0x7f0bac15fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.067+0000 7f0bb1d98640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac15e7f0 0x7f0bac15fef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400cdf0 tx=0x7f0ba400a710 comp rx=0 tx=0).stop 2024-09-16T01:55:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.068+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1712412989 shutdown_connections 2024-09-16T01:55:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.068+0000 7f0bb1d98640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0b9806c2b0 0x7f0b9806e770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.068+0000 7f0bb1d98640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bac15e7f0 0x7f0bac15fef0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.068+0000 7f0bb1d98640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0bac0b7250 0x7f0bac155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.068+0000 7f0bb1d98640 1 --2- 172.21.15.42:0/1712412989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0bac0af210 0x7f0bac158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.068+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1712412989 >> 172.21.15.42:0/1712412989 conn(0x7f0bac0b3f30 msgr2=0x7f0bac0af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:15.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.069+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1712412989 shutdown_connections 2024-09-16T01:55:15.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.069+0000 7f0bb1d98640 1 -- 172.21.15.42:0/1712412989 wait complete. 2024-09-16T01:55:15.091 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:55:15.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.197+0000 7f4f6ddd6640 1 Processor -- start 2024-09-16T01:55:15.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.197+0000 7f4f6ddd6640 1 -- start start 2024-09-16T01:55:15.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.198+0000 7f4f6ddd6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4f6815e5f0 0x7f4f680d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.198+0000 7f4f6ddd6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 0x7f4f6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.198+0000 7f4f6ddd6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f680d3690 con 0x7f4f680d30f0 2024-09-16T01:55:15.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.198+0000 7f4f6ddd6640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6806d530 con 0x7f4f6815e5f0 2024-09-16T01:55:15.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.198+0000 7f4f6ddd6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f680d3970 con 0x7f4f680b6690 2024-09-16T01:55:15.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.198+0000 7f4f677fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4f6815e5f0 0x7f4f680d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.198+0000 7f4f677fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4f6815e5f0 0x7f4f680d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36084/0 (socket says 172.21.15.42:36084) 2024-09-16T01:55:15.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.198+0000 7f4f677fe640 1 -- 172.21.15.42:0/2300410270 learned_addr learned my addr 172.21.15.42:0/2300410270 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:15.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.199+0000 7f4f677fe640 1 -- 172.21.15.42:0/2300410270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 msgr2=0x7f4f6806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:15.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.199+0000 7f4f67fff640 1 --2- 172.21.15.42:0/2300410270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 0x7f4f6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.199+0000 7f4f677fe640 1 --2- 172.21.15.42:0/2300410270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 0x7f4f6806d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.199+0000 7f4f677fe640 1 -- 172.21.15.42:0/2300410270 >> v1:172.21.15.107:6789/0 conn(0x7f4f680d30f0 legacy=0x7f4f680b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.199+0000 7f4f677fe640 1 -- 172.21.15.42:0/2300410270 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6806cee0 con 0x7f4f6815e5f0 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.199+0000 7f4f67fff640 1 --2- 172.21.15.42:0/2300410270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 0x7f4f6806d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.199+0000 7f4f677fe640 1 --2- 172.21.15.42:0/2300410270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 0x7f4f680d4dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f680d1f90 tx=0x7f4f5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229be066c4e3f7ed server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.199+0000 7f4f667fc640 1 -- 172.21.15.42:0/2300410270 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58037070 con 0x7f4f6815e5f0 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.200+0000 7f4f667fc640 1 -- 172.21.15.42:0/2300410270 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f58032440 con 0x7f4f6815e5f0 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.200+0000 7f4f667fc640 1 -- 172.21.15.42:0/2300410270 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58032810 con 0x7f4f6815e5f0 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.200+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/2300410270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 msgr2=0x7f4f680d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.200+0000 7f4f6ddd6640 1 --2- 172.21.15.42:0/2300410270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 0x7f4f680d4dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f680d1f90 tx=0x7f4f5802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.200+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/2300410270 shutdown_connections 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.200+0000 7f4f6ddd6640 1 --2- 172.21.15.42:0/2300410270 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 0x7f4f6806d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.200+0000 7f4f6ddd6640 1 --2- 172.21.15.42:0/2300410270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 0x7f4f680d4dd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.200+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/2300410270 >> 172.21.15.42:0/2300410270 conn(0x7f4f6808bfc0 msgr2=0x7f4f680d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:15.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.200+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/2300410270 shutdown_connections 2024-09-16T01:55:15.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.200+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/2300410270 wait complete. 2024-09-16T01:55:15.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.201+0000 7f4f6ddd6640 1 Processor -- start 2024-09-16T01:55:15.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f6ddd6640 1 -- start start 2024-09-16T01:55:15.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f6ddd6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 0x7f4f6815d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f6ddd6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f680d30f0 0x7f4f680b9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f6ddd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 0x7f4f680c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f6ddd6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4f680d5310 con 0x7f4f6815e5f0 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f6ddd6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6815e9d0 con 0x7f4f680d30f0 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f6ddd6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6806df00 con 0x7f4f680b6690 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f67fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 0x7f4f680c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f67fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 0x7f4f680c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36100/0 (socket says 172.21.15.42:36100) 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f67fff640 1 -- 172.21.15.42:0/1477597945 learned_addr learned my addr 172.21.15.42:0/1477597945 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f677fe640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 0x7f4f6815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.202+0000 7f4f66ffd640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f680d30f0 0x7f4f680b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f67fff640 1 -- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 msgr2=0x7f4f6815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f67fff640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 0x7f4f6815d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f67fff640 1 -- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f680d30f0 msgr2=0x7f4f680b9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f67fff640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f680d30f0 0x7f4f680b9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f67fff640 1 -- 172.21.15.42:0/1477597945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6815f340 con 0x7f4f6815e5f0 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f67fff640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 0x7f4f680c8030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000cef0 tx=0x7f4f6000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f4ffff640 1 -- 172.21.15.42:0/1477597945 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6001a070 con 0x7f4f6815e5f0 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f4ffff640 1 -- 172.21.15.42:0/1477597945 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6000d860 con 0x7f4f6815e5f0 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/1477597945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f680b9bc0 con 0x7f4f6815e5f0 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f4ffff640 1 -- 172.21.15.42:0/1477597945 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6000dc50 con 0x7f4f6815e5f0 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.203+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/1477597945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6815f8c0 con 0x7f4f6815e5f0 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.204+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/1477597945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f6806d9a0 con 0x7f4f6815e5f0 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.205+0000 7f4f4ffff640 1 -- 172.21.15.42:0/1477597945 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4f6001d070 con 0x7f4f6815e5f0 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.205+0000 7f4f4ffff640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4f5406c2b0 0x7f4f5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.205+0000 7f4f4ffff640 1 -- 172.21.15.42:0/1477597945 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f4f6008bd60 con 0x7f4f6815e5f0 2024-09-16T01:55:15.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.205+0000 7f4f677fe640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4f5406c2b0 0x7f4f5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.206+0000 7f4f677fe640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4f5406c2b0 0x7f4f5406e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f58034000 tx=0x7f4f5802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:15.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.210+0000 7f4f4ffff640 1 -- 172.21.15.42:0/1477597945 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f60059e40 con 0x7f4f6815e5f0 2024-09-16T01:55:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.389+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/1477597945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f680b1dd0 con 0x7f4f6815e5f0 2024-09-16T01:55:15.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.390+0000 7f4f4ffff640 1 -- 172.21.15.42:0/1477597945 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+17003 (secure 0 0 0) 0x7f4f6005e140 con 0x7f4f6815e5f0 2024-09-16T01:55:15.392 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:15.392 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":37,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:14.410793+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:55:12.311183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-16T01:55:13.394907+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:55:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.392+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4f5406c2b0 msgr2=0x7f4f5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.392+0000 7f4f6ddd6640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4f5406c2b0 0x7f4f5406e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f58034000 tx=0x7f4f5802e000 comp rx=0 tx=0).stop 2024-09-16T01:55:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.392+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/1477597945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 msgr2=0x7f4f680c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.392+0000 7f4f6ddd6640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 0x7f4f680c8030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000cef0 tx=0x7f4f6000a710 comp rx=0 tx=0).stop 2024-09-16T01:55:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.392+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/1477597945 shutdown_connections 2024-09-16T01:55:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.392+0000 7f4f6ddd6640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4f5406c2b0 0x7f4f5406e770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.392+0000 7f4f6ddd6640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f6815e5f0 0x7f4f680c8030 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.392+0000 7f4f6ddd6640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f680d30f0 0x7f4f680b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.392+0000 7f4f6ddd6640 1 --2- 172.21.15.42:0/1477597945 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f680b6690 0x7f4f6815d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.392+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/1477597945 >> 172.21.15.42:0/1477597945 conn(0x7f4f6808bfc0 msgr2=0x7f4f680b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:15.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.393+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/1477597945 shutdown_connections 2024-09-16T01:55:15.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.393+0000 7f4f6ddd6640 1 -- 172.21.15.42:0/1477597945 wait complete. 2024-09-16T01:55:15.405 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:55:15.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.506+0000 7f26f9d11640 1 Processor -- start 2024-09-16T01:55:15.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.506+0000 7f26f9d11640 1 -- start start 2024-09-16T01:55:15.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.506+0000 7f26f9d11640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f26f4161c80 0x7f26f406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.506+0000 7f26f9d11640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f4162060 0x7f26f40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.506+0000 7f26f9d11640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f406e870 con 0x7f26f40b64b0 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.506+0000 7f26f9d11640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f26f406d9f0 con 0x7f26f4161c80 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.506+0000 7f26f9d11640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f26f406dcd0 con 0x7f26f4162060 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f3fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f26f40b64b0 0x7f26f4162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53090/0 (socket says 172.21.15.42:53090) 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f3fff640 1 -- 172.21.15.42:0/2407307544 learned_addr learned my addr 172.21.15.42:0/2407307544 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f2ffd640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f4162060 0x7f26f40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046610794 0 0) 0x7f26ec001490 con 0x7f26f40b64b0 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f37fe640 1 --2- 172.21.15.42:0/2407307544 >> v2:172.21.15.107:3300/0 conn(0x7f26f4161c80 0x7f26f406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26dc003520 con 0x7f26f40b64b0 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2243363637 0 0) 0x7f26dc003520 con 0x7f26f40b64b0 2024-09-16T01:55:15.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f4162060 msgr2=0x7f26f40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f4162060 0x7f26f40b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 >> v2:172.21.15.107:3300/0 conn(0x7f26f4161c80 msgr2=0x7f26f406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 --2- 172.21.15.42:0/2407307544 >> v2:172.21.15.107:3300/0 conn(0x7f26f4161c80 0x7f26f406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f406dfb0 con 0x7f26f40b64b0 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f26ec001bc0 con 0x7f26f40b64b0 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 >> v1:172.21.15.42:6789/0 conn(0x7f26f40b64b0 legacy=0x7f26f4162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 0x7f26dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26dc004800 0x7f26dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f4162060 0x7f26dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26f406d9f0 con 0x7f26dc0039b0 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f26f406dcd0 con 0x7f26dc004800 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f26dc00b9c0 con 0x7f26f4162060 2024-09-16T01:55:15.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f37fe640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 0x7f26dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f3fff640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f4162060 0x7f26dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.507+0000 7f26f2ffd640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26dc004800 0x7f26dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.508+0000 7f26f37fe640 1 -- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f4162060 msgr2=0x7f26dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.508+0000 7f26f37fe640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f4162060 0x7f26dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.508+0000 7f26f37fe640 1 -- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26dc004800 msgr2=0x7f26dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.508+0000 7f26f37fe640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26dc004800 0x7f26dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.508+0000 7f26f37fe640 1 -- 172.21.15.42:0/2407307544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc003520 con 0x7f26dc0039b0 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.508+0000 7f26f37fe640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 0x7f26dc003dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009ac0 tx=0x7f26dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fa0faa064ff017 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.508+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4036070 con 0x7f26dc0039b0 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.508+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e4031400 con 0x7f26dc0039b0 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.508+0000 7f26f27fc640 1 -- 172.21.15.42:0/2407307544 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4009690 con 0x7f26dc0039b0 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.509+0000 7f26f9d11640 1 -- 172.21.15.42:0/2407307544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 msgr2=0x7f26dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.509+0000 7f26f9d11640 1 --2- 172.21.15.42:0/2407307544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 0x7f26dc003dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009ac0 tx=0x7f26dc005830 comp rx=0 tx=0).stop 2024-09-16T01:55:15.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.509+0000 7f26f3fff640 1 -- 172.21.15.42:0/2407307544 reap_dead start 2024-09-16T01:55:15.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.509+0000 7f26f9d11640 1 -- 172.21.15.42:0/2407307544 shutdown_connections 2024-09-16T01:55:15.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.509+0000 7f26f9d11640 1 -- 172.21.15.42:0/2407307544 >> 172.21.15.42:0/2407307544 conn(0x7f26f40d44f0 msgr2=0x7f26f40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:15.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.509+0000 7f26f9d11640 1 -- 172.21.15.42:0/2407307544 shutdown_connections 2024-09-16T01:55:15.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.509+0000 7f26f9d11640 1 -- 172.21.15.42:0/2407307544 wait complete. 2024-09-16T01:55:15.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.510+0000 7f26f9d11640 1 Processor -- start 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.510+0000 7f26f9d11640 1 -- start start 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f9d11640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 0x7f26f41565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f9d11640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26f4156bf0 0x7f26f40b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f9d11640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f40b15a0 0x7f26f40b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f9d11640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26f40d2a10 con 0x7f26dc0039b0 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f9d11640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f26f40d2890 con 0x7f26f4156bf0 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f9d11640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f26f40b5f70 con 0x7f26f40b15a0 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 0x7f26f41565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 0x7f26f41565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36118/0 (socket says 172.21.15.42:36118) 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f37fe640 1 -- 172.21.15.42:0/1778502189 learned_addr learned my addr 172.21.15.42:0/1778502189 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f3fff640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f40b15a0 0x7f26f40b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.511+0000 7f26f2ffd640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26f4156bf0 0x7f26f40b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26f37fe640 1 -- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f40b15a0 msgr2=0x7f26f40b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26f37fe640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f40b15a0 0x7f26f40b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26f37fe640 1 -- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26f4156bf0 msgr2=0x7f26f40b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26f37fe640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26f4156bf0 0x7f26f40b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26f37fe640 1 -- 172.21.15.42:0/1778502189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f40b73e0 con 0x7f26dc0039b0 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26f3fff640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f40b15a0 0x7f26f40b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26f37fe640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 0x7f26f41565d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009be0 tx=0x7f26e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26dbfff640 1 -- 172.21.15.42:0/1778502189 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4040020 con 0x7f26dc0039b0 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26dbfff640 1 -- 172.21.15.42:0/1778502189 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e4003b40 con 0x7f26dc0039b0 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26f9d11640 1 -- 172.21.15.42:0/1778502189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f40cded0 con 0x7f26dc0039b0 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26dbfff640 1 -- 172.21.15.42:0/1778502189 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4036040 con 0x7f26dc0039b0 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.512+0000 7f26f9d11640 1 -- 172.21.15.42:0/1778502189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f40ce1b0 con 0x7f26dc0039b0 2024-09-16T01:55:15.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.513+0000 7f26f9d11640 1 -- 172.21.15.42:0/1778502189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f406e330 con 0x7f26dc0039b0 2024-09-16T01:55:15.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.513+0000 7f26dbfff640 1 -- 172.21.15.42:0/1778502189 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f26e4043020 con 0x7f26dc0039b0 2024-09-16T01:55:15.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.514+0000 7f26dbfff640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f26e006c2b0 0x7f26e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.514+0000 7f26dbfff640 1 -- 172.21.15.42:0/1778502189 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f26e40aba00 con 0x7f26dc0039b0 2024-09-16T01:55:15.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.514+0000 7f26f2ffd640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f26e006c2b0 0x7f26e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.515+0000 7f26f2ffd640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f26e006c2b0 0x7f26e006e770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f26f40cb120 tx=0x7f26e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:15.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.518+0000 7f26dbfff640 1 -- 172.21.15.42:0/1778502189 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26e404a030 con 0x7f26dc0039b0 2024-09-16T01:55:15.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.697+0000 7f26f9d11640 1 -- 172.21.15.42:0/1778502189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26f40ba470 con 0x7f26dc0039b0 2024-09-16T01:55:15.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.698+0000 7f26dbfff640 1 -- 172.21.15.42:0/1778502189 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+17003 (secure 0 0 0) 0x7f26e407ee20 con 0x7f26dc0039b0 2024-09-16T01:55:15.699 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:15.700 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":37,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:14.410793+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:55:12.311183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-16T01:55:13.394907+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:55:15.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 -- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f26e006c2b0 msgr2=0x7f26e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f26e006c2b0 0x7f26e006e770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f26f40cb120 tx=0x7f26e8008040 comp rx=0 tx=0).stop 2024-09-16T01:55:15.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 -- 172.21.15.42:0/1778502189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 msgr2=0x7f26f41565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 0x7f26f41565d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009be0 tx=0x7f26e4004730 comp rx=0 tx=0).stop 2024-09-16T01:55:15.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 -- 172.21.15.42:0/1778502189 shutdown_connections 2024-09-16T01:55:15.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f26e006c2b0 0x7f26e006e770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f26f40b15a0 0x7f26f40b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26f4156bf0 0x7f26f40b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 --2- 172.21.15.42:0/1778502189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26dc0039b0 0x7f26f41565d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 -- 172.21.15.42:0/1778502189 >> 172.21.15.42:0/1778502189 conn(0x7f26f40d44f0 msgr2=0x7f26f4160100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:15.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 -- 172.21.15.42:0/1778502189 shutdown_connections 2024-09-16T01:55:15.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.700+0000 7f26f9d11640 1 -- 172.21.15.42:0/1778502189 wait complete. 2024-09-16T01:55:15.713 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:55:15.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.817+0000 7f5e31a5e640 1 Processor -- start 2024-09-16T01:55:15.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.817+0000 7f5e31a5e640 1 -- start start 2024-09-16T01:55:15.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e31a5e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5e2c0b5f80 0x7f5e2c162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e31a5e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2c0d2600 con 0x7f5e2c0d3320 2024-09-16T01:55:15.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e31a5e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2c0b3c10 con 0x7f5e2c0d4c10 2024-09-16T01:55:15.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e31a5e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2c0d5420 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e2b7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5e2c0d3320 0x7f5e2c0ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53098/0 (socket says 172.21.15.42:53098) 2024-09-16T01:55:15.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e2b7fe640 1 -- 172.21.15.42:0/1611626781 learned_addr learned my addr 172.21.15.42:0/1611626781 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:15.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e2affd640 1 --2- 172.21.15.42:0/1611626781 >> v2:172.21.15.107:3300/0 conn(0x7f5e2c0b5f80 0x7f5e2c162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e29ffb640 1 -- 172.21.15.42:0/1611626781 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949940102 0 0) 0x7f5e24001490 con 0x7f5e2c0d3320 2024-09-16T01:55:15.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e29ffb640 1 -- 172.21.15.42:0/1611626781 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e14003520 con 0x7f5e2c0d3320 2024-09-16T01:55:15.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e29ffb640 1 -- 172.21.15.42:0/1611626781 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2413642920 0 0) 0x7f5e20001110 con 0x7f5e2c0d4c10 2024-09-16T01:55:15.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e29ffb640 1 -- 172.21.15.42:0/1611626781 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e24001490 con 0x7f5e2c0d4c10 2024-09-16T01:55:15.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.818+0000 7f5e2affd640 1 -- 172.21.15.42:0/1611626781 >> v1:172.21.15.107:6789/0 conn(0x7f5e2c0d4c10 legacy=0x7f5e2c0b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.819+0000 7f5e2affd640 1 -- 172.21.15.42:0/1611626781 >> v1:172.21.15.42:6789/0 conn(0x7f5e2c0d3320 legacy=0x7f5e2c0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.819+0000 7f5e29ffb640 1 -- 172.21.15.42:0/1611626781 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1662648904 0 0) 0x7f5e14003520 con 0x7f5e2c0d3320 2024-09-16T01:55:15.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.819+0000 7f5e2affd640 1 -- 172.21.15.42:0/1611626781 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c0d2880 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.819+0000 7f5e2affd640 1 --2- 172.21.15.42:0/1611626781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e2c0b5f80 0x7f5e2c162980 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0097d0 tx=0x7f5e1c02a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bb7df0f1a4bc72 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.820+0000 7f5e29ffb640 1 -- 172.21.15.42:0/1611626781 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c037070 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.820+0000 7f5e29ffb640 1 -- 172.21.15.42:0/1611626781 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1c02ac90 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.820+0000 7f5e29ffb640 1 -- 172.21.15.42:0/1611626781 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24001bc0 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.820+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1611626781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e2c0b5f80 msgr2=0x7f5e2c162980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.820+0000 7f5e31a5e640 1 --2- 172.21.15.42:0/1611626781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e2c0b5f80 0x7f5e2c162980 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0097d0 tx=0x7f5e1c02a200 comp rx=0 tx=0).stop 2024-09-16T01:55:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.820+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1611626781 shutdown_connections 2024-09-16T01:55:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.820+0000 7f5e31a5e640 1 --2- 172.21.15.42:0/1611626781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e2c0b5f80 0x7f5e2c162980 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.820+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1611626781 >> 172.21.15.42:0/1611626781 conn(0x7f5e2c08bfc0 msgr2=0x7f5e2c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.820+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1611626781 shutdown_connections 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.820+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1611626781 wait complete. 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.821+0000 7f5e31a5e640 1 Processor -- start 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.822+0000 7f5e31a5e640 1 -- start start 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.822+0000 7f5e31a5e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e2c0b5f80 0x7f5e2c0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.822+0000 7f5e31a5e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e2c0d3320 0x7f5e2c06e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.822+0000 7f5e31a5e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e2c0d4c10 0x7f5e2c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.822+0000 7f5e31a5e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c0d2b20 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.822+0000 7f5e31a5e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c0d2e90 con 0x7f5e2c0d3320 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.822+0000 7f5e31a5e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c15f690 con 0x7f5e2c0d4c10 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.822+0000 7f5e2affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e2c0b5f80 0x7f5e2c0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.822+0000 7f5e2affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e2c0b5f80 0x7f5e2c0b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36130/0 (socket says 172.21.15.42:36130) 2024-09-16T01:55:15.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.822+0000 7f5e2affd640 1 -- 172.21.15.42:0/1690719419 learned_addr learned my addr 172.21.15.42:0/1690719419 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e2b7fe640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e2c0d4c10 0x7f5e2c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e2a7fc640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e2c0d3320 0x7f5e2c06e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e2affd640 1 -- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e2c0d4c10 msgr2=0x7f5e2c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e2affd640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e2c0d4c10 0x7f5e2c15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e2affd640 1 -- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e2c0d3320 msgr2=0x7f5e2c06e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e2affd640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e2c0d3320 0x7f5e2c06e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e2affd640 1 -- 172.21.15.42:0/1690719419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c0b2c90 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e2a7fc640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e2c0d3320 0x7f5e2c06e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e2affd640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e2c0b5f80 0x7f5e2c0b2750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c000c00 tx=0x7f5e1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e13fff640 1 -- 172.21.15.42:0/1690719419 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c037040 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e13fff640 1 -- 172.21.15.42:0/1690719419 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1c004230 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1690719419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c159bc0 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e13fff640 1 -- 172.21.15.42:0/1690719419 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c006e10 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.823+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1690719419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c15a180 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.824+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1690719419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e2c0d37b0 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.825+0000 7f5e13fff640 1 -- 172.21.15.42:0/1690719419 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5e1c003610 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.825+0000 7f5e13fff640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e1806c2b0 0x7f5e1806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.825+0000 7f5e13fff640 1 -- 172.21.15.42:0/1690719419 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f5e1c0abfb0 con 0x7f5e2c0b5f80 2024-09-16T01:55:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.825+0000 7f5e2a7fc640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e1806c2b0 0x7f5e1806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.826+0000 7f5e2a7fc640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e1806c2b0 0x7f5e1806e770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c151480 tx=0x7f5e20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:15.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:15.829+0000 7f5e13fff640 1 -- 172.21.15.42:0/1690719419 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e1c07a620 con 0x7f5e2c0b5f80 2024-09-16T01:55:16.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.043+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1690719419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5e2c0b5520 con 0x7f5e2c0b5f80 2024-09-16T01:55:16.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.056+0000 7f5e13fff640 1 -- 172.21.15.42:0/1690719419 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f5e1c079f20 con 0x7f5e2c0b5f80 2024-09-16T01:55:16.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.058+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e1806c2b0 msgr2=0x7f5e1806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:16.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.058+0000 7f5e31a5e640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e1806c2b0 0x7f5e1806e770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c151480 tx=0x7f5e20009040 comp rx=0 tx=0).stop 2024-09-16T01:55:16.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.058+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1690719419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e2c0b5f80 msgr2=0x7f5e2c0b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.058+0000 7f5e31a5e640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e2c0b5f80 0x7f5e2c0b2750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c000c00 tx=0x7f5e1c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.058+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1690719419 shutdown_connections 2024-09-16T01:55:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.058+0000 7f5e31a5e640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e1806c2b0 0x7f5e1806e770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.058+0000 7f5e31a5e640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e2c0d4c10 0x7f5e2c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.058+0000 7f5e31a5e640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e2c0d3320 0x7f5e2c06e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.058+0000 7f5e31a5e640 1 --2- 172.21.15.42:0/1690719419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e2c0b5f80 0x7f5e2c0b2750 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.059+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1690719419 >> 172.21.15.42:0/1690719419 conn(0x7f5e2c08bfc0 msgr2=0x7f5e2c1614c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.059+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1690719419 shutdown_connections 2024-09-16T01:55:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.059+0000 7f5e31a5e640 1 -- 172.21.15.42:0/1690719419 wait complete. 2024-09-16T01:55:16.072 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:55:16.072 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:55:16.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.177+0000 7f3b152ba640 1 Processor -- start 2024-09-16T01:55:16.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.177+0000 7f3b152ba640 1 -- start start 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.178+0000 7f3b152ba640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3b1015e5a0 0x7f3b100cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.178+0000 7f3b152ba640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b100d53f0 con 0x7f3b1015e980 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.178+0000 7f3b152ba640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b1006cd90 con 0x7f3b100d1500 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.178+0000 7f3b152ba640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f3b1006d070 con 0x7f3b1015e5a0 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.178+0000 7f3b0effd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3b1015e5a0 0x7f3b100cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.178+0000 7f3b0effd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3b1015e5a0 0x7f3b100cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36138/0 (socket says 172.21.15.42:36138) 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.178+0000 7f3b0e7fc640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3b1015e980 0x7f3b100d0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53100/0 (socket says 172.21.15.42:53100) 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.178+0000 7f3b0effd640 1 -- 172.21.15.42:0/1194936055 learned_addr learned my addr 172.21.15.42:0/1194936055 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.178+0000 7f3b0effd640 1 -- 172.21.15.42:0/1194936055 >> v1:172.21.15.107:6789/0 conn(0x7f3b100d1500 legacy=0x7f3b101685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.178+0000 7f3b0effd640 1 -- 172.21.15.42:0/1194936055 >> v1:172.21.15.42:6789/0 conn(0x7f3b1015e980 legacy=0x7f3b100d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:16.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.179+0000 7f3b0effd640 1 -- 172.21.15.42:0/1194936055 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1006d350 con 0x7f3b1015e5a0 2024-09-16T01:55:16.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.179+0000 7f3b0effd640 1 --2- 172.21.15.42:0/1194936055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 0x7f3b100cfcd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009870 tx=0x7f3b0002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a159988f7d3a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:16.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.179+0000 7f3b0dffb640 1 -- 172.21.15.42:0/1194936055 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00037070 con 0x7f3b1015e5a0 2024-09-16T01:55:16.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.179+0000 7f3b0dffb640 1 -- 172.21.15.42:0/1194936055 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b00032440 con 0x7f3b1015e5a0 2024-09-16T01:55:16.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.179+0000 7f3b0dffb640 1 -- 172.21.15.42:0/1194936055 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00032810 con 0x7f3b1015e5a0 2024-09-16T01:55:16.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.180+0000 7f3b152ba640 1 -- 172.21.15.42:0/1194936055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 msgr2=0x7f3b100cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:16.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.180+0000 7f3b152ba640 1 --2- 172.21.15.42:0/1194936055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 0x7f3b100cfcd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009870 tx=0x7f3b0002a210 comp rx=0 tx=0).stop 2024-09-16T01:55:16.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.180+0000 7f3b152ba640 1 -- 172.21.15.42:0/1194936055 shutdown_connections 2024-09-16T01:55:16.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.180+0000 7f3b152ba640 1 --2- 172.21.15.42:0/1194936055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 0x7f3b100cfcd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:16.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.180+0000 7f3b152ba640 1 -- 172.21.15.42:0/1194936055 >> 172.21.15.42:0/1194936055 conn(0x7f3b1008bfc0 msgr2=0x7f3b100d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:16.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.180+0000 7f3b152ba640 1 -- 172.21.15.42:0/1194936055 shutdown_connections 2024-09-16T01:55:16.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.180+0000 7f3b152ba640 1 -- 172.21.15.42:0/1194936055 wait complete. 2024-09-16T01:55:16.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.181+0000 7f3b152ba640 1 Processor -- start 2024-09-16T01:55:16.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.181+0000 7f3b152ba640 1 -- start start 2024-09-16T01:55:16.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.182+0000 7f3b152ba640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b100d1500 0x7f3b10154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:16.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.182+0000 7f3b152ba640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 0x7f3b10161580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:16.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.182+0000 7f3b152ba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b1015e980 0x7f3b100b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:16.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.182+0000 7f3b152ba640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1006de30 con 0x7f3b1015e5a0 2024-09-16T01:55:16.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.182+0000 7f3b152ba640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1006d910 con 0x7f3b1015e980 2024-09-16T01:55:16.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.182+0000 7f3b152ba640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1006dfb0 con 0x7f3b100d1500 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.182+0000 7f3b0e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 0x7f3b10161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.182+0000 7f3b0e7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 0x7f3b10161580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36142/0 (socket says 172.21.15.42:36142) 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.182+0000 7f3b0e7fc640 1 -- 172.21.15.42:0/2855136000 learned_addr learned my addr 172.21.15.42:0/2855136000 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b0effd640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b100d1500 0x7f3b10154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b0f7fe640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b1015e980 0x7f3b100b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b0e7fc640 1 -- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b100d1500 msgr2=0x7f3b10154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b0e7fc640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b100d1500 0x7f3b10154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b0e7fc640 1 -- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b1015e980 msgr2=0x7f3b100b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b0e7fc640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b1015e980 0x7f3b100b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b0e7fc640 1 -- 172.21.15.42:0/2855136000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b10160ae0 con 0x7f3b1015e5a0 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b0f7fe640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b1015e980 0x7f3b100b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b0e7fc640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 0x7f3b10161580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c3c0 tx=0x7f3b0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3af77fe640 1 -- 172.21.15.42:0/2855136000 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b040074e0 con 0x7f3b1015e5a0 2024-09-16T01:55:16.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3af77fe640 1 -- 172.21.15.42:0/2855136000 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b04007680 con 0x7f3b1015e5a0 2024-09-16T01:55:16.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b152ba640 1 -- 172.21.15.42:0/2855136000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b100c82f0 con 0x7f3b1015e5a0 2024-09-16T01:55:16.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3af77fe640 1 -- 172.21.15.42:0/2855136000 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04004a00 con 0x7f3b1015e5a0 2024-09-16T01:55:16.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.183+0000 7f3b152ba640 1 -- 172.21.15.42:0/2855136000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b10161060 con 0x7f3b1015e5a0 2024-09-16T01:55:16.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.184+0000 7f3b152ba640 1 -- 172.21.15.42:0/2855136000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b100d0df0 con 0x7f3b1015e5a0 2024-09-16T01:55:16.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.185+0000 7f3af77fe640 1 -- 172.21.15.42:0/2855136000 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3b0401a020 con 0x7f3b1015e5a0 2024-09-16T01:55:16.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.185+0000 7f3af77fe640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3afc06c2b0 0x7f3afc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:16.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.185+0000 7f3af77fe640 1 -- 172.21.15.42:0/2855136000 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3b0408ad40 con 0x7f3b1015e5a0 2024-09-16T01:55:16.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.185+0000 7f3b0effd640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3afc06c2b0 0x7f3afc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:16.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.186+0000 7f3b0effd640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3afc06c2b0 0x7f3afc06e770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b00034000 tx=0x7f3b0002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:16.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.189+0000 7f3af77fe640 1 -- 172.21.15.42:0/2855136000 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b04059320 con 0x7f3b1015e5a0 2024-09-16T01:55:16.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:16.401+0000 7f3b152ba640 1 -- 172.21.15.42:0/2855136000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3b100d1ba0 con 0x7f3b1015e5a0 2024-09-16T01:55:16.924 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:55:16.927 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:55:17.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.065+0000 7f3af77fe640 1 -- 172.21.15.42:0/2855136000 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f3b04058c20 con 0x7f3b1015e5a0 2024-09-16T01:55:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 -- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3afc06c2b0 msgr2=0x7f3afc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3afc06c2b0 0x7f3afc06e770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b00034000 tx=0x7f3b0002e000 comp rx=0 tx=0).stop 2024-09-16T01:55:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 -- 172.21.15.42:0/2855136000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 msgr2=0x7f3b10161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 0x7f3b10161580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c3c0 tx=0x7f3b0400c880 comp rx=0 tx=0).stop 2024-09-16T01:55:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 -- 172.21.15.42:0/2855136000 shutdown_connections 2024-09-16T01:55:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f3afc06c2b0 0x7f3afc06e770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b1015e980 0x7f3b100b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b1015e5a0 0x7f3b10161580 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 --2- 172.21.15.42:0/2855136000 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3b100d1500 0x7f3b10154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 -- 172.21.15.42:0/2855136000 >> 172.21.15.42:0/2855136000 conn(0x7f3b1008bfc0 msgr2=0x7f3b100b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 -- 172.21.15.42:0/2855136000 shutdown_connections 2024-09-16T01:55:17.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.068+0000 7f3b152ba640 1 -- 172.21.15.42:0/2855136000 wait complete. 2024-09-16T01:55:17.082 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:55:17.082 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:17.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.186+0000 7f4d08c53640 1 Processor -- start 2024-09-16T01:55:17.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.186+0000 7f4d08c53640 1 -- start start 2024-09-16T01:55:17.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.187+0000 7f4d08c53640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d040cfcc0 0x7f4d0406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.187+0000 7f4d08c53640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4d040d4fd0 0x7f4d040d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.187+0000 7f4d08c53640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d040d2700 con 0x7f4d0415e760 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.187+0000 7f4d08c53640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4d040cedb0 con 0x7f4d040d4fd0 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.187+0000 7f4d08c53640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4d040cf090 con 0x7f4d040cfcc0 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.187+0000 7f4d0259c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4d0415e760 0x7f4d040cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53112/0 (socket says 172.21.15.42:53112) 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.187+0000 7f4d0259c640 1 -- 172.21.15.42:0/3309932444 learned_addr learned my addr 172.21.15.42:0/3309932444 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1336643793 0 0) 0x7f4cfc001110 con 0x7f4d0415e760 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf0003520 con 0x7f4d0415e760 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d01d9b640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d040cfcc0 0x7f4d0406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d02d9d640 1 --2- 172.21.15.42:0/3309932444 >> v2:172.21.15.107:3300/0 conn(0x7f4d040d4fd0 0x7f4d040d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1798375813 0 0) 0x7f4cf0003520 con 0x7f4d0415e760 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d040cfcc0 msgr2=0x7f4d0406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d040cfcc0 0x7f4d0406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 >> v2:172.21.15.107:3300/0 conn(0x7f4d040d4fd0 msgr2=0x7f4d040d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 --2- 172.21.15.42:0/3309932444 >> v2:172.21.15.107:3300/0 conn(0x7f4d040d4fd0 0x7f4d040d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d040b3c80 con 0x7f4d0415e760 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f4cfc001840 con 0x7f4d0415e760 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d02d9d640 1 --2- 172.21.15.42:0/3309932444 >> v2:172.21.15.107:3300/0 conn(0x7f4d040d4fd0 0x7f4d040d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 >> v1:172.21.15.42:6789/0 conn(0x7f4d0415e760 legacy=0x7f4d040cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf00039b0 0x7f4cf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d040cfcc0 0x7f4cf0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf0004d40 0x7f4cf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4d040cedb0 con 0x7f4cf0004d40 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4d040cf090 con 0x7f4cf00039b0 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf000b9f0 con 0x7f4d040cfcc0 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d02d9d640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf0004d40 0x7f4cf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d0259c640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf00039b0 0x7f4cf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d01d9b640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d040cfcc0 0x7f4cf0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d02d9d640 1 -- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d040cfcc0 msgr2=0x7f4cf0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:17.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d02d9d640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4d040cfcc0 0x7f4cf0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d02d9d640 1 -- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf00039b0 msgr2=0x7f4cf0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:17.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d02d9d640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cf00039b0 0x7f4cf0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.188+0000 7f4d02d9d640 1 -- 172.21.15.42:0/3309932444 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf0003520 con 0x7f4cf0004d40 2024-09-16T01:55:17.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.189+0000 7f4d02d9d640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf0004d40 0x7f4cf00051c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40073e0 tx=0x7f4cf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204da44d118589b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:17.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.189+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4009c80 con 0x7f4cf0004d40 2024-09-16T01:55:17.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.189+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf402c680 con 0x7f4cf0004d40 2024-09-16T01:55:17.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.189+0000 7f4d0159a640 1 -- 172.21.15.42:0/3309932444 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf402ca30 con 0x7f4cf0004d40 2024-09-16T01:55:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.190+0000 7f4d08c53640 1 -- 172.21.15.42:0/3309932444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf0004d40 msgr2=0x7f4cf00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.190+0000 7f4d08c53640 1 --2- 172.21.15.42:0/3309932444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf0004d40 0x7f4cf00051c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40073e0 tx=0x7f4cf0005830 comp rx=0 tx=0).stop 2024-09-16T01:55:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.190+0000 7f4d02d9d640 1 -- 172.21.15.42:0/3309932444 reap_dead start 2024-09-16T01:55:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.190+0000 7f4d08c53640 1 -- 172.21.15.42:0/3309932444 shutdown_connections 2024-09-16T01:55:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.190+0000 7f4d08c53640 1 -- 172.21.15.42:0/3309932444 >> 172.21.15.42:0/3309932444 conn(0x7f4d0408bfc0 msgr2=0x7f4d040d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.190+0000 7f4d08c53640 1 -- 172.21.15.42:0/3309932444 shutdown_connections 2024-09-16T01:55:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.190+0000 7f4d08c53640 1 -- 172.21.15.42:0/3309932444 wait complete. 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.191+0000 7f4d08c53640 1 Processor -- start 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.191+0000 7f4d08c53640 1 -- start start 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d08c53640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4cf0004d40 0x7f4d040b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d08c53640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d040b9a70 0x7f4d041f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d08c53640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d040b4db0 0x7f4d040b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d08c53640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0406cdd0 con 0x7f4d040b9a70 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d08c53640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4d040b3860 con 0x7f4d040b4db0 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d08c53640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0406cf50 con 0x7f4cf0004d40 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d01d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d040b9a70 0x7f4d041f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d01d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d040b9a70 0x7f4d041f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36160/0 (socket says 172.21.15.42:36160) 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d01d9b640 1 -- 172.21.15.42:0/3228047004 learned_addr learned my addr 172.21.15.42:0/3228047004 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d0259c640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4cf0004d40 0x7f4d040b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d02d9d640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d040b4db0 0x7f4d040b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d01d9b640 1 -- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4cf0004d40 msgr2=0x7f4d040b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d01d9b640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4cf0004d40 0x7f4d040b8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d01d9b640 1 -- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d040b4db0 msgr2=0x7f4d040b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.192+0000 7f4d01d9b640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d040b4db0 0x7f4d040b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.193+0000 7f4d01d9b640 1 -- 172.21.15.42:0/3228047004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d040b57a0 con 0x7f4d040b9a70 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.193+0000 7f4d01d9b640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d040b9a70 0x7f4d041f5820 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0118e0 tx=0x7f4cec011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.193+0000 7f4cfaffd640 1 -- 172.21.15.42:0/3228047004 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec005ba0 con 0x7f4d040b9a70 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.193+0000 7f4cfaffd640 1 -- 172.21.15.42:0/3228047004 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cec005d40 con 0x7f4d040b9a70 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.193+0000 7f4d08c53640 1 -- 172.21.15.42:0/3228047004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d040b3ff0 con 0x7f4d040b9a70 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.193+0000 7f4cfaffd640 1 -- 172.21.15.42:0/3228047004 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00f9e0 con 0x7f4d040b9a70 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.193+0000 7f4d08c53640 1 -- 172.21.15.42:0/3228047004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d040b45b0 con 0x7f4d040b9a70 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.194+0000 7f4d08c53640 1 -- 172.21.15.42:0/3228047004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d04073710 con 0x7f4d040b9a70 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.194+0000 7f4cfaffd640 1 -- 172.21.15.42:0/3228047004 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4cec012040 con 0x7f4d040b9a70 2024-09-16T01:55:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.195+0000 7f4cfaffd640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4ce406c2b0 0x7f4ce406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.195+0000 7f4cfaffd640 1 -- 172.21.15.42:0/3228047004 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f4cec08ba70 con 0x7f4d040b9a70 2024-09-16T01:55:17.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.195+0000 7f4d0259c640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4ce406c2b0 0x7f4ce406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.195+0000 7f4d0259c640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4ce406c2b0 0x7f4ce406e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0012f0 tx=0x7f4cfc007ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:17.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.199+0000 7f4cfaffd640 1 -- 172.21.15.42:0/3228047004 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d04073710 con 0x7f4d040b9a70 2024-09-16T01:55:17.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.409+0000 7f4d08c53640 1 -- 172.21.15.42:0/3228047004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d040b3200 con 0x7f4d040b9a70 2024-09-16T01:55:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.409+0000 7f4cfaffd640 1 -- 172.21.15.42:0/3228047004 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f4cec018030 con 0x7f4d040b9a70 2024-09-16T01:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"btime":"2024-09-16T01:55:17:061679+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/920871952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":920871952},{"type":"v1","addr":"172.21.15.42:6835","nonce":920871952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2239532612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2239532612},{"type":"v1","addr":"172.21.15.42:6833","nonce":2239532612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/663599658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":663599658},{"type":"v1","addr":"172.21.15.107:6836","nonce":663599658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:14.411116+0000","modified":"2024-09-16T01:55:16.402868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34562":{"gid":34562,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3744211154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3744211154},{"type":"v1","addr":"172.21.15.107:6837","nonce":3744211154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34562,"qdb_cluster":[34562]},"id":2}]} 2024-09-16T01:55:17.412 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-09-16T01:55:17.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 -- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4ce406c2b0 msgr2=0x7f4ce406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4ce406c2b0 0x7f4ce406e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0012f0 tx=0x7f4cfc007ac0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 -- 172.21.15.42:0/3228047004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d040b9a70 msgr2=0x7f4d041f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d040b9a70 0x7f4d041f5820 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0118e0 tx=0x7f4cec011ce0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 -- 172.21.15.42:0/3228047004 shutdown_connections 2024-09-16T01:55:17.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4ce406c2b0 0x7f4ce406e770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d040b4db0 0x7f4d040b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d040b9a70 0x7f4d041f5820 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 --2- 172.21.15.42:0/3228047004 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4cf0004d40 0x7f4d040b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 -- 172.21.15.42:0/3228047004 >> 172.21.15.42:0/3228047004 conn(0x7f4d0408bfc0 msgr2=0x7f4d04156920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 -- 172.21.15.42:0/3228047004 shutdown_connections 2024-09-16T01:55:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.411+0000 7f4d08c53640 1 -- 172.21.15.42:0/3228047004 wait complete. 2024-09-16T01:55:17.424 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:55:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.524+0000 7f981ee4c640 1 Processor -- start 2024-09-16T01:55:17.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.524+0000 7f981ee4c640 1 -- start start 2024-09-16T01:55:17.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.525+0000 7f981ee4c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f98180d30f0 0x7f98180b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.525+0000 7f981ee4c640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98180d3690 con 0x7f981815e5f0 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.525+0000 7f981ee4c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98180d3970 con 0x7f98180b64c0 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.525+0000 7f981ee4c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f981806d530 con 0x7f98180d30f0 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.525+0000 7f981cbe8640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f981815e5f0 0x7f98180d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53120/0 (socket says 172.21.15.42:53120) 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.525+0000 7f981cbe8640 1 -- 172.21.15.42:0/2284887405 learned_addr learned my addr 172.21.15.42:0/2284887405 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.525+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3745659348 0 0) 0x7f98180d3690 con 0x7f981815e5f0 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.525+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9800003520 con 0x7f981815e5f0 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.525+0000 7f9817fff640 1 --2- 172.21.15.42:0/2284887405 >> v2:172.21.15.107:3300/0 conn(0x7f98180d30f0 0x7f98180b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2497239606 0 0) 0x7f9800003520 con 0x7f981815e5f0 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 >> v2:172.21.15.107:3300/0 conn(0x7f98180d30f0 msgr2=0x7f98180b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 --2- 172.21.15.42:0/2284887405 >> v2:172.21.15.107:3300/0 conn(0x7f98180d30f0 0x7f98180b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 >> v1:172.21.15.107:6789/0 conn(0x7f98180b64c0 legacy=0x7f981806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981806cee0 con 0x7f981815e5f0 2024-09-16T01:55:17.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f9808001670 con 0x7f981815e5f0 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 >> v1:172.21.15.42:6789/0 conn(0x7f981815e5f0 legacy=0x7f98180d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000039b0 0x7f9800003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9800004800 0x7f9800004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000051c0 0x7f980000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f981806d530 con 0x7f98000039b0 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f980000c060 con 0x7f98000051c0 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f980000c260 con 0x7f9800004800 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f981cbe8640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000039b0 0x7f9800003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f981d3e9640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000051c0 0x7f980000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f9817fff640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9800004800 0x7f9800004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f981cbe8640 1 -- 172.21.15.42:0/2284887405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9800004800 msgr2=0x7f9800004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f981cbe8640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9800004800 0x7f9800004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f981cbe8640 1 -- 172.21.15.42:0/2284887405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000051c0 msgr2=0x7f980000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:17.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f981cbe8640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000051c0 0x7f980000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f981cbe8640 1 -- 172.21.15.42:0/2284887405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9800003520 con 0x7f98000039b0 2024-09-16T01:55:17.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f981d3e9640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000051c0 0x7f980000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:17.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.526+0000 7f981d3e9640 1 -- 172.21.15.42:0/2284887405 reap_dead start 2024-09-16T01:55:17.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.527+0000 7f981cbe8640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000039b0 0x7f9800003dd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f980800c210 tx=0x7f9800005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ade220eafbff71 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:17.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.527+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808007d30 con 0x7f98000039b0 2024-09-16T01:55:17.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.527+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9808005ad0 con 0x7f98000039b0 2024-09-16T01:55:17.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.527+0000 7f98177fe640 1 -- 172.21.15.42:0/2284887405 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808007070 con 0x7f98000039b0 2024-09-16T01:55:17.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.528+0000 7f981ee4c640 1 -- 172.21.15.42:0/2284887405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000039b0 msgr2=0x7f9800003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.528+0000 7f981ee4c640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000039b0 0x7f9800003dd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f980800c210 tx=0x7f9800005830 comp rx=0 tx=0).stop 2024-09-16T01:55:17.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.528+0000 7f981ee4c640 1 -- 172.21.15.42:0/2284887405 shutdown_connections 2024-09-16T01:55:17.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.528+0000 7f981ee4c640 1 --2- 172.21.15.42:0/2284887405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000039b0 0x7f9800003dd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.528+0000 7f981ee4c640 1 -- 172.21.15.42:0/2284887405 >> 172.21.15.42:0/2284887405 conn(0x7f981808bfc0 msgr2=0x7f98180d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:17.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.528+0000 7f981ee4c640 1 -- 172.21.15.42:0/2284887405 shutdown_connections 2024-09-16T01:55:17.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.528+0000 7f981ee4c640 1 -- 172.21.15.42:0/2284887405 wait complete. 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.529+0000 7f981ee4c640 1 Processor -- start 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.529+0000 7f981ee4c640 1 -- start start 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f981ee4c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000039b0 0x7f98180b7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f981ee4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98180cbe50 0x7f981815d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f981ee4c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f981815d9a0 0x7f981815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f981ee4c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f98180b5f80 con 0x7f98180cbe50 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f981ee4c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f981815e9d0 con 0x7f98000039b0 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f981ee4c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f98180b6100 con 0x7f981815d9a0 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f9817fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98180cbe50 0x7f981815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f9817fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98180cbe50 0x7f981815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36178/0 (socket says 172.21.15.42:36178) 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f9817fff640 1 -- 172.21.15.42:0/694040367 learned_addr learned my addr 172.21.15.42:0/694040367 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:17.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f981d3e9640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f981815d9a0 0x7f981815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f981cbe8640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000039b0 0x7f98180b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f9817fff640 1 -- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f981815d9a0 msgr2=0x7f981815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f9817fff640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f981815d9a0 0x7f981815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f9817fff640 1 -- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000039b0 msgr2=0x7f98180b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f9817fff640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000039b0 0x7f98180b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f9817fff640 1 -- 172.21.15.42:0/694040367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981815d130 con 0x7f98180cbe50 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f9817fff640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98180cbe50 0x7f981815d460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f980c011700 tx=0x7f980c011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.530+0000 7f98157fa640 1 -- 172.21.15.42:0/694040367 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c00f9c0 con 0x7f98180cbe50 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.531+0000 7f98157fa640 1 -- 172.21.15.42:0/694040367 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c00fb60 con 0x7f98180cbe50 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.531+0000 7f98157fa640 1 -- 172.21.15.42:0/694040367 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c015460 con 0x7f98180cbe50 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.531+0000 7f981ee4c640 1 -- 172.21.15.42:0/694040367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98180b7890 con 0x7f98180cbe50 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.531+0000 7f981ee4c640 1 -- 172.21.15.42:0/694040367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98180cc930 con 0x7f98180cbe50 2024-09-16T01:55:17.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.532+0000 7f981ee4c640 1 -- 172.21.15.42:0/694040367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98180d4dd0 con 0x7f98180cbe50 2024-09-16T01:55:17.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.532+0000 7f98157fa640 1 -- 172.21.15.42:0/694040367 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f980c015600 con 0x7f98180cbe50 2024-09-16T01:55:17.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.533+0000 7f98157fa640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f980406c2b0 0x7f980406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.533+0000 7f98157fa640 1 -- 172.21.15.42:0/694040367 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f980c08bde0 con 0x7f98180cbe50 2024-09-16T01:55:17.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.533+0000 7f981cbe8640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f980406c2b0 0x7f980406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.533+0000 7f981cbe8640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f980406c2b0 0x7f980406e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9808033000 tx=0x7f980802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:17.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.537+0000 7f98157fa640 1 -- 172.21.15.42:0/694040367 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f980c019030 con 0x7f98180cbe50 2024-09-16T01:55:17.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.713+0000 7f981ee4c640 1 -- 172.21.15.42:0/694040367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98180cffd0 con 0x7f98180cbe50 2024-09-16T01:55:17.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.714+0000 7f98157fa640 1 -- 172.21.15.42:0/694040367 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16990 (secure 0 0 0) 0x7f980c059cd0 con 0x7f98180cbe50 2024-09-16T01:55:17.716 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:17.716 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":38,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:16.056518+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:55:12.311183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-16T01:55:13.394907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:55:17.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.716+0000 7f981ee4c640 1 -- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f980406c2b0 msgr2=0x7f980406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.716+0000 7f981ee4c640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f980406c2b0 0x7f980406e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9808033000 tx=0x7f980802e000 comp rx=0 tx=0).stop 2024-09-16T01:55:17.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.716+0000 7f981ee4c640 1 -- 172.21.15.42:0/694040367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98180cbe50 msgr2=0x7f981815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.716+0000 7f981ee4c640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98180cbe50 0x7f981815d460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f980c011700 tx=0x7f980c011bc0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.717+0000 7f981ee4c640 1 -- 172.21.15.42:0/694040367 shutdown_connections 2024-09-16T01:55:17.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.717+0000 7f981ee4c640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f980406c2b0 0x7f980406e770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.717+0000 7f981ee4c640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f981815d9a0 0x7f981815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.717+0000 7f981ee4c640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98180cbe50 0x7f981815d460 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.717+0000 7f981ee4c640 1 --2- 172.21.15.42:0/694040367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000039b0 0x7f98180b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.717+0000 7f981ee4c640 1 -- 172.21.15.42:0/694040367 >> 172.21.15.42:0/694040367 conn(0x7f981808bfc0 msgr2=0x7f98180b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:17.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.717+0000 7f981ee4c640 1 -- 172.21.15.42:0/694040367 shutdown_connections 2024-09-16T01:55:17.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.717+0000 7f981ee4c640 1 -- 172.21.15.42:0/694040367 wait complete. 2024-09-16T01:55:17.730 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:55:17.730 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:55:17.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.831+0000 7fccd7423640 1 Processor -- start 2024-09-16T01:55:17.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.831+0000 7fccd7423640 1 -- start start 2024-09-16T01:55:17.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccd7423640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 0x7fccd006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccd7423640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccd00d2700 con 0x7fccd015e760 2024-09-16T01:55:17.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccd7423640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccd00cedb0 con 0x7fccd00cfcc0 2024-09-16T01:55:17.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccd7423640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fccd00cf090 con 0x7fccd00d4fd0 2024-09-16T01:55:17.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccd51bf640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fccd015e760 0x7fccd00cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53126/0 (socket says 172.21.15.42:53126) 2024-09-16T01:55:17.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccd51bf640 1 -- 172.21.15.42:0/4212658467 learned_addr learned my addr 172.21.15.42:0/4212658467 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:17.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccd59c0640 1 --2- 172.21.15.42:0/4212658467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 0x7fccd006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccc7fff640 1 -- 172.21.15.42:0/4212658467 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257302238 0 0) 0x7fcccc001110 con 0x7fccd015e760 2024-09-16T01:55:17.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccc7fff640 1 -- 172.21.15.42:0/4212658467 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccbc003520 con 0x7fccd015e760 2024-09-16T01:55:17.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccc7fff640 1 -- 172.21.15.42:0/4212658467 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620754814 0 0) 0x7fccd00cedb0 con 0x7fccd00cfcc0 2024-09-16T01:55:17.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccd59c0640 1 -- 172.21.15.42:0/4212658467 >> v1:172.21.15.107:6789/0 conn(0x7fccd00cfcc0 legacy=0x7fccd00d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.832+0000 7fccd59c0640 1 -- 172.21.15.42:0/4212658467 >> v1:172.21.15.42:6789/0 conn(0x7fccd015e760 legacy=0x7fccd00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.833+0000 7fccd59c0640 1 -- 172.21.15.42:0/4212658467 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd00b3c80 con 0x7fccd00d4fd0 2024-09-16T01:55:17.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.833+0000 7fccd59c0640 1 --2- 172.21.15.42:0/4212658467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 0x7fccd006cdd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009dc0 tx=0x7fccc802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77c9eb16f3ac7cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:17.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.833+0000 7fccc7fff640 1 -- 172.21.15.42:0/4212658467 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8007740 con 0x7fccd00d4fd0 2024-09-16T01:55:17.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.833+0000 7fccc7fff640 1 -- 172.21.15.42:0/4212658467 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc80078e0 con 0x7fccd00d4fd0 2024-09-16T01:55:17.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.833+0000 7fccc7fff640 1 -- 172.21.15.42:0/4212658467 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8007c90 con 0x7fccd00d4fd0 2024-09-16T01:55:17.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.834+0000 7fccd7423640 1 -- 172.21.15.42:0/4212658467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 msgr2=0x7fccd006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.834+0000 7fccd7423640 1 --2- 172.21.15.42:0/4212658467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 0x7fccd006cdd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009dc0 tx=0x7fccc802a6d0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.834+0000 7fccd7423640 1 -- 172.21.15.42:0/4212658467 shutdown_connections 2024-09-16T01:55:17.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.834+0000 7fccd7423640 1 --2- 172.21.15.42:0/4212658467 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 0x7fccd006cdd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.834+0000 7fccd7423640 1 -- 172.21.15.42:0/4212658467 >> 172.21.15.42:0/4212658467 conn(0x7fccd008bfc0 msgr2=0x7fccd00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:17.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.834+0000 7fccd7423640 1 -- 172.21.15.42:0/4212658467 shutdown_connections 2024-09-16T01:55:17.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.834+0000 7fccd7423640 1 -- 172.21.15.42:0/4212658467 wait complete. 2024-09-16T01:55:17.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.835+0000 7fccd7423640 1 Processor -- start 2024-09-16T01:55:17.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.835+0000 7fccd7423640 1 -- start start 2024-09-16T01:55:17.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd7423640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd00cfcc0 0x7fccd014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd7423640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 0x7fccd01502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd7423640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd015e760 0x7fccd0160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd7423640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fccd00d35b0 con 0x7fccd00cfcc0 2024-09-16T01:55:17.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd7423640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fccd00b3920 con 0x7fccd015e760 2024-09-16T01:55:17.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd7423640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fccd00d3730 con 0x7fccd00d4fd0 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd51bf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd00cfcc0 0x7fccd014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd51bf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd00cfcc0 0x7fccd014f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36190/0 (socket says 172.21.15.42:36190) 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd51bf640 1 -- 172.21.15.42:0/496856830 learned_addr learned my addr 172.21.15.42:0/496856830 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd59c0640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd015e760 0x7fccd0160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd49be640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 0x7fccd01502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.836+0000 7fccd51bf640 1 -- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 msgr2=0x7fccd01502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccd51bf640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 0x7fccd01502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccd51bf640 1 -- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd015e760 msgr2=0x7fccd0160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccd51bf640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd015e760 0x7fccd0160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccd51bf640 1 -- 172.21.15.42:0/496856830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd014fee0 con 0x7fccd00cfcc0 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccd59c0640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd015e760 0x7fccd0160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccd51bf640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd00cfcc0 0x7fccd014f9a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c3d0 tx=0x7fcccc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccc5ffb640 1 -- 172.21.15.42:0/496856830 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc017070 con 0x7fccd00cfcc0 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccc5ffb640 1 -- 172.21.15.42:0/496856830 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc005ce0 con 0x7fccd00cfcc0 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccc5ffb640 1 -- 172.21.15.42:0/496856830 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc007310 con 0x7fccd00cfcc0 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccd7423640 1 -- 172.21.15.42:0/496856830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd015efd0 con 0x7fccd00cfcc0 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.837+0000 7fccd7423640 1 -- 172.21.15.42:0/496856830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd015f590 con 0x7fccd00cfcc0 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.838+0000 7fccd7423640 1 -- 172.21.15.42:0/496856830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd0068e20 con 0x7fccd00cfcc0 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.839+0000 7fccc5ffb640 1 -- 172.21.15.42:0/496856830 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcccc01a070 con 0x7fccd00cfcc0 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.839+0000 7fccc5ffb640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fccb406c2b0 0x7fccb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.839+0000 7fccc5ffb640 1 -- 172.21.15.42:0/496856830 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fcccc08aa20 con 0x7fccd00cfcc0 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.839+0000 7fccd49be640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fccb406c2b0 0x7fccb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:17.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.840+0000 7fccd49be640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fccb406c2b0 0x7fccb406e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fccc0007fd0 tx=0x7fccc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:17.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:17.844+0000 7fccc5ffb640 1 -- 172.21.15.42:0/496856830 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccd014fee0 con 0x7fccd00cfcc0 2024-09-16T01:55:18.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.018+0000 7fccd7423640 1 -- 172.21.15.42:0/496856830 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fccd00b6d20 con 0x7fccb406c2b0 2024-09-16T01:55:18.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.024+0000 7fccc5ffb640 1 -- 172.21.15.42:0/496856830 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248449 (secure 0 0 0) 0x7fccd00b6d20 con 0x7fccb406c2b0 2024-09-16T01:55:18.028 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:18.030 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:55:18.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 -- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fccb406c2b0 msgr2=0x7fccb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fccb406c2b0 0x7fccb406e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fccc0007fd0 tx=0x7fccc0009040 comp rx=0 tx=0).stop 2024-09-16T01:55:18.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 -- 172.21.15.42:0/496856830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd00cfcc0 msgr2=0x7fccd014f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd00cfcc0 0x7fccd014f9a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c3d0 tx=0x7fcccc00c890 comp rx=0 tx=0).stop 2024-09-16T01:55:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 -- 172.21.15.42:0/496856830 shutdown_connections 2024-09-16T01:55:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fccb406c2b0 0x7fccb406e770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccd015e760 0x7fccd0160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fccd00d4fd0 0x7fccd01502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 --2- 172.21.15.42:0/496856830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd00cfcc0 0x7fccd014f9a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 -- 172.21.15.42:0/496856830 >> 172.21.15.42:0/496856830 conn(0x7fccd008bfc0 msgr2=0x7fccd00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 -- 172.21.15.42:0/496856830 shutdown_connections 2024-09-16T01:55:18.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.027+0000 7fccd7423640 1 -- 172.21.15.42:0/496856830 wait complete. 2024-09-16T01:55:18.040 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-16T01:55:16.261895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":237216,"kb_used_data":4332,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737504,"statfs":{"total":773094113280,"available":772851204096,"internally_reserved":0,"allocated":4435968,"data_stored":2548701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000715"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070192+0000","last_change":"2024-09-16T01:55:15.065385+0000","last_active":"2024-09-16T01:55:15.070192+0000","last_peered":"2024-09-16T01:55:15.070192+0000","last_clean":"2024-09-16T01:55:15.070192+0000","last_became_active":"2024-09-16T01:55:15.065095+0000","last_became_peered":"2024-09-16T01:55:15.065095+0000","last_unstale":"2024-09-16T01:55:15.070192+0000","last_undegraded":"2024-09-16T01:55:15.070192+0000","last_fullsized":"2024-09-16T01:55:15.070192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067753+0000","last_change":"2024-09-16T01:55:15.059749+0000","last_active":"2024-09-16T01:55:15.067753+0000","last_peered":"2024-09-16T01:55:15.067753+0000","last_clean":"2024-09-16T01:55:15.067753+0000","last_became_active":"2024-09-16T01:55:15.059458+0000","last_became_peered":"2024-09-16T01:55:15.059458+0000","last_unstale":"2024-09-16T01:55:15.067753+0000","last_undegraded":"2024-09-16T01:55:15.067753+0000","last_fullsized":"2024-09-16T01:55:15.067753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:26.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080246+0000","last_change":"2024-09-16T01:55:15.077805+0000","last_active":"2024-09-16T01:55:15.080246+0000","last_peered":"2024-09-16T01:55:15.080246+0000","last_clean":"2024-09-16T01:55:15.080246+0000","last_became_active":"2024-09-16T01:55:15.077485+0000","last_became_peered":"2024-09-16T01:55:15.077485+0000","last_unstale":"2024-09-16T01:55:15.080246+0000","last_undegraded":"2024-09-16T01:55:15.080246+0000","last_fullsized":"2024-09-16T01:55:15.080246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070564+0000","last_change":"2024-09-16T01:55:15.067284+0000","last_active":"2024-09-16T01:55:15.070564+0000","last_peered":"2024-09-16T01:55:15.070564+0000","last_clean":"2024-09-16T01:55:15.070564+0000","last_became_active":"2024-09-16T01:55:15.066918+0000","last_became_peered":"2024-09-16T01:55:15.066918+0000","last_unstale":"2024-09-16T01:55:15.070564+0000","last_undegraded":"2024-09-16T01:55:15.070564+0000","last_fullsized":"2024-09-16T01:55:15.070564+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.077947+0000","last_change":"2024-09-16T01:55:15.074589+0000","last_active":"2024-09-16T01:55:15.077947+0000","last_peered":"2024-09-16T01:55:15.077947+0000","last_clean":"2024-09-16T01:55:15.077947+0000","last_became_active":"2024-09-16T01:55:15.074341+0000","last_became_peered":"2024-09-16T01:55:15.074341+0000","last_unstale":"2024-09-16T01:55:15.077947+0000","last_undegraded":"2024-09-16T01:55:15.077947+0000","last_fullsized":"2024-09-16T01:55:15.077947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.571746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067783+0000","last_change":"2024-09-16T01:55:15.063121+0000","last_active":"2024-09-16T01:55:15.067783+0000","last_peered":"2024-09-16T01:55:15.067783+0000","last_clean":"2024-09-16T01:55:15.067783+0000","last_became_active":"2024-09-16T01:55:15.062819+0000","last_became_peered":"2024-09-16T01:55:15.062819+0000","last_unstale":"2024-09-16T01:55:15.067783+0000","last_undegraded":"2024-09-16T01:55:15.067783+0000","last_fullsized":"2024-09-16T01:55:15.067783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072493+0000","last_change":"2024-09-16T01:55:15.069367+0000","last_active":"2024-09-16T01:55:15.072493+0000","last_peered":"2024-09-16T01:55:15.072493+0000","last_clean":"2024-09-16T01:55:15.072493+0000","last_became_active":"2024-09-16T01:55:15.069079+0000","last_became_peered":"2024-09-16T01:55:15.069079+0000","last_unstale":"2024-09-16T01:55:15.072493+0000","last_undegraded":"2024-09-16T01:55:15.072493+0000","last_fullsized":"2024-09-16T01:55:15.072493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.079096+0000","last_change":"2024-09-16T01:55:15.071490+0000","last_active":"2024-09-16T01:55:15.079096+0000","last_peered":"2024-09-16T01:55:15.079096+0000","last_clean":"2024-09-16T01:55:15.079096+0000","last_became_active":"2024-09-16T01:55:15.071162+0000","last_became_peered":"2024-09-16T01:55:15.071162+0000","last_unstale":"2024-09-16T01:55:15.079096+0000","last_undegraded":"2024-09-16T01:55:15.079096+0000","last_fullsized":"2024-09-16T01:55:15.079096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076910+0000","last_change":"2024-09-16T01:55:15.067585+0000","last_active":"2024-09-16T01:55:15.076910+0000","last_peered":"2024-09-16T01:55:15.076910+0000","last_clean":"2024-09-16T01:55:15.076910+0000","last_became_active":"2024-09-16T01:55:15.067196+0000","last_became_peered":"2024-09-16T01:55:15.067196+0000","last_unstale":"2024-09-16T01:55:15.076910+0000","last_undegraded":"2024-09-16T01:55:15.076910+0000","last_fullsized":"2024-09-16T01:55:15.076910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.064986+0000","last_change":"2024-09-16T01:55:15.063667+0000","last_active":"2024-09-16T01:55:15.064986+0000","last_peered":"2024-09-16T01:55:15.064986+0000","last_clean":"2024-09-16T01:55:15.064986+0000","last_became_active":"2024-09-16T01:55:15.063380+0000","last_became_peered":"2024-09-16T01:55:15.063380+0000","last_unstale":"2024-09-16T01:55:15.064986+0000","last_undegraded":"2024-09-16T01:55:15.064986+0000","last_fullsized":"2024-09-16T01:55:15.064986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075948+0000","last_change":"2024-09-16T01:55:15.072130+0000","last_active":"2024-09-16T01:55:15.075948+0000","last_peered":"2024-09-16T01:55:15.075948+0000","last_clean":"2024-09-16T01:55:15.075948+0000","last_became_active":"2024-09-16T01:55:15.071860+0000","last_became_peered":"2024-09-16T01:55:15.071860+0000","last_unstale":"2024-09-16T01:55:15.075948+0000","last_undegraded":"2024-09-16T01:55:15.075948+0000","last_fullsized":"2024-09-16T01:55:15.075948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074051+0000","last_change":"2024-09-16T01:55:15.068911+0000","last_active":"2024-09-16T01:55:15.074051+0000","last_peered":"2024-09-16T01:55:15.074051+0000","last_clean":"2024-09-16T01:55:15.074051+0000","last_became_active":"2024-09-16T01:55:15.068623+0000","last_became_peered":"2024-09-16T01:55:15.068623+0000","last_unstale":"2024-09-16T01:55:15.074051+0000","last_undegraded":"2024-09-16T01:55:15.074051+0000","last_fullsized":"2024-09-16T01:55:15.074051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076431+0000","last_change":"2024-09-16T01:55:15.070772+0000","last_active":"2024-09-16T01:55:15.076431+0000","last_peered":"2024-09-16T01:55:15.076431+0000","last_clean":"2024-09-16T01:55:15.076431+0000","last_became_active":"2024-09-16T01:55:15.068031+0000","last_became_peered":"2024-09-16T01:55:15.068031+0000","last_unstale":"2024-09-16T01:55:15.076431+0000","last_undegraded":"2024-09-16T01:55:15.076431+0000","last_fullsized":"2024-09-16T01:55:15.076431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068039+0000","last_change":"2024-09-16T01:55:15.066271+0000","last_active":"2024-09-16T01:55:15.068039+0000","last_peered":"2024-09-16T01:55:15.068039+0000","last_clean":"2024-09-16T01:55:15.068039+0000","last_became_active":"2024-09-16T01:55:15.065908+0000","last_became_peered":"2024-09-16T01:55:15.065908+0000","last_unstale":"2024-09-16T01:55:15.068039+0000","last_undegraded":"2024-09-16T01:55:15.068039+0000","last_fullsized":"2024-09-16T01:55:15.068039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:42.161072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068075+0000","last_change":"2024-09-16T01:55:15.065314+0000","last_active":"2024-09-16T01:55:15.068075+0000","last_peered":"2024-09-16T01:55:15.068075+0000","last_clean":"2024-09-16T01:55:15.068075+0000","last_became_active":"2024-09-16T01:55:15.065037+0000","last_became_peered":"2024-09-16T01:55:15.065037+0000","last_unstale":"2024-09-16T01:55:15.068075+0000","last_undegraded":"2024-09-16T01:55:15.068075+0000","last_fullsized":"2024-09-16T01:55:15.068075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:09.030685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075927+0000","last_change":"2024-09-16T01:55:15.066813+0000","last_active":"2024-09-16T01:55:15.075927+0000","last_peered":"2024-09-16T01:55:15.075927+0000","last_clean":"2024-09-16T01:55:15.075927+0000","last_became_active":"2024-09-16T01:55:15.063973+0000","last_became_peered":"2024-09-16T01:55:15.063973+0000","last_unstale":"2024-09-16T01:55:15.075927+0000","last_undegraded":"2024-09-16T01:55:15.075927+0000","last_fullsized":"2024-09-16T01:55:15.075927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.073081+0000","last_change":"2024-09-16T01:55:15.065269+0000","last_active":"2024-09-16T01:55:15.073081+0000","last_peered":"2024-09-16T01:55:15.073081+0000","last_clean":"2024-09-16T01:55:15.073081+0000","last_became_active":"2024-09-16T01:55:15.064860+0000","last_became_peered":"2024-09-16T01:55:15.064860+0000","last_unstale":"2024-09-16T01:55:15.073081+0000","last_undegraded":"2024-09-16T01:55:15.073081+0000","last_fullsized":"2024-09-16T01:55:15.073081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068536+0000","last_change":"2024-09-16T01:55:15.066489+0000","last_active":"2024-09-16T01:55:15.068536+0000","last_peered":"2024-09-16T01:55:15.068536+0000","last_clean":"2024-09-16T01:55:15.068536+0000","last_became_active":"2024-09-16T01:55:15.066198+0000","last_became_peered":"2024-09-16T01:55:15.066198+0000","last_unstale":"2024-09-16T01:55:15.068536+0000","last_undegraded":"2024-09-16T01:55:15.068536+0000","last_fullsized":"2024-09-16T01:55:15.068536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:13.646813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.069980+0000","last_change":"2024-09-16T01:55:15.065514+0000","last_active":"2024-09-16T01:55:15.069980+0000","last_peered":"2024-09-16T01:55:15.069980+0000","last_clean":"2024-09-16T01:55:15.069980+0000","last_became_active":"2024-09-16T01:55:15.064716+0000","last_became_peered":"2024-09-16T01:55:15.064716+0000","last_unstale":"2024-09-16T01:55:15.069980+0000","last_undegraded":"2024-09-16T01:55:15.069980+0000","last_fullsized":"2024-09-16T01:55:15.069980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080171+0000","last_change":"2024-09-16T01:55:15.074757+0000","last_active":"2024-09-16T01:55:15.080171+0000","last_peered":"2024-09-16T01:55:15.080171+0000","last_clean":"2024-09-16T01:55:15.080171+0000","last_became_active":"2024-09-16T01:55:15.074465+0000","last_became_peered":"2024-09-16T01:55:15.074465+0000","last_unstale":"2024-09-16T01:55:15.080171+0000","last_undegraded":"2024-09-16T01:55:15.080171+0000","last_fullsized":"2024-09-16T01:55:15.080171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076161+0000","last_change":"2024-09-16T01:55:15.073726+0000","last_active":"2024-09-16T01:55:15.076161+0000","last_peered":"2024-09-16T01:55:15.076161+0000","last_clean":"2024-09-16T01:55:15.076161+0000","last_became_active":"2024-09-16T01:55:15.073453+0000","last_became_peered":"2024-09-16T01:55:15.073453+0000","last_unstale":"2024-09-16T01:55:15.076161+0000","last_undegraded":"2024-09-16T01:55:15.076161+0000","last_fullsized":"2024-09-16T01:55:15.076161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:22.978110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068277+0000","last_change":"2024-09-16T01:55:15.066587+0000","last_active":"2024-09-16T01:55:15.068277+0000","last_peered":"2024-09-16T01:55:15.068277+0000","last_clean":"2024-09-16T01:55:15.068277+0000","last_became_active":"2024-09-16T01:55:15.066292+0000","last_became_peered":"2024-09-16T01:55:15.066292+0000","last_unstale":"2024-09-16T01:55:15.068277+0000","last_undegraded":"2024-09-16T01:55:15.068277+0000","last_fullsized":"2024-09-16T01:55:15.068277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:27.843379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080063+0000","last_change":"2024-09-16T01:55:15.070192+0000","last_active":"2024-09-16T01:55:15.080063+0000","last_peered":"2024-09-16T01:55:15.080063+0000","last_clean":"2024-09-16T01:55:15.080063+0000","last_became_active":"2024-09-16T01:55:15.069764+0000","last_became_peered":"2024-09-16T01:55:15.069764+0000","last_unstale":"2024-09-16T01:55:15.080063+0000","last_undegraded":"2024-09-16T01:55:15.080063+0000","last_fullsized":"2024-09-16T01:55:15.080063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068967+0000","last_change":"2024-09-16T01:55:15.063260+0000","last_active":"2024-09-16T01:55:15.068967+0000","last_peered":"2024-09-16T01:55:15.068967+0000","last_clean":"2024-09-16T01:55:15.068967+0000","last_became_active":"2024-09-16T01:55:15.062964+0000","last_became_peered":"2024-09-16T01:55:15.062964+0000","last_unstale":"2024-09-16T01:55:15.068967+0000","last_undegraded":"2024-09-16T01:55:15.068967+0000","last_fullsized":"2024-09-16T01:55:15.068967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083596+0000","last_change":"2024-09-16T01:55:14.067402+0000","last_active":"2024-09-16T01:55:15.083596+0000","last_peered":"2024-09-16T01:55:15.083596+0000","last_clean":"2024-09-16T01:55:15.083596+0000","last_became_active":"2024-09-16T01:55:14.067117+0000","last_became_peered":"2024-09-16T01:55:14.067117+0000","last_unstale":"2024-09-16T01:55:15.083596+0000","last_undegraded":"2024-09-16T01:55:15.083596+0000","last_fullsized":"2024-09-16T01:55:15.083596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.523320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070015+0000","last_change":"2024-09-16T01:55:15.065086+0000","last_active":"2024-09-16T01:55:15.070015+0000","last_peered":"2024-09-16T01:55:15.070015+0000","last_clean":"2024-09-16T01:55:15.070015+0000","last_became_active":"2024-09-16T01:55:15.064785+0000","last_became_peered":"2024-09-16T01:55:15.064785+0000","last_unstale":"2024-09-16T01:55:15.070015+0000","last_undegraded":"2024-09-16T01:55:15.070015+0000","last_fullsized":"2024-09-16T01:55:15.070015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.084033+0000","last_change":"2024-09-16T01:55:14.068738+0000","last_active":"2024-09-16T01:55:15.084033+0000","last_peered":"2024-09-16T01:55:15.084033+0000","last_clean":"2024-09-16T01:55:15.084033+0000","last_became_active":"2024-09-16T01:55:14.068402+0000","last_became_peered":"2024-09-16T01:55:14.068402+0000","last_unstale":"2024-09-16T01:55:15.084033+0000","last_undegraded":"2024-09-16T01:55:15.084033+0000","last_fullsized":"2024-09-16T01:55:15.084033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:12.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074112+0000","last_change":"2024-09-16T01:55:15.068471+0000","last_active":"2024-09-16T01:55:15.074112+0000","last_peered":"2024-09-16T01:55:15.074112+0000","last_clean":"2024-09-16T01:55:15.074112+0000","last_became_active":"2024-09-16T01:55:15.067998+0000","last_became_peered":"2024-09-16T01:55:15.067998+0000","last_unstale":"2024-09-16T01:55:15.074112+0000","last_undegraded":"2024-09-16T01:55:15.074112+0000","last_fullsized":"2024-09-16T01:55:15.074112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083804+0000","last_change":"2024-09-16T01:55:14.068740+0000","last_active":"2024-09-16T01:55:15.083804+0000","last_peered":"2024-09-16T01:55:15.083804+0000","last_clean":"2024-09-16T01:55:15.083804+0000","last_became_active":"2024-09-16T01:55:14.068436+0000","last_became_peered":"2024-09-16T01:55:14.068436+0000","last_unstale":"2024-09-16T01:55:15.083804+0000","last_undegraded":"2024-09-16T01:55:15.083804+0000","last_fullsized":"2024-09-16T01:55:15.083804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074261+0000","last_change":"2024-09-16T01:55:15.073153+0000","last_active":"2024-09-16T01:55:15.074261+0000","last_peered":"2024-09-16T01:55:15.074261+0000","last_clean":"2024-09-16T01:55:15.074261+0000","last_became_active":"2024-09-16T01:55:15.072869+0000","last_became_peered":"2024-09-16T01:55:15.072869+0000","last_unstale":"2024-09-16T01:55:15.074261+0000","last_undegraded":"2024-09-16T01:55:15.074261+0000","last_fullsized":"2024-09-16T01:55:15.074261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:18.529028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083076+0000","last_change":"2024-09-16T01:55:14.064430+0000","last_active":"2024-09-16T01:55:15.083076+0000","last_peered":"2024-09-16T01:55:15.083076+0000","last_clean":"2024-09-16T01:55:15.083076+0000","last_became_active":"2024-09-16T01:55:14.064050+0000","last_became_peered":"2024-09-16T01:55:14.064050+0000","last_unstale":"2024-09-16T01:55:15.083076+0000","last_undegraded":"2024-09-16T01:55:15.083076+0000","last_fullsized":"2024-09-16T01:55:15.083076+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:08.025192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076149+0000","last_change":"2024-09-16T01:55:15.074074+0000","last_active":"2024-09-16T01:55:15.076149+0000","last_peered":"2024-09-16T01:55:15.076149+0000","last_clean":"2024-09-16T01:55:15.076149+0000","last_became_active":"2024-09-16T01:55:15.068752+0000","last_became_peered":"2024-09-16T01:55:15.068752+0000","last_unstale":"2024-09-16T01:55:15.076149+0000","last_undegraded":"2024-09-16T01:55:15.076149+0000","last_fullsized":"2024-09-16T01:55:15.076149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088009+0000","last_change":"2024-09-16T01:55:14.064060+0000","last_active":"2024-09-16T01:55:15.088009+0000","last_peered":"2024-09-16T01:55:15.088009+0000","last_clean":"2024-09-16T01:55:15.088009+0000","last_became_active":"2024-09-16T01:55:14.063169+0000","last_became_peered":"2024-09-16T01:55:14.063169+0000","last_unstale":"2024-09-16T01:55:15.088009+0000","last_undegraded":"2024-09-16T01:55:15.088009+0000","last_fullsized":"2024-09-16T01:55:15.088009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076409+0000","last_change":"2024-09-16T01:55:15.066922+0000","last_active":"2024-09-16T01:55:15.076409+0000","last_peered":"2024-09-16T01:55:15.076409+0000","last_clean":"2024-09-16T01:55:15.076409+0000","last_became_active":"2024-09-16T01:55:15.063924+0000","last_became_peered":"2024-09-16T01:55:15.063924+0000","last_unstale":"2024-09-16T01:55:15.076409+0000","last_undegraded":"2024-09-16T01:55:15.076409+0000","last_fullsized":"2024-09-16T01:55:15.076409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047981+0000","last_change":"2024-09-16T01:55:13.047981+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047981+0000","last_undegraded":"2024-09-16T01:55:13.047981+0000","last_fullsized":"2024-09-16T01:55:13.047981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.073105+0000","last_change":"2024-09-16T01:55:15.065460+0000","last_active":"2024-09-16T01:55:15.073105+0000","last_peered":"2024-09-16T01:55:15.073105+0000","last_clean":"2024-09-16T01:55:15.073105+0000","last_became_active":"2024-09-16T01:55:15.065203+0000","last_became_peered":"2024-09-16T01:55:15.065203+0000","last_unstale":"2024-09-16T01:55:15.073105+0000","last_undegraded":"2024-09-16T01:55:15.073105+0000","last_fullsized":"2024-09-16T01:55:15.073105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053078+0000","last_change":"2024-09-16T01:55:14.063567+0000","last_active":"2024-09-16T01:55:15.053078+0000","last_peered":"2024-09-16T01:55:15.053078+0000","last_clean":"2024-09-16T01:55:15.053078+0000","last_became_active":"2024-09-16T01:55:14.063264+0000","last_became_peered":"2024-09-16T01:55:14.063264+0000","last_unstale":"2024-09-16T01:55:15.053078+0000","last_undegraded":"2024-09-16T01:55:15.053078+0000","last_fullsized":"2024-09-16T01:55:15.053078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:12.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071322+0000","last_change":"2024-09-16T01:55:15.067811+0000","last_active":"2024-09-16T01:55:15.071322+0000","last_peered":"2024-09-16T01:55:15.071322+0000","last_clean":"2024-09-16T01:55:15.071322+0000","last_became_active":"2024-09-16T01:55:15.067505+0000","last_became_peered":"2024-09-16T01:55:15.067505+0000","last_unstale":"2024-09-16T01:55:15.071322+0000","last_undegraded":"2024-09-16T01:55:15.071322+0000","last_fullsized":"2024-09-16T01:55:15.071322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:33.406715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053269+0000","last_change":"2024-09-16T01:55:14.067645+0000","last_active":"2024-09-16T01:55:15.053269+0000","last_peered":"2024-09-16T01:55:15.053269+0000","last_clean":"2024-09-16T01:55:15.053269+0000","last_became_active":"2024-09-16T01:55:14.067386+0000","last_became_peered":"2024-09-16T01:55:14.067386+0000","last_unstale":"2024-09-16T01:55:15.053269+0000","last_undegraded":"2024-09-16T01:55:15.053269+0000","last_fullsized":"2024-09-16T01:55:15.053269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:19.662035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.057787+0000","last_change":"2024-09-16T01:55:14.057478+0000","last_active":"2024-09-16T01:55:15.057787+0000","last_peered":"2024-09-16T01:55:15.057787+0000","last_clean":"2024-09-16T01:55:15.057787+0000","last_became_active":"2024-09-16T01:55:14.057199+0000","last_became_peered":"2024-09-16T01:55:14.057199+0000","last_unstale":"2024-09-16T01:55:15.057787+0000","last_undegraded":"2024-09-16T01:55:15.057787+0000","last_fullsized":"2024-09-16T01:55:15.057787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:26.749150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.061100+0000","last_change":"2024-09-16T01:55:14.068900+0000","last_active":"2024-09-16T01:55:15.061100+0000","last_peered":"2024-09-16T01:55:15.061100+0000","last_clean":"2024-09-16T01:55:15.061100+0000","last_became_active":"2024-09-16T01:55:14.066896+0000","last_became_peered":"2024-09-16T01:55:14.066896+0000","last_unstale":"2024-09-16T01:55:15.061100+0000","last_undegraded":"2024-09-16T01:55:15.061100+0000","last_fullsized":"2024-09-16T01:55:15.061100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:38.976382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074610+0000","last_change":"2024-09-16T01:55:15.069993+0000","last_active":"2024-09-16T01:55:15.074610+0000","last_peered":"2024-09-16T01:55:15.074610+0000","last_clean":"2024-09-16T01:55:15.074610+0000","last_became_active":"2024-09-16T01:55:15.068922+0000","last_became_peered":"2024-09-16T01:55:15.068922+0000","last_unstale":"2024-09-16T01:55:15.074610+0000","last_undegraded":"2024-09-16T01:55:15.074610+0000","last_fullsized":"2024-09-16T01:55:15.074610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088255+0000","last_change":"2024-09-16T01:55:14.065656+0000","last_active":"2024-09-16T01:55:15.088255+0000","last_peered":"2024-09-16T01:55:15.088255+0000","last_clean":"2024-09-16T01:55:15.088255+0000","last_became_active":"2024-09-16T01:55:14.065390+0000","last_became_peered":"2024-09-16T01:55:14.065390+0000","last_unstale":"2024-09-16T01:55:15.088255+0000","last_undegraded":"2024-09-16T01:55:15.088255+0000","last_fullsized":"2024-09-16T01:55:15.088255+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:17.922515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067977+0000","last_change":"2024-09-16T01:55:15.061491+0000","last_active":"2024-09-16T01:55:15.067977+0000","last_peered":"2024-09-16T01:55:15.067977+0000","last_clean":"2024-09-16T01:55:15.067977+0000","last_became_active":"2024-09-16T01:55:15.060771+0000","last_became_peered":"2024-09-16T01:55:15.060771+0000","last_unstale":"2024-09-16T01:55:15.067977+0000","last_undegraded":"2024-09-16T01:55:15.067977+0000","last_fullsized":"2024-09-16T01:55:15.067977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:27.843379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.089771+0000","last_change":"2024-09-16T01:55:14.066984+0000","last_active":"2024-09-16T01:55:15.089771+0000","last_peered":"2024-09-16T01:55:15.089771+0000","last_clean":"2024-09-16T01:55:15.089771+0000","last_became_active":"2024-09-16T01:55:14.066574+0000","last_became_peered":"2024-09-16T01:55:14.066574+0000","last_unstale":"2024-09-16T01:55:15.089771+0000","last_undegraded":"2024-09-16T01:55:15.089771+0000","last_fullsized":"2024-09-16T01:55:15.089771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:16.713685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076819+0000","last_change":"2024-09-16T01:55:15.075252+0000","last_active":"2024-09-16T01:55:15.076819+0000","last_peered":"2024-09-16T01:55:15.076819+0000","last_clean":"2024-09-16T01:55:15.076819+0000","last_became_active":"2024-09-16T01:55:15.074981+0000","last_became_peered":"2024-09-16T01:55:15.074981+0000","last_unstale":"2024-09-16T01:55:15.076819+0000","last_undegraded":"2024-09-16T01:55:15.076819+0000","last_fullsized":"2024-09-16T01:55:15.076819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080750+0000","last_change":"2024-09-16T01:55:14.065205+0000","last_active":"2024-09-16T01:55:15.080750+0000","last_peered":"2024-09-16T01:55:15.080750+0000","last_clean":"2024-09-16T01:55:15.080750+0000","last_became_active":"2024-09-16T01:55:14.064867+0000","last_became_peered":"2024-09-16T01:55:14.064867+0000","last_unstale":"2024-09-16T01:55:15.080750+0000","last_undegraded":"2024-09-16T01:55:15.080750+0000","last_fullsized":"2024-09-16T01:55:15.080750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:40.415556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070269+0000","last_change":"2024-09-16T01:55:15.065359+0000","last_active":"2024-09-16T01:55:15.070269+0000","last_peered":"2024-09-16T01:55:15.070269+0000","last_clean":"2024-09-16T01:55:15.070269+0000","last_became_active":"2024-09-16T01:55:15.065061+0000","last_became_peered":"2024-09-16T01:55:15.065061+0000","last_unstale":"2024-09-16T01:55:15.070269+0000","last_undegraded":"2024-09-16T01:55:15.070269+0000","last_fullsized":"2024-09-16T01:55:15.070269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054606+0000","last_change":"2024-09-16T01:55:14.070545+0000","last_active":"2024-09-16T01:55:15.054606+0000","last_peered":"2024-09-16T01:55:15.054606+0000","last_clean":"2024-09-16T01:55:15.054606+0000","last_became_active":"2024-09-16T01:55:14.070303+0000","last_became_peered":"2024-09-16T01:55:14.070303+0000","last_unstale":"2024-09-16T01:55:15.054606+0000","last_undegraded":"2024-09-16T01:55:15.054606+0000","last_fullsized":"2024-09-16T01:55:15.054606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:38.976382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.056902+0000","last_change":"2024-09-16T01:55:14.067297+0000","last_active":"2024-09-16T01:55:15.056902+0000","last_peered":"2024-09-16T01:55:15.056902+0000","last_clean":"2024-09-16T01:55:15.056902+0000","last_became_active":"2024-09-16T01:55:14.066981+0000","last_became_peered":"2024-09-16T01:55:14.066981+0000","last_unstale":"2024-09-16T01:55:15.056902+0000","last_undegraded":"2024-09-16T01:55:15.056902+0000","last_fullsized":"2024-09-16T01:55:15.056902+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:17.010112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071281+0000","last_change":"2024-09-16T01:55:15.067563+0000","last_active":"2024-09-16T01:55:15.071281+0000","last_peered":"2024-09-16T01:55:15.071281+0000","last_clean":"2024-09-16T01:55:15.071281+0000","last_became_active":"2024-09-16T01:55:15.066882+0000","last_became_peered":"2024-09-16T01:55:15.066882+0000","last_unstale":"2024-09-16T01:55:15.071281+0000","last_undegraded":"2024-09-16T01:55:15.071281+0000","last_fullsized":"2024-09-16T01:55:15.071281+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:29.313718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047780+0000","last_change":"2024-09-16T01:55:13.047780+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047780+0000","last_undegraded":"2024-09-16T01:55:13.047780+0000","last_fullsized":"2024-09-16T01:55:13.047780+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071149+0000","last_change":"2024-09-16T01:55:15.069351+0000","last_active":"2024-09-16T01:55:15.071149+0000","last_peered":"2024-09-16T01:55:15.071149+0000","last_clean":"2024-09-16T01:55:15.071149+0000","last_became_active":"2024-09-16T01:55:15.068952+0000","last_became_peered":"2024-09-16T01:55:15.068952+0000","last_unstale":"2024-09-16T01:55:15.071149+0000","last_undegraded":"2024-09-16T01:55:15.071149+0000","last_fullsized":"2024-09-16T01:55:15.071149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:53:42.620283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088312+0000","last_change":"2024-09-16T01:55:14.068287+0000","last_active":"2024-09-16T01:55:15.088312+0000","last_peered":"2024-09-16T01:55:15.088312+0000","last_clean":"2024-09-16T01:55:15.088312+0000","last_became_active":"2024-09-16T01:55:14.066615+0000","last_became_peered":"2024-09-16T01:55:14.066615+0000","last_unstale":"2024-09-16T01:55:15.088312+0000","last_undegraded":"2024-09-16T01:55:15.088312+0000","last_fullsized":"2024-09-16T01:55:15.088312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:52.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076931+0000","last_change":"2024-09-16T01:55:15.071381+0000","last_active":"2024-09-16T01:55:15.076931+0000","last_peered":"2024-09-16T01:55:15.076931+0000","last_clean":"2024-09-16T01:55:15.076931+0000","last_became_active":"2024-09-16T01:55:15.071076+0000","last_became_peered":"2024-09-16T01:55:15.071076+0000","last_unstale":"2024-09-16T01:55:15.076931+0000","last_undegraded":"2024-09-16T01:55:15.076931+0000","last_fullsized":"2024-09-16T01:55:15.076931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088343+0000","last_change":"2024-09-16T01:55:14.070457+0000","last_active":"2024-09-16T01:55:15.088343+0000","last_peered":"2024-09-16T01:55:15.088343+0000","last_clean":"2024-09-16T01:55:15.088343+0000","last_became_active":"2024-09-16T01:55:14.070109+0000","last_became_peered":"2024-09-16T01:55:14.070109+0000","last_unstale":"2024-09-16T01:55:15.088343+0000","last_undegraded":"2024-09-16T01:55:15.088343+0000","last_fullsized":"2024-09-16T01:55:15.088343+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.523320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068014+0000","last_change":"2024-09-16T01:55:15.062497+0000","last_active":"2024-09-16T01:55:15.068014+0000","last_peered":"2024-09-16T01:55:15.068014+0000","last_clean":"2024-09-16T01:55:15.068014+0000","last_became_active":"2024-09-16T01:55:15.062232+0000","last_became_peered":"2024-09-16T01:55:15.062232+0000","last_unstale":"2024-09-16T01:55:15.068014+0000","last_undegraded":"2024-09-16T01:55:15.068014+0000","last_fullsized":"2024-09-16T01:55:15.068014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:13.034548+0000","last_change":"2024-09-16T01:55:13.034548+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.034548+0000","last_undegraded":"2024-09-16T01:55:13.034548+0000","last_fullsized":"2024-09-16T01:55:13.034548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054332+0000","last_change":"2024-09-16T01:55:14.064373+0000","last_active":"2024-09-16T01:55:15.054332+0000","last_peered":"2024-09-16T01:55:15.054332+0000","last_clean":"2024-09-16T01:55:15.054332+0000","last_became_active":"2024-09-16T01:55:14.064081+0000","last_became_peered":"2024-09-16T01:55:14.064081+0000","last_unstale":"2024-09-16T01:55:15.054332+0000","last_undegraded":"2024-09-16T01:55:15.054332+0000","last_fullsized":"2024-09-16T01:55:15.054332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:17.922515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:13.034548+0000","last_change":"2024-09-16T01:55:13.034548+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.034548+0000","last_undegraded":"2024-09-16T01:55:13.034548+0000","last_fullsized":"2024-09-16T01:55:13.034548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072354+0000","last_change":"2024-09-16T01:55:15.068101+0000","last_active":"2024-09-16T01:55:15.072354+0000","last_peered":"2024-09-16T01:55:15.072354+0000","last_clean":"2024-09-16T01:55:15.072354+0000","last_became_active":"2024-09-16T01:55:15.067812+0000","last_became_peered":"2024-09-16T01:55:15.067812+0000","last_unstale":"2024-09-16T01:55:15.072354+0000","last_undegraded":"2024-09-16T01:55:15.072354+0000","last_fullsized":"2024-09-16T01:55:15.072354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:13.034548+0000","last_change":"2024-09-16T01:55:13.034548+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.034548+0000","last_undegraded":"2024-09-16T01:55:13.034548+0000","last_fullsized":"2024-09-16T01:55:13.034548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075848+0000","last_change":"2024-09-16T01:55:15.071198+0000","last_active":"2024-09-16T01:55:15.075848+0000","last_peered":"2024-09-16T01:55:15.075848+0000","last_clean":"2024-09-16T01:55:15.075848+0000","last_became_active":"2024-09-16T01:55:15.070942+0000","last_became_peered":"2024-09-16T01:55:15.070942+0000","last_unstale":"2024-09-16T01:55:15.075848+0000","last_undegraded":"2024-09-16T01:55:15.075848+0000","last_fullsized":"2024-09-16T01:55:15.075848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:26.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.048045+0000","last_change":"2024-09-16T01:55:13.048045+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.048045+0000","last_undegraded":"2024-09-16T01:55:13.048045+0000","last_fullsized":"2024-09-16T01:55:13.048045+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071304+0000","last_change":"2024-09-16T01:55:15.067797+0000","last_active":"2024-09-16T01:55:15.071304+0000","last_peered":"2024-09-16T01:55:15.071304+0000","last_clean":"2024-09-16T01:55:15.071304+0000","last_became_active":"2024-09-16T01:55:15.067256+0000","last_became_peered":"2024-09-16T01:55:15.067256+0000","last_unstale":"2024-09-16T01:55:15.071304+0000","last_undegraded":"2024-09-16T01:55:15.071304+0000","last_fullsized":"2024-09-16T01:55:15.071304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.571746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:13.034548+0000","last_change":"2024-09-16T01:55:13.034548+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.034548+0000","last_undegraded":"2024-09-16T01:55:13.034548+0000","last_fullsized":"2024-09-16T01:55:13.034548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.078125+0000","last_change":"2024-09-16T01:55:15.072888+0000","last_active":"2024-09-16T01:55:15.078125+0000","last_peered":"2024-09-16T01:55:15.078125+0000","last_clean":"2024-09-16T01:55:15.078125+0000","last_became_active":"2024-09-16T01:55:15.072571+0000","last_became_peered":"2024-09-16T01:55:15.072571+0000","last_unstale":"2024-09-16T01:55:15.078125+0000","last_undegraded":"2024-09-16T01:55:15.078125+0000","last_fullsized":"2024-09-16T01:55:15.078125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088241+0000","last_change":"2024-09-16T01:55:14.066143+0000","last_active":"2024-09-16T01:55:15.088241+0000","last_peered":"2024-09-16T01:55:15.088241+0000","last_clean":"2024-09-16T01:55:15.088241+0000","last_became_active":"2024-09-16T01:55:14.065838+0000","last_became_peered":"2024-09-16T01:55:14.065838+0000","last_unstale":"2024-09-16T01:55:15.088241+0000","last_undegraded":"2024-09-16T01:55:15.088241+0000","last_fullsized":"2024-09-16T01:55:15.088241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:07.689683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:13.034548+0000","last_change":"2024-09-16T01:55:13.034548+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.034548+0000","last_undegraded":"2024-09-16T01:55:13.034548+0000","last_fullsized":"2024-09-16T01:55:13.034548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070227+0000","last_change":"2024-09-16T01:55:15.066052+0000","last_active":"2024-09-16T01:55:15.070227+0000","last_peered":"2024-09-16T01:55:15.070227+0000","last_clean":"2024-09-16T01:55:15.070227+0000","last_became_active":"2024-09-16T01:55:15.065771+0000","last_became_peered":"2024-09-16T01:55:15.065771+0000","last_unstale":"2024-09-16T01:55:15.070227+0000","last_undegraded":"2024-09-16T01:55:15.070227+0000","last_fullsized":"2024-09-16T01:55:15.070227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:22.978110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.059430+0000","last_change":"2024-09-16T01:55:14.064829+0000","last_active":"2024-09-16T01:55:15.059430+0000","last_peered":"2024-09-16T01:55:15.059430+0000","last_clean":"2024-09-16T01:55:15.059430+0000","last_became_active":"2024-09-16T01:55:14.064531+0000","last_became_peered":"2024-09-16T01:55:14.064531+0000","last_unstale":"2024-09-16T01:55:15.059430+0000","last_undegraded":"2024-09-16T01:55:15.059430+0000","last_fullsized":"2024-09-16T01:55:15.059430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:41.155579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076798+0000","last_change":"2024-09-16T01:55:15.074355+0000","last_active":"2024-09-16T01:55:15.076798+0000","last_peered":"2024-09-16T01:55:15.076798+0000","last_clean":"2024-09-16T01:55:15.076798+0000","last_became_active":"2024-09-16T01:55:15.071086+0000","last_became_peered":"2024-09-16T01:55:15.071086+0000","last_unstale":"2024-09-16T01:55:15.076798+0000","last_undegraded":"2024-09-16T01:55:15.076798+0000","last_fullsized":"2024-09-16T01:55:15.076798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.062153+0000","last_change":"2024-09-16T01:55:14.067246+0000","last_active":"2024-09-16T01:55:15.062153+0000","last_peered":"2024-09-16T01:55:15.062153+0000","last_clean":"2024-09-16T01:55:15.062153+0000","last_became_active":"2024-09-16T01:55:14.066819+0000","last_became_peered":"2024-09-16T01:55:14.066819+0000","last_unstale":"2024-09-16T01:55:15.062153+0000","last_undegraded":"2024-09-16T01:55:15.062153+0000","last_fullsized":"2024-09-16T01:55:15.062153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072435+0000","last_change":"2024-09-16T01:55:15.069885+0000","last_active":"2024-09-16T01:55:15.072435+0000","last_peered":"2024-09-16T01:55:15.072435+0000","last_clean":"2024-09-16T01:55:15.072435+0000","last_became_active":"2024-09-16T01:55:15.068666+0000","last_became_peered":"2024-09-16T01:55:15.068666+0000","last_unstale":"2024-09-16T01:55:15.072435+0000","last_undegraded":"2024-09-16T01:55:15.072435+0000","last_fullsized":"2024-09-16T01:55:15.072435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.059227+0000","last_change":"2024-09-16T01:55:14.064031+0000","last_active":"2024-09-16T01:55:15.059227+0000","last_peered":"2024-09-16T01:55:15.059227+0000","last_clean":"2024-09-16T01:55:15.059227+0000","last_became_active":"2024-09-16T01:55:14.063686+0000","last_became_peered":"2024-09-16T01:55:14.063686+0000","last_unstale":"2024-09-16T01:55:15.059227+0000","last_undegraded":"2024-09-16T01:55:15.059227+0000","last_fullsized":"2024-09-16T01:55:15.059227+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:19.662035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.062236+0000","last_change":"2024-09-16T01:55:15.058905+0000","last_active":"2024-09-16T01:55:15.062236+0000","last_peered":"2024-09-16T01:55:15.062236+0000","last_clean":"2024-09-16T01:55:15.062236+0000","last_became_active":"2024-09-16T01:55:15.058632+0000","last_became_peered":"2024-09-16T01:55:15.058632+0000","last_unstale":"2024-09-16T01:55:15.062236+0000","last_undegraded":"2024-09-16T01:55:15.062236+0000","last_fullsized":"2024-09-16T01:55:15.062236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:13.646813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053762+0000","last_change":"2024-09-16T01:55:14.064739+0000","last_active":"2024-09-16T01:55:15.053762+0000","last_peered":"2024-09-16T01:55:15.053762+0000","last_clean":"2024-09-16T01:55:15.053762+0000","last_became_active":"2024-09-16T01:55:14.064446+0000","last_became_peered":"2024-09-16T01:55:14.064446+0000","last_unstale":"2024-09-16T01:55:15.053762+0000","last_undegraded":"2024-09-16T01:55:15.053762+0000","last_fullsized":"2024-09-16T01:55:15.053762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:41.155579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054832+0000","last_change":"2024-09-16T01:55:14.057198+0000","last_active":"2024-09-16T01:55:15.054832+0000","last_peered":"2024-09-16T01:55:15.054832+0000","last_clean":"2024-09-16T01:55:15.054832+0000","last_became_active":"2024-09-16T01:55:14.056723+0000","last_became_peered":"2024-09-16T01:55:14.056723+0000","last_unstale":"2024-09-16T01:55:15.054832+0000","last_undegraded":"2024-09-16T01:55:15.054832+0000","last_fullsized":"2024-09-16T01:55:15.054832+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:53.464988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076035+0000","last_change":"2024-09-16T01:55:15.074182+0000","last_active":"2024-09-16T01:55:15.076035+0000","last_peered":"2024-09-16T01:55:15.076035+0000","last_clean":"2024-09-16T01:55:15.076035+0000","last_became_active":"2024-09-16T01:55:15.073915+0000","last_became_peered":"2024-09-16T01:55:15.073915+0000","last_unstale":"2024-09-16T01:55:15.076035+0000","last_undegraded":"2024-09-16T01:55:15.076035+0000","last_fullsized":"2024-09-16T01:55:15.076035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:29.313718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047989+0000","last_change":"2024-09-16T01:55:13.047989+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047989+0000","last_undegraded":"2024-09-16T01:55:13.047989+0000","last_fullsized":"2024-09-16T01:55:13.047989+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T01:55:13.048552+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:55:13.048552+0000","last_peered":"2024-09-16T01:55:13.048552+0000","last_clean":"2024-09-16T01:55:13.048552+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:55:13.048552+0000","last_undegraded":"2024-09-16T01:55:13.048552+0000","last_fullsized":"2024-09-16T01:55:13.048552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":434176,"data_stored":180254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":178608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":761809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":755142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31560,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":380928,"data_stored":158565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:55:18.044 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:55:18.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.180+0000 7f556b49b640 1 Processor -- start 2024-09-16T01:55:18.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.180+0000 7f556b49b640 1 -- start start 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.181+0000 7f556b49b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564161c80 0x7f556406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.181+0000 7f556b49b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556406e870 con 0x7f55640b6680 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.181+0000 7f556b49b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556406d9f0 con 0x7f5564162060 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.181+0000 7f556b49b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f556406dcd0 con 0x7f5564161c80 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.181+0000 7f5569a38640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f55640b6680 0x7f55640cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59706/0 (socket says 172.21.15.42:59706) 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.181+0000 7f5569a38640 1 -- 172.21.15.42:0/2095520327 learned_addr learned my addr 172.21.15.42:0/2095520327 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f5569237640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564161c80 0x7f556406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3152943800 0 0) 0x7f555c001110 con 0x7f55640b6680 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5550003520 con 0x7f55640b6680 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721473347 0 0) 0x7f556406d9f0 con 0x7f5564162060 2024-09-16T01:55:18.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f555c001110 con 0x7f5564162060 2024-09-16T01:55:18.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2629327348 0 0) 0x7f5550003520 con 0x7f55640b6680 2024-09-16T01:55:18.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564161c80 msgr2=0x7f556406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:18.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564161c80 0x7f556406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 >> v1:172.21.15.107:6789/0 conn(0x7f5564162060 legacy=0x7f55640b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556406dfb0 con 0x7f55640b6680 2024-09-16T01:55:18.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f555c001840 con 0x7f55640b6680 2024-09-16T01:55:18.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 >> v1:172.21.15.42:6789/0 conn(0x7f55640b6680 legacy=0x7f55640cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 0x7f5550003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564161c80 0x7f5550004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5550004d40 0x7f55500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f556406dcd0 con 0x7f5550003b70 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f555000ba70 con 0x7f5550004d40 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f555000bc20 con 0x7f5564161c80 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f5569237640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 0x7f5550003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f5568a36640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564161c80 0x7f5550004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f5569a38640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5550004d40 0x7f55500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f5569237640 1 -- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564161c80 msgr2=0x7f5550004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f5569237640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564161c80 0x7f5550004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f5569237640 1 -- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5550004d40 msgr2=0x7f55500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f5569237640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5550004d40 0x7f55500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f5569237640 1 -- 172.21.15.42:0/2095520327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5550003520 con 0x7f5550003b70 2024-09-16T01:55:18.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.182+0000 7f5569a38640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5550004d40 0x7f55500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:18.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.183+0000 7f5569237640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 0x7f5550003f70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5560009fc0 tx=0x7f5550005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddafe5711766733 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:18.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.183+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560009c10 con 0x7f5550003b70 2024-09-16T01:55:18.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.183+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5560036070 con 0x7f5550003b70 2024-09-16T01:55:18.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.183+0000 7f555bfff640 1 -- 172.21.15.42:0/2095520327 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560031880 con 0x7f5550003b70 2024-09-16T01:55:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.184+0000 7f556b49b640 1 -- 172.21.15.42:0/2095520327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 msgr2=0x7f5550003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.184+0000 7f556b49b640 1 --2- 172.21.15.42:0/2095520327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 0x7f5550003f70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5560009fc0 tx=0x7f5550005830 comp rx=0 tx=0).stop 2024-09-16T01:55:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.184+0000 7f5569a38640 1 -- 172.21.15.42:0/2095520327 reap_dead start 2024-09-16T01:55:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.184+0000 7f556b49b640 1 -- 172.21.15.42:0/2095520327 shutdown_connections 2024-09-16T01:55:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.184+0000 7f556b49b640 1 -- 172.21.15.42:0/2095520327 >> 172.21.15.42:0/2095520327 conn(0x7f55640d44f0 msgr2=0x7f55640d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.184+0000 7f556b49b640 1 -- 172.21.15.42:0/2095520327 shutdown_connections 2024-09-16T01:55:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.184+0000 7f556b49b640 1 -- 172.21.15.42:0/2095520327 wait complete. 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.185+0000 7f556b49b640 1 Processor -- start 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.185+0000 7f556b49b640 1 -- start start 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f556b49b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 0x7f55640b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f556b49b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55641558b0 0x7f5564154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f556b49b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564155360 0x7f5564154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f556b49b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55640b6cb0 con 0x7f5550003b70 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f556b49b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f55640b6b30 con 0x7f55641558b0 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f556b49b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f556406e330 con 0x7f5564155360 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f5569237640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 0x7f55640b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f5569237640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 0x7f55640b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47972/0 (socket says 172.21.15.42:47972) 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f5569237640 1 -- 172.21.15.42:0/1105946687 learned_addr learned my addr 172.21.15.42:0/1105946687 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f5569a38640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564155360 0x7f5564154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f5568a36640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55641558b0 0x7f5564154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f5569237640 1 -- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564155360 msgr2=0x7f5564154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f5569237640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564155360 0x7f5564154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f5569237640 1 -- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55641558b0 msgr2=0x7f5564154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f5569237640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55641558b0 0x7f5564154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.186+0000 7f5569237640 1 -- 172.21.15.42:0/1105946687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55640b7930 con 0x7f5550003b70 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.187+0000 7f5569237640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 0x7f55640b2320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f556000e230 tx=0x7f5560009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.187+0000 7f5559ffb640 1 -- 172.21.15.42:0/1105946687 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560009c10 con 0x7f5550003b70 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.187+0000 7f5559ffb640 1 -- 172.21.15.42:0/1105946687 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5560003990 con 0x7f5550003b70 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.187+0000 7f556b49b640 1 -- 172.21.15.42:0/1105946687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55640b7c10 con 0x7f5550003b70 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.187+0000 7f5559ffb640 1 -- 172.21.15.42:0/1105946687 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560003d60 con 0x7f5550003b70 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.187+0000 7f556b49b640 1 -- 172.21.15.42:0/1105946687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55640b81d0 con 0x7f5550003b70 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.188+0000 7f556b49b640 1 -- 172.21.15.42:0/1105946687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55640ba470 con 0x7f5550003b70 2024-09-16T01:55:18.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.188+0000 7f5559ffb640 1 -- 172.21.15.42:0/1105946687 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5560005d10 con 0x7f5550003b70 2024-09-16T01:55:18.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.189+0000 7f5559ffb640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f554806c2e0 0x7f554806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.189+0000 7f5559ffb640 1 -- 172.21.15.42:0/1105946687 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f55600ac8e0 con 0x7f5550003b70 2024-09-16T01:55:18.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.189+0000 7f5568a36640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f554806c2e0 0x7f554806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.190+0000 7f5568a36640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f554806c2e0 0x7f554806e7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f55640cae80 tx=0x7f5554009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:18.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.193+0000 7f5559ffb640 1 -- 172.21.15.42:0/1105946687 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f556007aeb0 con 0x7f5550003b70 2024-09-16T01:55:18.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.365+0000 7f556b49b640 1 -- 172.21.15.42:0/1105946687 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55640cfe70 con 0x7f554806c2e0 2024-09-16T01:55:18.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.372+0000 7f5559ffb640 1 -- 172.21.15.42:0/1105946687 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250188 (secure 0 0 0) 0x7f55640cfe70 con 0x7f554806c2e0 2024-09-16T01:55:18.376 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:18.377 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.375+0000 7f556b49b640 1 -- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f554806c2e0 msgr2=0x7f554806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.375+0000 7f556b49b640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f554806c2e0 0x7f554806e7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f55640cae80 tx=0x7f5554009040 comp rx=0 tx=0).stop 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.375+0000 7f556b49b640 1 -- 172.21.15.42:0/1105946687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 msgr2=0x7f55640b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.375+0000 7f556b49b640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 0x7f55640b2320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f556000e230 tx=0x7f5560009750 comp rx=0 tx=0).stop 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.376+0000 7f556b49b640 1 -- 172.21.15.42:0/1105946687 shutdown_connections 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.376+0000 7f556b49b640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f554806c2e0 0x7f554806e7a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.376+0000 7f556b49b640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5564155360 0x7f5564154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.376+0000 7f556b49b640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f55641558b0 0x7f5564154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.376+0000 7f556b49b640 1 --2- 172.21.15.42:0/1105946687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5550003b70 0x7f55640b2320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.376+0000 7f556b49b640 1 -- 172.21.15.42:0/1105946687 >> 172.21.15.42:0/1105946687 conn(0x7f55640d44f0 msgr2=0x7f55640cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:18.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.376+0000 7f556b49b640 1 -- 172.21.15.42:0/1105946687 shutdown_connections 2024-09-16T01:55:18.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.376+0000 7f556b49b640 1 -- 172.21.15.42:0/1105946687 wait complete. 2024-09-16T01:55:18.387 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-16T01:55:18.262289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237276,"kb_used_data":4384,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737444,"statfs":{"total":773094113280,"available":772851142656,"internally_reserved":0,"allocated":4489216,"data_stored":2575506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.222058"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070192+0000","last_change":"2024-09-16T01:55:15.065385+0000","last_active":"2024-09-16T01:55:15.070192+0000","last_peered":"2024-09-16T01:55:15.070192+0000","last_clean":"2024-09-16T01:55:15.070192+0000","last_became_active":"2024-09-16T01:55:15.065095+0000","last_became_peered":"2024-09-16T01:55:15.065095+0000","last_unstale":"2024-09-16T01:55:15.070192+0000","last_undegraded":"2024-09-16T01:55:15.070192+0000","last_fullsized":"2024-09-16T01:55:15.070192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067753+0000","last_change":"2024-09-16T01:55:15.059749+0000","last_active":"2024-09-16T01:55:15.067753+0000","last_peered":"2024-09-16T01:55:15.067753+0000","last_clean":"2024-09-16T01:55:15.067753+0000","last_became_active":"2024-09-16T01:55:15.059458+0000","last_became_peered":"2024-09-16T01:55:15.059458+0000","last_unstale":"2024-09-16T01:55:15.067753+0000","last_undegraded":"2024-09-16T01:55:15.067753+0000","last_fullsized":"2024-09-16T01:55:15.067753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:26.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080246+0000","last_change":"2024-09-16T01:55:15.077805+0000","last_active":"2024-09-16T01:55:15.080246+0000","last_peered":"2024-09-16T01:55:15.080246+0000","last_clean":"2024-09-16T01:55:15.080246+0000","last_became_active":"2024-09-16T01:55:15.077485+0000","last_became_peered":"2024-09-16T01:55:15.077485+0000","last_unstale":"2024-09-16T01:55:15.080246+0000","last_undegraded":"2024-09-16T01:55:15.080246+0000","last_fullsized":"2024-09-16T01:55:15.080246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063287+0000","last_change":"2024-09-16T01:55:15.058881+0000","last_active":"2024-09-16T01:55:16.063287+0000","last_peered":"2024-09-16T01:55:16.063287+0000","last_clean":"2024-09-16T01:55:16.063287+0000","last_became_active":"2024-09-16T01:55:15.058341+0000","last_became_peered":"2024-09-16T01:55:15.058341+0000","last_unstale":"2024-09-16T01:55:16.063287+0000","last_undegraded":"2024-09-16T01:55:16.063287+0000","last_fullsized":"2024-09-16T01:55:16.063287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:05.641631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063089+0000","last_change":"2024-09-16T01:55:15.059514+0000","last_active":"2024-09-16T01:55:16.063089+0000","last_peered":"2024-09-16T01:55:16.063089+0000","last_clean":"2024-09-16T01:55:16.063089+0000","last_became_active":"2024-09-16T01:55:15.059148+0000","last_became_peered":"2024-09-16T01:55:15.059148+0000","last_unstale":"2024-09-16T01:55:16.063089+0000","last_undegraded":"2024-09-16T01:55:16.063089+0000","last_fullsized":"2024-09-16T01:55:16.063089+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:43.845985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070564+0000","last_change":"2024-09-16T01:55:15.067284+0000","last_active":"2024-09-16T01:55:15.070564+0000","last_peered":"2024-09-16T01:55:15.070564+0000","last_clean":"2024-09-16T01:55:15.070564+0000","last_became_active":"2024-09-16T01:55:15.066918+0000","last_became_peered":"2024-09-16T01:55:15.066918+0000","last_unstale":"2024-09-16T01:55:15.070564+0000","last_undegraded":"2024-09-16T01:55:15.070564+0000","last_fullsized":"2024-09-16T01:55:15.070564+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.077947+0000","last_change":"2024-09-16T01:55:15.074589+0000","last_active":"2024-09-16T01:55:15.077947+0000","last_peered":"2024-09-16T01:55:15.077947+0000","last_clean":"2024-09-16T01:55:15.077947+0000","last_became_active":"2024-09-16T01:55:15.074341+0000","last_became_peered":"2024-09-16T01:55:15.074341+0000","last_unstale":"2024-09-16T01:55:15.077947+0000","last_undegraded":"2024-09-16T01:55:15.077947+0000","last_fullsized":"2024-09-16T01:55:15.077947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.571746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067783+0000","last_change":"2024-09-16T01:55:15.063121+0000","last_active":"2024-09-16T01:55:15.067783+0000","last_peered":"2024-09-16T01:55:15.067783+0000","last_clean":"2024-09-16T01:55:15.067783+0000","last_became_active":"2024-09-16T01:55:15.062819+0000","last_became_peered":"2024-09-16T01:55:15.062819+0000","last_unstale":"2024-09-16T01:55:15.067783+0000","last_undegraded":"2024-09-16T01:55:15.067783+0000","last_fullsized":"2024-09-16T01:55:15.067783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072493+0000","last_change":"2024-09-16T01:55:15.069367+0000","last_active":"2024-09-16T01:55:15.072493+0000","last_peered":"2024-09-16T01:55:15.072493+0000","last_clean":"2024-09-16T01:55:15.072493+0000","last_became_active":"2024-09-16T01:55:15.069079+0000","last_became_peered":"2024-09-16T01:55:15.069079+0000","last_unstale":"2024-09-16T01:55:15.072493+0000","last_undegraded":"2024-09-16T01:55:15.072493+0000","last_fullsized":"2024-09-16T01:55:15.072493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.079096+0000","last_change":"2024-09-16T01:55:15.071490+0000","last_active":"2024-09-16T01:55:15.079096+0000","last_peered":"2024-09-16T01:55:15.079096+0000","last_clean":"2024-09-16T01:55:15.079096+0000","last_became_active":"2024-09-16T01:55:15.071162+0000","last_became_peered":"2024-09-16T01:55:15.071162+0000","last_unstale":"2024-09-16T01:55:15.079096+0000","last_undegraded":"2024-09-16T01:55:15.079096+0000","last_fullsized":"2024-09-16T01:55:15.079096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076910+0000","last_change":"2024-09-16T01:55:15.067585+0000","last_active":"2024-09-16T01:55:15.076910+0000","last_peered":"2024-09-16T01:55:15.076910+0000","last_clean":"2024-09-16T01:55:15.076910+0000","last_became_active":"2024-09-16T01:55:15.067196+0000","last_became_peered":"2024-09-16T01:55:15.067196+0000","last_unstale":"2024-09-16T01:55:15.076910+0000","last_undegraded":"2024-09-16T01:55:15.076910+0000","last_fullsized":"2024-09-16T01:55:15.076910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.064986+0000","last_change":"2024-09-16T01:55:15.063667+0000","last_active":"2024-09-16T01:55:15.064986+0000","last_peered":"2024-09-16T01:55:15.064986+0000","last_clean":"2024-09-16T01:55:15.064986+0000","last_became_active":"2024-09-16T01:55:15.063380+0000","last_became_peered":"2024-09-16T01:55:15.063380+0000","last_unstale":"2024-09-16T01:55:15.064986+0000","last_undegraded":"2024-09-16T01:55:15.064986+0000","last_fullsized":"2024-09-16T01:55:15.064986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075948+0000","last_change":"2024-09-16T01:55:15.072130+0000","last_active":"2024-09-16T01:55:15.075948+0000","last_peered":"2024-09-16T01:55:15.075948+0000","last_clean":"2024-09-16T01:55:15.075948+0000","last_became_active":"2024-09-16T01:55:15.071860+0000","last_became_peered":"2024-09-16T01:55:15.071860+0000","last_unstale":"2024-09-16T01:55:15.075948+0000","last_undegraded":"2024-09-16T01:55:15.075948+0000","last_fullsized":"2024-09-16T01:55:15.075948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074051+0000","last_change":"2024-09-16T01:55:15.068911+0000","last_active":"2024-09-16T01:55:15.074051+0000","last_peered":"2024-09-16T01:55:15.074051+0000","last_clean":"2024-09-16T01:55:15.074051+0000","last_became_active":"2024-09-16T01:55:15.068623+0000","last_became_peered":"2024-09-16T01:55:15.068623+0000","last_unstale":"2024-09-16T01:55:15.074051+0000","last_undegraded":"2024-09-16T01:55:15.074051+0000","last_fullsized":"2024-09-16T01:55:15.074051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076431+0000","last_change":"2024-09-16T01:55:15.070772+0000","last_active":"2024-09-16T01:55:15.076431+0000","last_peered":"2024-09-16T01:55:15.076431+0000","last_clean":"2024-09-16T01:55:15.076431+0000","last_became_active":"2024-09-16T01:55:15.068031+0000","last_became_peered":"2024-09-16T01:55:15.068031+0000","last_unstale":"2024-09-16T01:55:15.076431+0000","last_undegraded":"2024-09-16T01:55:15.076431+0000","last_fullsized":"2024-09-16T01:55:15.076431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068039+0000","last_change":"2024-09-16T01:55:15.066271+0000","last_active":"2024-09-16T01:55:15.068039+0000","last_peered":"2024-09-16T01:55:15.068039+0000","last_clean":"2024-09-16T01:55:15.068039+0000","last_became_active":"2024-09-16T01:55:15.065908+0000","last_became_peered":"2024-09-16T01:55:15.065908+0000","last_unstale":"2024-09-16T01:55:15.068039+0000","last_undegraded":"2024-09-16T01:55:15.068039+0000","last_fullsized":"2024-09-16T01:55:15.068039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:42.161072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063171+0000","last_change":"2024-09-16T01:55:15.065208+0000","last_active":"2024-09-16T01:55:16.063171+0000","last_peered":"2024-09-16T01:55:16.063171+0000","last_clean":"2024-09-16T01:55:16.063171+0000","last_became_active":"2024-09-16T01:55:15.062657+0000","last_became_peered":"2024-09-16T01:55:15.062657+0000","last_unstale":"2024-09-16T01:55:16.063171+0000","last_undegraded":"2024-09-16T01:55:16.063171+0000","last_fullsized":"2024-09-16T01:55:16.063171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:53.907841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068075+0000","last_change":"2024-09-16T01:55:15.065314+0000","last_active":"2024-09-16T01:55:15.068075+0000","last_peered":"2024-09-16T01:55:15.068075+0000","last_clean":"2024-09-16T01:55:15.068075+0000","last_became_active":"2024-09-16T01:55:15.065037+0000","last_became_peered":"2024-09-16T01:55:15.065037+0000","last_unstale":"2024-09-16T01:55:15.068075+0000","last_undegraded":"2024-09-16T01:55:15.068075+0000","last_fullsized":"2024-09-16T01:55:15.068075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:09.030685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075927+0000","last_change":"2024-09-16T01:55:15.066813+0000","last_active":"2024-09-16T01:55:15.075927+0000","last_peered":"2024-09-16T01:55:15.075927+0000","last_clean":"2024-09-16T01:55:15.075927+0000","last_became_active":"2024-09-16T01:55:15.063973+0000","last_became_peered":"2024-09-16T01:55:15.063973+0000","last_unstale":"2024-09-16T01:55:15.075927+0000","last_undegraded":"2024-09-16T01:55:15.075927+0000","last_fullsized":"2024-09-16T01:55:15.075927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.073081+0000","last_change":"2024-09-16T01:55:15.065269+0000","last_active":"2024-09-16T01:55:15.073081+0000","last_peered":"2024-09-16T01:55:15.073081+0000","last_clean":"2024-09-16T01:55:15.073081+0000","last_became_active":"2024-09-16T01:55:15.064860+0000","last_became_peered":"2024-09-16T01:55:15.064860+0000","last_unstale":"2024-09-16T01:55:15.073081+0000","last_undegraded":"2024-09-16T01:55:15.073081+0000","last_fullsized":"2024-09-16T01:55:15.073081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.062949+0000","last_change":"2024-09-16T01:55:15.071896+0000","last_active":"2024-09-16T01:55:16.062949+0000","last_peered":"2024-09-16T01:55:16.062949+0000","last_clean":"2024-09-16T01:55:16.062949+0000","last_became_active":"2024-09-16T01:55:15.071607+0000","last_became_peered":"2024-09-16T01:55:15.071607+0000","last_unstale":"2024-09-16T01:55:16.062949+0000","last_undegraded":"2024-09-16T01:55:16.062949+0000","last_fullsized":"2024-09-16T01:55:16.062949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:21.925734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068536+0000","last_change":"2024-09-16T01:55:15.066489+0000","last_active":"2024-09-16T01:55:15.068536+0000","last_peered":"2024-09-16T01:55:15.068536+0000","last_clean":"2024-09-16T01:55:15.068536+0000","last_became_active":"2024-09-16T01:55:15.066198+0000","last_became_peered":"2024-09-16T01:55:15.066198+0000","last_unstale":"2024-09-16T01:55:15.068536+0000","last_undegraded":"2024-09-16T01:55:15.068536+0000","last_fullsized":"2024-09-16T01:55:15.068536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:13.646813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.069980+0000","last_change":"2024-09-16T01:55:15.065514+0000","last_active":"2024-09-16T01:55:15.069980+0000","last_peered":"2024-09-16T01:55:15.069980+0000","last_clean":"2024-09-16T01:55:15.069980+0000","last_became_active":"2024-09-16T01:55:15.064716+0000","last_became_peered":"2024-09-16T01:55:15.064716+0000","last_unstale":"2024-09-16T01:55:15.069980+0000","last_undegraded":"2024-09-16T01:55:15.069980+0000","last_fullsized":"2024-09-16T01:55:15.069980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080171+0000","last_change":"2024-09-16T01:55:15.074757+0000","last_active":"2024-09-16T01:55:15.080171+0000","last_peered":"2024-09-16T01:55:15.080171+0000","last_clean":"2024-09-16T01:55:15.080171+0000","last_became_active":"2024-09-16T01:55:15.074465+0000","last_became_peered":"2024-09-16T01:55:15.074465+0000","last_unstale":"2024-09-16T01:55:15.080171+0000","last_undegraded":"2024-09-16T01:55:15.080171+0000","last_fullsized":"2024-09-16T01:55:15.080171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076161+0000","last_change":"2024-09-16T01:55:15.073726+0000","last_active":"2024-09-16T01:55:15.076161+0000","last_peered":"2024-09-16T01:55:15.076161+0000","last_clean":"2024-09-16T01:55:15.076161+0000","last_became_active":"2024-09-16T01:55:15.073453+0000","last_became_peered":"2024-09-16T01:55:15.073453+0000","last_unstale":"2024-09-16T01:55:15.076161+0000","last_undegraded":"2024-09-16T01:55:15.076161+0000","last_fullsized":"2024-09-16T01:55:15.076161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:22.978110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068277+0000","last_change":"2024-09-16T01:55:15.066587+0000","last_active":"2024-09-16T01:55:15.068277+0000","last_peered":"2024-09-16T01:55:15.068277+0000","last_clean":"2024-09-16T01:55:15.068277+0000","last_became_active":"2024-09-16T01:55:15.066292+0000","last_became_peered":"2024-09-16T01:55:15.066292+0000","last_unstale":"2024-09-16T01:55:15.068277+0000","last_undegraded":"2024-09-16T01:55:15.068277+0000","last_fullsized":"2024-09-16T01:55:15.068277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:27.843379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080063+0000","last_change":"2024-09-16T01:55:15.070192+0000","last_active":"2024-09-16T01:55:15.080063+0000","last_peered":"2024-09-16T01:55:15.080063+0000","last_clean":"2024-09-16T01:55:15.080063+0000","last_became_active":"2024-09-16T01:55:15.069764+0000","last_became_peered":"2024-09-16T01:55:15.069764+0000","last_unstale":"2024-09-16T01:55:15.080063+0000","last_undegraded":"2024-09-16T01:55:15.080063+0000","last_fullsized":"2024-09-16T01:55:15.080063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068967+0000","last_change":"2024-09-16T01:55:15.063260+0000","last_active":"2024-09-16T01:55:15.068967+0000","last_peered":"2024-09-16T01:55:15.068967+0000","last_clean":"2024-09-16T01:55:15.068967+0000","last_became_active":"2024-09-16T01:55:15.062964+0000","last_became_peered":"2024-09-16T01:55:15.062964+0000","last_unstale":"2024-09-16T01:55:15.068967+0000","last_undegraded":"2024-09-16T01:55:15.068967+0000","last_fullsized":"2024-09-16T01:55:15.068967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083596+0000","last_change":"2024-09-16T01:55:14.067402+0000","last_active":"2024-09-16T01:55:15.083596+0000","last_peered":"2024-09-16T01:55:15.083596+0000","last_clean":"2024-09-16T01:55:15.083596+0000","last_became_active":"2024-09-16T01:55:14.067117+0000","last_became_peered":"2024-09-16T01:55:14.067117+0000","last_unstale":"2024-09-16T01:55:15.083596+0000","last_undegraded":"2024-09-16T01:55:15.083596+0000","last_fullsized":"2024-09-16T01:55:15.083596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.523320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070015+0000","last_change":"2024-09-16T01:55:15.065086+0000","last_active":"2024-09-16T01:55:15.070015+0000","last_peered":"2024-09-16T01:55:15.070015+0000","last_clean":"2024-09-16T01:55:15.070015+0000","last_became_active":"2024-09-16T01:55:15.064785+0000","last_became_peered":"2024-09-16T01:55:15.064785+0000","last_unstale":"2024-09-16T01:55:15.070015+0000","last_undegraded":"2024-09-16T01:55:15.070015+0000","last_fullsized":"2024-09-16T01:55:15.070015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.084033+0000","last_change":"2024-09-16T01:55:14.068738+0000","last_active":"2024-09-16T01:55:15.084033+0000","last_peered":"2024-09-16T01:55:15.084033+0000","last_clean":"2024-09-16T01:55:15.084033+0000","last_became_active":"2024-09-16T01:55:14.068402+0000","last_became_peered":"2024-09-16T01:55:14.068402+0000","last_unstale":"2024-09-16T01:55:15.084033+0000","last_undegraded":"2024-09-16T01:55:15.084033+0000","last_fullsized":"2024-09-16T01:55:15.084033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:12.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074112+0000","last_change":"2024-09-16T01:55:15.068471+0000","last_active":"2024-09-16T01:55:15.074112+0000","last_peered":"2024-09-16T01:55:15.074112+0000","last_clean":"2024-09-16T01:55:15.074112+0000","last_became_active":"2024-09-16T01:55:15.067998+0000","last_became_peered":"2024-09-16T01:55:15.067998+0000","last_unstale":"2024-09-16T01:55:15.074112+0000","last_undegraded":"2024-09-16T01:55:15.074112+0000","last_fullsized":"2024-09-16T01:55:15.074112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083804+0000","last_change":"2024-09-16T01:55:14.068740+0000","last_active":"2024-09-16T01:55:15.083804+0000","last_peered":"2024-09-16T01:55:15.083804+0000","last_clean":"2024-09-16T01:55:15.083804+0000","last_became_active":"2024-09-16T01:55:14.068436+0000","last_became_peered":"2024-09-16T01:55:14.068436+0000","last_unstale":"2024-09-16T01:55:15.083804+0000","last_undegraded":"2024-09-16T01:55:15.083804+0000","last_fullsized":"2024-09-16T01:55:15.083804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074261+0000","last_change":"2024-09-16T01:55:15.073153+0000","last_active":"2024-09-16T01:55:15.074261+0000","last_peered":"2024-09-16T01:55:15.074261+0000","last_clean":"2024-09-16T01:55:15.074261+0000","last_became_active":"2024-09-16T01:55:15.072869+0000","last_became_peered":"2024-09-16T01:55:15.072869+0000","last_unstale":"2024-09-16T01:55:15.074261+0000","last_undegraded":"2024-09-16T01:55:15.074261+0000","last_fullsized":"2024-09-16T01:55:15.074261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:18.529028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083076+0000","last_change":"2024-09-16T01:55:14.064430+0000","last_active":"2024-09-16T01:55:15.083076+0000","last_peered":"2024-09-16T01:55:15.083076+0000","last_clean":"2024-09-16T01:55:15.083076+0000","last_became_active":"2024-09-16T01:55:14.064050+0000","last_became_peered":"2024-09-16T01:55:14.064050+0000","last_unstale":"2024-09-16T01:55:15.083076+0000","last_undegraded":"2024-09-16T01:55:15.083076+0000","last_fullsized":"2024-09-16T01:55:15.083076+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:08.025192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076149+0000","last_change":"2024-09-16T01:55:15.074074+0000","last_active":"2024-09-16T01:55:15.076149+0000","last_peered":"2024-09-16T01:55:15.076149+0000","last_clean":"2024-09-16T01:55:15.076149+0000","last_became_active":"2024-09-16T01:55:15.068752+0000","last_became_peered":"2024-09-16T01:55:15.068752+0000","last_unstale":"2024-09-16T01:55:15.076149+0000","last_undegraded":"2024-09-16T01:55:15.076149+0000","last_fullsized":"2024-09-16T01:55:15.076149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088009+0000","last_change":"2024-09-16T01:55:14.064060+0000","last_active":"2024-09-16T01:55:15.088009+0000","last_peered":"2024-09-16T01:55:15.088009+0000","last_clean":"2024-09-16T01:55:15.088009+0000","last_became_active":"2024-09-16T01:55:14.063169+0000","last_became_peered":"2024-09-16T01:55:14.063169+0000","last_unstale":"2024-09-16T01:55:15.088009+0000","last_undegraded":"2024-09-16T01:55:15.088009+0000","last_fullsized":"2024-09-16T01:55:15.088009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076409+0000","last_change":"2024-09-16T01:55:15.066922+0000","last_active":"2024-09-16T01:55:15.076409+0000","last_peered":"2024-09-16T01:55:15.076409+0000","last_clean":"2024-09-16T01:55:15.076409+0000","last_became_active":"2024-09-16T01:55:15.063924+0000","last_became_peered":"2024-09-16T01:55:15.063924+0000","last_unstale":"2024-09-16T01:55:15.076409+0000","last_undegraded":"2024-09-16T01:55:15.076409+0000","last_fullsized":"2024-09-16T01:55:15.076409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047981+0000","last_change":"2024-09-16T01:55:13.047981+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047981+0000","last_undegraded":"2024-09-16T01:55:13.047981+0000","last_fullsized":"2024-09-16T01:55:13.047981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.073105+0000","last_change":"2024-09-16T01:55:15.065460+0000","last_active":"2024-09-16T01:55:15.073105+0000","last_peered":"2024-09-16T01:55:15.073105+0000","last_clean":"2024-09-16T01:55:15.073105+0000","last_became_active":"2024-09-16T01:55:15.065203+0000","last_became_peered":"2024-09-16T01:55:15.065203+0000","last_unstale":"2024-09-16T01:55:15.073105+0000","last_undegraded":"2024-09-16T01:55:15.073105+0000","last_fullsized":"2024-09-16T01:55:15.073105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053078+0000","last_change":"2024-09-16T01:55:14.063567+0000","last_active":"2024-09-16T01:55:15.053078+0000","last_peered":"2024-09-16T01:55:15.053078+0000","last_clean":"2024-09-16T01:55:15.053078+0000","last_became_active":"2024-09-16T01:55:14.063264+0000","last_became_peered":"2024-09-16T01:55:14.063264+0000","last_unstale":"2024-09-16T01:55:15.053078+0000","last_undegraded":"2024-09-16T01:55:15.053078+0000","last_fullsized":"2024-09-16T01:55:15.053078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:12.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071322+0000","last_change":"2024-09-16T01:55:15.067811+0000","last_active":"2024-09-16T01:55:15.071322+0000","last_peered":"2024-09-16T01:55:15.071322+0000","last_clean":"2024-09-16T01:55:15.071322+0000","last_became_active":"2024-09-16T01:55:15.067505+0000","last_became_peered":"2024-09-16T01:55:15.067505+0000","last_unstale":"2024-09-16T01:55:15.071322+0000","last_undegraded":"2024-09-16T01:55:15.071322+0000","last_fullsized":"2024-09-16T01:55:15.071322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:33.406715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053269+0000","last_change":"2024-09-16T01:55:14.067645+0000","last_active":"2024-09-16T01:55:15.053269+0000","last_peered":"2024-09-16T01:55:15.053269+0000","last_clean":"2024-09-16T01:55:15.053269+0000","last_became_active":"2024-09-16T01:55:14.067386+0000","last_became_peered":"2024-09-16T01:55:14.067386+0000","last_unstale":"2024-09-16T01:55:15.053269+0000","last_undegraded":"2024-09-16T01:55:15.053269+0000","last_fullsized":"2024-09-16T01:55:15.053269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:19.662035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063284+0000","last_change":"2024-09-16T01:55:15.058622+0000","last_active":"2024-09-16T01:55:16.063284+0000","last_peered":"2024-09-16T01:55:16.063284+0000","last_clean":"2024-09-16T01:55:16.063284+0000","last_became_active":"2024-09-16T01:55:15.057958+0000","last_became_peered":"2024-09-16T01:55:15.057958+0000","last_unstale":"2024-09-16T01:55:16.063284+0000","last_undegraded":"2024-09-16T01:55:16.063284+0000","last_fullsized":"2024-09-16T01:55:16.063284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:54.514922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.057787+0000","last_change":"2024-09-16T01:55:14.057478+0000","last_active":"2024-09-16T01:55:15.057787+0000","last_peered":"2024-09-16T01:55:15.057787+0000","last_clean":"2024-09-16T01:55:15.057787+0000","last_became_active":"2024-09-16T01:55:14.057199+0000","last_became_peered":"2024-09-16T01:55:14.057199+0000","last_unstale":"2024-09-16T01:55:15.057787+0000","last_undegraded":"2024-09-16T01:55:15.057787+0000","last_fullsized":"2024-09-16T01:55:15.057787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:26.749150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.061100+0000","last_change":"2024-09-16T01:55:14.068900+0000","last_active":"2024-09-16T01:55:15.061100+0000","last_peered":"2024-09-16T01:55:15.061100+0000","last_clean":"2024-09-16T01:55:15.061100+0000","last_became_active":"2024-09-16T01:55:14.066896+0000","last_became_peered":"2024-09-16T01:55:14.066896+0000","last_unstale":"2024-09-16T01:55:15.061100+0000","last_undegraded":"2024-09-16T01:55:15.061100+0000","last_fullsized":"2024-09-16T01:55:15.061100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:38.976382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074610+0000","last_change":"2024-09-16T01:55:15.069993+0000","last_active":"2024-09-16T01:55:15.074610+0000","last_peered":"2024-09-16T01:55:15.074610+0000","last_clean":"2024-09-16T01:55:15.074610+0000","last_became_active":"2024-09-16T01:55:15.068922+0000","last_became_peered":"2024-09-16T01:55:15.068922+0000","last_unstale":"2024-09-16T01:55:15.074610+0000","last_undegraded":"2024-09-16T01:55:15.074610+0000","last_fullsized":"2024-09-16T01:55:15.074610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088255+0000","last_change":"2024-09-16T01:55:14.065656+0000","last_active":"2024-09-16T01:55:15.088255+0000","last_peered":"2024-09-16T01:55:15.088255+0000","last_clean":"2024-09-16T01:55:15.088255+0000","last_became_active":"2024-09-16T01:55:14.065390+0000","last_became_peered":"2024-09-16T01:55:14.065390+0000","last_unstale":"2024-09-16T01:55:15.088255+0000","last_undegraded":"2024-09-16T01:55:15.088255+0000","last_fullsized":"2024-09-16T01:55:15.088255+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:17.922515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067977+0000","last_change":"2024-09-16T01:55:15.061491+0000","last_active":"2024-09-16T01:55:15.067977+0000","last_peered":"2024-09-16T01:55:15.067977+0000","last_clean":"2024-09-16T01:55:15.067977+0000","last_became_active":"2024-09-16T01:55:15.060771+0000","last_became_peered":"2024-09-16T01:55:15.060771+0000","last_unstale":"2024-09-16T01:55:15.067977+0000","last_undegraded":"2024-09-16T01:55:15.067977+0000","last_fullsized":"2024-09-16T01:55:15.067977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:27.843379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.089771+0000","last_change":"2024-09-16T01:55:14.066984+0000","last_active":"2024-09-16T01:55:15.089771+0000","last_peered":"2024-09-16T01:55:15.089771+0000","last_clean":"2024-09-16T01:55:15.089771+0000","last_became_active":"2024-09-16T01:55:14.066574+0000","last_became_peered":"2024-09-16T01:55:14.066574+0000","last_unstale":"2024-09-16T01:55:15.089771+0000","last_undegraded":"2024-09-16T01:55:15.089771+0000","last_fullsized":"2024-09-16T01:55:15.089771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:16.713685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076819+0000","last_change":"2024-09-16T01:55:15.075252+0000","last_active":"2024-09-16T01:55:15.076819+0000","last_peered":"2024-09-16T01:55:15.076819+0000","last_clean":"2024-09-16T01:55:15.076819+0000","last_became_active":"2024-09-16T01:55:15.074981+0000","last_became_peered":"2024-09-16T01:55:15.074981+0000","last_unstale":"2024-09-16T01:55:15.076819+0000","last_undegraded":"2024-09-16T01:55:15.076819+0000","last_fullsized":"2024-09-16T01:55:15.076819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080750+0000","last_change":"2024-09-16T01:55:14.065205+0000","last_active":"2024-09-16T01:55:15.080750+0000","last_peered":"2024-09-16T01:55:15.080750+0000","last_clean":"2024-09-16T01:55:15.080750+0000","last_became_active":"2024-09-16T01:55:14.064867+0000","last_became_peered":"2024-09-16T01:55:14.064867+0000","last_unstale":"2024-09-16T01:55:15.080750+0000","last_undegraded":"2024-09-16T01:55:15.080750+0000","last_fullsized":"2024-09-16T01:55:15.080750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:40.415556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070269+0000","last_change":"2024-09-16T01:55:15.065359+0000","last_active":"2024-09-16T01:55:15.070269+0000","last_peered":"2024-09-16T01:55:15.070269+0000","last_clean":"2024-09-16T01:55:15.070269+0000","last_became_active":"2024-09-16T01:55:15.065061+0000","last_became_peered":"2024-09-16T01:55:15.065061+0000","last_unstale":"2024-09-16T01:55:15.070269+0000","last_undegraded":"2024-09-16T01:55:15.070269+0000","last_fullsized":"2024-09-16T01:55:15.070269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054606+0000","last_change":"2024-09-16T01:55:14.070545+0000","last_active":"2024-09-16T01:55:15.054606+0000","last_peered":"2024-09-16T01:55:15.054606+0000","last_clean":"2024-09-16T01:55:15.054606+0000","last_became_active":"2024-09-16T01:55:14.070303+0000","last_became_peered":"2024-09-16T01:55:14.070303+0000","last_unstale":"2024-09-16T01:55:15.054606+0000","last_undegraded":"2024-09-16T01:55:15.054606+0000","last_fullsized":"2024-09-16T01:55:15.054606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:38.976382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.056902+0000","last_change":"2024-09-16T01:55:14.067297+0000","last_active":"2024-09-16T01:55:15.056902+0000","last_peered":"2024-09-16T01:55:15.056902+0000","last_clean":"2024-09-16T01:55:15.056902+0000","last_became_active":"2024-09-16T01:55:14.066981+0000","last_became_peered":"2024-09-16T01:55:14.066981+0000","last_unstale":"2024-09-16T01:55:15.056902+0000","last_undegraded":"2024-09-16T01:55:15.056902+0000","last_fullsized":"2024-09-16T01:55:15.056902+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:17.010112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071281+0000","last_change":"2024-09-16T01:55:15.067563+0000","last_active":"2024-09-16T01:55:15.071281+0000","last_peered":"2024-09-16T01:55:15.071281+0000","last_clean":"2024-09-16T01:55:15.071281+0000","last_became_active":"2024-09-16T01:55:15.066882+0000","last_became_peered":"2024-09-16T01:55:15.066882+0000","last_unstale":"2024-09-16T01:55:15.071281+0000","last_undegraded":"2024-09-16T01:55:15.071281+0000","last_fullsized":"2024-09-16T01:55:15.071281+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:29.313718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047780+0000","last_change":"2024-09-16T01:55:13.047780+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047780+0000","last_undegraded":"2024-09-16T01:55:13.047780+0000","last_fullsized":"2024-09-16T01:55:13.047780+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071149+0000","last_change":"2024-09-16T01:55:15.069351+0000","last_active":"2024-09-16T01:55:15.071149+0000","last_peered":"2024-09-16T01:55:15.071149+0000","last_clean":"2024-09-16T01:55:15.071149+0000","last_became_active":"2024-09-16T01:55:15.068952+0000","last_became_peered":"2024-09-16T01:55:15.068952+0000","last_unstale":"2024-09-16T01:55:15.071149+0000","last_undegraded":"2024-09-16T01:55:15.071149+0000","last_fullsized":"2024-09-16T01:55:15.071149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:53:42.620283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088312+0000","last_change":"2024-09-16T01:55:14.068287+0000","last_active":"2024-09-16T01:55:15.088312+0000","last_peered":"2024-09-16T01:55:15.088312+0000","last_clean":"2024-09-16T01:55:15.088312+0000","last_became_active":"2024-09-16T01:55:14.066615+0000","last_became_peered":"2024-09-16T01:55:14.066615+0000","last_unstale":"2024-09-16T01:55:15.088312+0000","last_undegraded":"2024-09-16T01:55:15.088312+0000","last_fullsized":"2024-09-16T01:55:15.088312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:52.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076931+0000","last_change":"2024-09-16T01:55:15.071381+0000","last_active":"2024-09-16T01:55:15.076931+0000","last_peered":"2024-09-16T01:55:15.076931+0000","last_clean":"2024-09-16T01:55:15.076931+0000","last_became_active":"2024-09-16T01:55:15.071076+0000","last_became_peered":"2024-09-16T01:55:15.071076+0000","last_unstale":"2024-09-16T01:55:15.076931+0000","last_undegraded":"2024-09-16T01:55:15.076931+0000","last_fullsized":"2024-09-16T01:55:15.076931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088343+0000","last_change":"2024-09-16T01:55:14.070457+0000","last_active":"2024-09-16T01:55:15.088343+0000","last_peered":"2024-09-16T01:55:15.088343+0000","last_clean":"2024-09-16T01:55:15.088343+0000","last_became_active":"2024-09-16T01:55:14.070109+0000","last_became_peered":"2024-09-16T01:55:14.070109+0000","last_unstale":"2024-09-16T01:55:15.088343+0000","last_undegraded":"2024-09-16T01:55:15.088343+0000","last_fullsized":"2024-09-16T01:55:15.088343+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.523320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068014+0000","last_change":"2024-09-16T01:55:15.062497+0000","last_active":"2024-09-16T01:55:15.068014+0000","last_peered":"2024-09-16T01:55:15.068014+0000","last_clean":"2024-09-16T01:55:15.068014+0000","last_became_active":"2024-09-16T01:55:15.062232+0000","last_became_peered":"2024-09-16T01:55:15.062232+0000","last_unstale":"2024-09-16T01:55:15.068014+0000","last_undegraded":"2024-09-16T01:55:15.068014+0000","last_fullsized":"2024-09-16T01:55:15.068014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063347+0000","last_change":"2024-09-16T01:55:14.069579+0000","last_active":"2024-09-16T01:55:16.063347+0000","last_peered":"2024-09-16T01:55:16.063347+0000","last_clean":"2024-09-16T01:55:16.063347+0000","last_became_active":"2024-09-16T01:55:14.069262+0000","last_became_peered":"2024-09-16T01:55:14.069262+0000","last_unstale":"2024-09-16T01:55:16.063347+0000","last_undegraded":"2024-09-16T01:55:16.063347+0000","last_fullsized":"2024-09-16T01:55:16.063347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:18.137110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063308+0000","last_change":"2024-09-16T01:55:15.061094+0000","last_active":"2024-09-16T01:55:16.063308+0000","last_peered":"2024-09-16T01:55:16.063308+0000","last_clean":"2024-09-16T01:55:16.063308+0000","last_became_active":"2024-09-16T01:55:15.060812+0000","last_became_peered":"2024-09-16T01:55:15.060812+0000","last_unstale":"2024-09-16T01:55:16.063308+0000","last_undegraded":"2024-09-16T01:55:16.063308+0000","last_fullsized":"2024-09-16T01:55:16.063308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:52.593075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054332+0000","last_change":"2024-09-16T01:55:14.064373+0000","last_active":"2024-09-16T01:55:15.054332+0000","last_peered":"2024-09-16T01:55:15.054332+0000","last_clean":"2024-09-16T01:55:15.054332+0000","last_became_active":"2024-09-16T01:55:14.064081+0000","last_became_peered":"2024-09-16T01:55:14.064081+0000","last_unstale":"2024-09-16T01:55:15.054332+0000","last_undegraded":"2024-09-16T01:55:15.054332+0000","last_fullsized":"2024-09-16T01:55:15.054332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:17.922515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063132+0000","last_change":"2024-09-16T01:55:14.064714+0000","last_active":"2024-09-16T01:55:16.063132+0000","last_peered":"2024-09-16T01:55:16.063132+0000","last_clean":"2024-09-16T01:55:16.063132+0000","last_became_active":"2024-09-16T01:55:14.064423+0000","last_became_peered":"2024-09-16T01:55:14.064423+0000","last_unstale":"2024-09-16T01:55:16.063132+0000","last_undegraded":"2024-09-16T01:55:16.063132+0000","last_fullsized":"2024-09-16T01:55:16.063132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:02.564362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072354+0000","last_change":"2024-09-16T01:55:15.068101+0000","last_active":"2024-09-16T01:55:15.072354+0000","last_peered":"2024-09-16T01:55:15.072354+0000","last_clean":"2024-09-16T01:55:15.072354+0000","last_became_active":"2024-09-16T01:55:15.067812+0000","last_became_peered":"2024-09-16T01:55:15.067812+0000","last_unstale":"2024-09-16T01:55:15.072354+0000","last_undegraded":"2024-09-16T01:55:15.072354+0000","last_fullsized":"2024-09-16T01:55:15.072354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063005+0000","last_change":"2024-09-16T01:55:14.063203+0000","last_active":"2024-09-16T01:55:16.063005+0000","last_peered":"2024-09-16T01:55:16.063005+0000","last_clean":"2024-09-16T01:55:16.063005+0000","last_became_active":"2024-09-16T01:55:14.062940+0000","last_became_peered":"2024-09-16T01:55:14.062940+0000","last_unstale":"2024-09-16T01:55:16.063005+0000","last_undegraded":"2024-09-16T01:55:16.063005+0000","last_fullsized":"2024-09-16T01:55:16.063005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:56.080694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075848+0000","last_change":"2024-09-16T01:55:15.071198+0000","last_active":"2024-09-16T01:55:15.075848+0000","last_peered":"2024-09-16T01:55:15.075848+0000","last_clean":"2024-09-16T01:55:15.075848+0000","last_became_active":"2024-09-16T01:55:15.070942+0000","last_became_peered":"2024-09-16T01:55:15.070942+0000","last_unstale":"2024-09-16T01:55:15.075848+0000","last_undegraded":"2024-09-16T01:55:15.075848+0000","last_fullsized":"2024-09-16T01:55:15.075848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:26.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.048045+0000","last_change":"2024-09-16T01:55:13.048045+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.048045+0000","last_undegraded":"2024-09-16T01:55:13.048045+0000","last_fullsized":"2024-09-16T01:55:13.048045+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071304+0000","last_change":"2024-09-16T01:55:15.067797+0000","last_active":"2024-09-16T01:55:15.071304+0000","last_peered":"2024-09-16T01:55:15.071304+0000","last_clean":"2024-09-16T01:55:15.071304+0000","last_became_active":"2024-09-16T01:55:15.067256+0000","last_became_peered":"2024-09-16T01:55:15.067256+0000","last_unstale":"2024-09-16T01:55:15.071304+0000","last_undegraded":"2024-09-16T01:55:15.071304+0000","last_fullsized":"2024-09-16T01:55:15.071304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.571746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.062931+0000","last_change":"2024-09-16T01:55:14.061458+0000","last_active":"2024-09-16T01:55:16.062931+0000","last_peered":"2024-09-16T01:55:16.062931+0000","last_clean":"2024-09-16T01:55:16.062931+0000","last_became_active":"2024-09-16T01:55:14.061101+0000","last_became_peered":"2024-09-16T01:55:14.061101+0000","last_unstale":"2024-09-16T01:55:16.062931+0000","last_undegraded":"2024-09-16T01:55:16.062931+0000","last_fullsized":"2024-09-16T01:55:16.062931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:13.570291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.078125+0000","last_change":"2024-09-16T01:55:15.072888+0000","last_active":"2024-09-16T01:55:15.078125+0000","last_peered":"2024-09-16T01:55:15.078125+0000","last_clean":"2024-09-16T01:55:15.078125+0000","last_became_active":"2024-09-16T01:55:15.072571+0000","last_became_peered":"2024-09-16T01:55:15.072571+0000","last_unstale":"2024-09-16T01:55:15.078125+0000","last_undegraded":"2024-09-16T01:55:15.078125+0000","last_fullsized":"2024-09-16T01:55:15.078125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088241+0000","last_change":"2024-09-16T01:55:14.066143+0000","last_active":"2024-09-16T01:55:15.088241+0000","last_peered":"2024-09-16T01:55:15.088241+0000","last_clean":"2024-09-16T01:55:15.088241+0000","last_became_active":"2024-09-16T01:55:14.065838+0000","last_became_peered":"2024-09-16T01:55:14.065838+0000","last_unstale":"2024-09-16T01:55:15.088241+0000","last_undegraded":"2024-09-16T01:55:15.088241+0000","last_fullsized":"2024-09-16T01:55:15.088241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:07.689683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073154+0000","last_change":"2024-09-16T01:55:14.064101+0000","last_active":"2024-09-16T01:55:16.073154+0000","last_peered":"2024-09-16T01:55:16.073154+0000","last_clean":"2024-09-16T01:55:16.073154+0000","last_became_active":"2024-09-16T01:55:14.063782+0000","last_became_peered":"2024-09-16T01:55:14.063782+0000","last_unstale":"2024-09-16T01:55:16.073154+0000","last_undegraded":"2024-09-16T01:55:16.073154+0000","last_fullsized":"2024-09-16T01:55:16.073154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:53.149175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070227+0000","last_change":"2024-09-16T01:55:15.066052+0000","last_active":"2024-09-16T01:55:15.070227+0000","last_peered":"2024-09-16T01:55:15.070227+0000","last_clean":"2024-09-16T01:55:15.070227+0000","last_became_active":"2024-09-16T01:55:15.065771+0000","last_became_peered":"2024-09-16T01:55:15.065771+0000","last_unstale":"2024-09-16T01:55:15.070227+0000","last_undegraded":"2024-09-16T01:55:15.070227+0000","last_fullsized":"2024-09-16T01:55:15.070227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:22.978110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.059430+0000","last_change":"2024-09-16T01:55:14.064829+0000","last_active":"2024-09-16T01:55:15.059430+0000","last_peered":"2024-09-16T01:55:15.059430+0000","last_clean":"2024-09-16T01:55:15.059430+0000","last_became_active":"2024-09-16T01:55:14.064531+0000","last_became_peered":"2024-09-16T01:55:14.064531+0000","last_unstale":"2024-09-16T01:55:15.059430+0000","last_undegraded":"2024-09-16T01:55:15.059430+0000","last_fullsized":"2024-09-16T01:55:15.059430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:41.155579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076798+0000","last_change":"2024-09-16T01:55:15.074355+0000","last_active":"2024-09-16T01:55:15.076798+0000","last_peered":"2024-09-16T01:55:15.076798+0000","last_clean":"2024-09-16T01:55:15.076798+0000","last_became_active":"2024-09-16T01:55:15.071086+0000","last_became_peered":"2024-09-16T01:55:15.071086+0000","last_unstale":"2024-09-16T01:55:15.076798+0000","last_undegraded":"2024-09-16T01:55:15.076798+0000","last_fullsized":"2024-09-16T01:55:15.076798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.062153+0000","last_change":"2024-09-16T01:55:14.067246+0000","last_active":"2024-09-16T01:55:15.062153+0000","last_peered":"2024-09-16T01:55:15.062153+0000","last_clean":"2024-09-16T01:55:15.062153+0000","last_became_active":"2024-09-16T01:55:14.066819+0000","last_became_peered":"2024-09-16T01:55:14.066819+0000","last_unstale":"2024-09-16T01:55:15.062153+0000","last_undegraded":"2024-09-16T01:55:15.062153+0000","last_fullsized":"2024-09-16T01:55:15.062153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072435+0000","last_change":"2024-09-16T01:55:15.069885+0000","last_active":"2024-09-16T01:55:15.072435+0000","last_peered":"2024-09-16T01:55:15.072435+0000","last_clean":"2024-09-16T01:55:15.072435+0000","last_became_active":"2024-09-16T01:55:15.068666+0000","last_became_peered":"2024-09-16T01:55:15.068666+0000","last_unstale":"2024-09-16T01:55:15.072435+0000","last_undegraded":"2024-09-16T01:55:15.072435+0000","last_fullsized":"2024-09-16T01:55:15.072435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.059227+0000","last_change":"2024-09-16T01:55:14.064031+0000","last_active":"2024-09-16T01:55:15.059227+0000","last_peered":"2024-09-16T01:55:15.059227+0000","last_clean":"2024-09-16T01:55:15.059227+0000","last_became_active":"2024-09-16T01:55:14.063686+0000","last_became_peered":"2024-09-16T01:55:14.063686+0000","last_unstale":"2024-09-16T01:55:15.059227+0000","last_undegraded":"2024-09-16T01:55:15.059227+0000","last_fullsized":"2024-09-16T01:55:15.059227+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:19.662035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.062236+0000","last_change":"2024-09-16T01:55:15.058905+0000","last_active":"2024-09-16T01:55:15.062236+0000","last_peered":"2024-09-16T01:55:15.062236+0000","last_clean":"2024-09-16T01:55:15.062236+0000","last_became_active":"2024-09-16T01:55:15.058632+0000","last_became_peered":"2024-09-16T01:55:15.058632+0000","last_unstale":"2024-09-16T01:55:15.062236+0000","last_undegraded":"2024-09-16T01:55:15.062236+0000","last_fullsized":"2024-09-16T01:55:15.062236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:13.646813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053762+0000","last_change":"2024-09-16T01:55:14.064739+0000","last_active":"2024-09-16T01:55:15.053762+0000","last_peered":"2024-09-16T01:55:15.053762+0000","last_clean":"2024-09-16T01:55:15.053762+0000","last_became_active":"2024-09-16T01:55:14.064446+0000","last_became_peered":"2024-09-16T01:55:14.064446+0000","last_unstale":"2024-09-16T01:55:15.053762+0000","last_undegraded":"2024-09-16T01:55:15.053762+0000","last_fullsized":"2024-09-16T01:55:15.053762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:41.155579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054832+0000","last_change":"2024-09-16T01:55:14.057198+0000","last_active":"2024-09-16T01:55:15.054832+0000","last_peered":"2024-09-16T01:55:15.054832+0000","last_clean":"2024-09-16T01:55:15.054832+0000","last_became_active":"2024-09-16T01:55:14.056723+0000","last_became_peered":"2024-09-16T01:55:14.056723+0000","last_unstale":"2024-09-16T01:55:15.054832+0000","last_undegraded":"2024-09-16T01:55:15.054832+0000","last_fullsized":"2024-09-16T01:55:15.054832+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:53.464988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076035+0000","last_change":"2024-09-16T01:55:15.074182+0000","last_active":"2024-09-16T01:55:15.076035+0000","last_peered":"2024-09-16T01:55:15.076035+0000","last_clean":"2024-09-16T01:55:15.076035+0000","last_became_active":"2024-09-16T01:55:15.073915+0000","last_became_peered":"2024-09-16T01:55:15.073915+0000","last_unstale":"2024-09-16T01:55:15.076035+0000","last_undegraded":"2024-09-16T01:55:15.076035+0000","last_fullsized":"2024-09-16T01:55:15.076035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:29.313718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047989+0000","last_change":"2024-09-16T01:55:13.047989+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047989+0000","last_undegraded":"2024-09-16T01:55:13.047989+0000","last_fullsized":"2024-09-16T01:55:13.047989+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T01:55:13.048552+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:55:13.048552+0000","last_peered":"2024-09-16T01:55:13.048552+0000","last_clean":"2024-09-16T01:55:13.048552+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:55:13.048552+0000","last_undegraded":"2024-09-16T01:55:13.048552+0000","last_fullsized":"2024-09-16T01:55:13.048552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":434176,"data_stored":180254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":178608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":761809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":755142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":434176,"data_stored":185370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:55:18.391 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:55:18.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.529+0000 7fa8c3f4b640 1 Processor -- start 2024-09-16T01:55:18.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.529+0000 7fa8c3f4b640 1 -- start start 2024-09-16T01:55:18.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.530+0000 7fa8c3f4b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa8bc162060 0x7fa8bc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.530+0000 7fa8c3f4b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 0x7fa8bc0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.530+0000 7fa8c3f4b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc06d9f0 con 0x7fa8bc161c80 2024-09-16T01:55:18.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.530+0000 7fa8c3f4b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fa8bc06dcd0 con 0x7fa8bc162060 2024-09-16T01:55:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.530+0000 7fa8c3f4b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc06dfb0 con 0x7fa8bc0b64b0 2024-09-16T01:55:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.530+0000 7fa8c14e6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa8bc162060 0x7fa8bc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.530+0000 7fa8c1ce7640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa8bc161c80 0x7fa8bc06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59714/0 (socket says 172.21.15.42:59714) 2024-09-16T01:55:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.530+0000 7fa8c1ce7640 1 -- 172.21.15.42:0/3385931513 learned_addr learned my addr 172.21.15.42:0/3385931513 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.531+0000 7fa8c24e8640 1 --2- 172.21.15.42:0/3385931513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 0x7fa8bc0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.531+0000 7fa8c14e6640 1 -- 172.21.15.42:0/3385931513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 msgr2=0x7fa8bc0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.531+0000 7fa8c14e6640 1 --2- 172.21.15.42:0/3385931513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 0x7fa8bc0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.531+0000 7fa8c14e6640 1 -- 172.21.15.42:0/3385931513 >> v1:172.21.15.42:6789/0 conn(0x7fa8bc161c80 legacy=0x7fa8bc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.531+0000 7fa8c14e6640 1 -- 172.21.15.42:0/3385931513 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc0d01f0 con 0x7fa8bc162060 2024-09-16T01:55:18.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.531+0000 7fa8c0ce5640 1 -- 172.21.15.42:0/3385931513 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395233629 0 0) 0x7fa8bc06d9f0 con 0x7fa8bc161c80 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.531+0000 7fa8c14e6640 1 --2- 172.21.15.42:0/3385931513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 0x7fa8bc0b5f70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00097a0 tx=0x7fa8b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c67e06adddf0550 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c0ce5640 1 -- 172.21.15.42:0/3385931513 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0037070 con 0x7fa8bc162060 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c0ce5640 1 -- 172.21.15.42:0/3385931513 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b0032440 con 0x7fa8bc162060 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c0ce5640 1 -- 172.21.15.42:0/3385931513 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0032810 con 0x7fa8bc162060 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/3385931513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 msgr2=0x7fa8bc0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c3f4b640 1 --2- 172.21.15.42:0/3385931513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 0x7fa8bc0b5f70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00097a0 tx=0x7fa8b002a180 comp rx=0 tx=0).stop 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/3385931513 shutdown_connections 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c3f4b640 1 --2- 172.21.15.42:0/3385931513 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 0x7fa8bc0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c3f4b640 1 --2- 172.21.15.42:0/3385931513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 0x7fa8bc0b5f70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/3385931513 >> 172.21.15.42:0/3385931513 conn(0x7fa8bc0d44f0 msgr2=0x7fa8bc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:18.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/3385931513 shutdown_connections 2024-09-16T01:55:18.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.532+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/3385931513 wait complete. 2024-09-16T01:55:18.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.533+0000 7fa8c3f4b640 1 Processor -- start 2024-09-16T01:55:18.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.534+0000 7fa8c3f4b640 1 -- start start 2024-09-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.534+0000 7fa8c3f4b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 0x7fa8bc159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.534+0000 7fa8c3f4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8bc161c80 0x7fa8bc0b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.534+0000 7fa8c3f4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 0x7fa8bc0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.534+0000 7fa8c3f4b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc0cf360 con 0x7fa8bc162060 2024-09-16T01:55:18.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.534+0000 7fa8c3f4b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc0cf1e0 con 0x7fa8bc161c80 2024-09-16T01:55:18.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.534+0000 7fa8c3f4b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc0cf4e0 con 0x7fa8bc0b64b0 2024-09-16T01:55:18.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.534+0000 7fa8c24e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 0x7fa8bc0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.534+0000 7fa8c24e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 0x7fa8bc0c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47996/0 (socket says 172.21.15.42:47996) 2024-09-16T01:55:18.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.534+0000 7fa8c24e8640 1 -- 172.21.15.42:0/1692775576 learned_addr learned my addr 172.21.15.42:0/1692775576 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:18.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c1ce7640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 0x7fa8bc159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c14e6640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8bc161c80 0x7fa8bc0b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c24e8640 1 -- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 msgr2=0x7fa8bc159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c24e8640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 0x7fa8bc159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c24e8640 1 -- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8bc161c80 msgr2=0x7fa8bc0b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c24e8640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8bc161c80 0x7fa8bc0b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c24e8640 1 -- 172.21.15.42:0/1692775576 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc159e90 con 0x7fa8bc162060 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c1ce7640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 0x7fa8bc159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c14e6640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8bc161c80 0x7fa8bc0b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c24e8640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 0x7fa8bc0c7f30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400d830 tx=0x7fa8b400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8ba7fc640 1 -- 172.21.15.42:0/1692775576 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400b6c0 con 0x7fa8bc162060 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8ba7fc640 1 -- 172.21.15.42:0/1692775576 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b4019070 con 0x7fa8bc162060 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/1692775576 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8bc0c89f0 con 0x7fa8bc162060 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8ba7fc640 1 -- 172.21.15.42:0/1692775576 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400bac0 con 0x7fa8bc162060 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.535+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/1692775576 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8bc0b7c60 con 0x7fa8bc162060 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.536+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/1692775576 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8bc0b5f70 con 0x7fa8bc162060 2024-09-16T01:55:18.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.536+0000 7fa8ba7fc640 1 -- 172.21.15.42:0/1692775576 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa8b401e460 con 0x7fa8bc162060 2024-09-16T01:55:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.537+0000 7fa8ba7fc640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa8a806c2b0 0x7fa8a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.537+0000 7fa8ba7fc640 1 -- 172.21.15.42:0/1692775576 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa8b408bc60 con 0x7fa8bc162060 2024-09-16T01:55:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.537+0000 7fa8c1ce7640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa8a806c2b0 0x7fa8a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.538+0000 7fa8c1ce7640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa8a806c2b0 0x7fa8a806e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0012e0 tx=0x7fa8ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:18.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.541+0000 7fa8ba7fc640 1 -- 172.21.15.42:0/1692775576 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8b405a240 con 0x7fa8bc162060 2024-09-16T01:55:18.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.715+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/1692775576 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa8bc0b4e50 con 0x7fa8a806c2b0 2024-09-16T01:55:18.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.721+0000 7fa8ba7fc640 1 -- 172.21.15.42:0/1692775576 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250188 (secure 0 0 0) 0x7fa8bc0b4e50 con 0x7fa8a806c2b0 2024-09-16T01:55:18.725 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:18.726 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa8a806c2b0 msgr2=0x7fa8a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa8a806c2b0 0x7fa8a806e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0012e0 tx=0x7fa8ac009040 comp rx=0 tx=0).stop 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/1692775576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 msgr2=0x7fa8bc0c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 0x7fa8bc0c7f30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400d830 tx=0x7fa8b400dcf0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/1692775576 shutdown_connections 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa8a806c2b0 0x7fa8a806e770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8bc162060 0x7fa8bc0c7f30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8bc161c80 0x7fa8bc0b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 --2- 172.21.15.42:0/1692775576 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8bc0b64b0 0x7fa8bc159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/1692775576 >> 172.21.15.42:0/1692775576 conn(0x7fa8bc0d44f0 msgr2=0x7fa8bc0d3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/1692775576 shutdown_connections 2024-09-16T01:55:18.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.724+0000 7fa8c3f4b640 1 -- 172.21.15.42:0/1692775576 wait complete. 2024-09-16T01:55:18.736 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-16T01:55:18.262289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237276,"kb_used_data":4384,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737444,"statfs":{"total":773094113280,"available":772851142656,"internally_reserved":0,"allocated":4489216,"data_stored":2575506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.222058"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070192+0000","last_change":"2024-09-16T01:55:15.065385+0000","last_active":"2024-09-16T01:55:15.070192+0000","last_peered":"2024-09-16T01:55:15.070192+0000","last_clean":"2024-09-16T01:55:15.070192+0000","last_became_active":"2024-09-16T01:55:15.065095+0000","last_became_peered":"2024-09-16T01:55:15.065095+0000","last_unstale":"2024-09-16T01:55:15.070192+0000","last_undegraded":"2024-09-16T01:55:15.070192+0000","last_fullsized":"2024-09-16T01:55:15.070192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067753+0000","last_change":"2024-09-16T01:55:15.059749+0000","last_active":"2024-09-16T01:55:15.067753+0000","last_peered":"2024-09-16T01:55:15.067753+0000","last_clean":"2024-09-16T01:55:15.067753+0000","last_became_active":"2024-09-16T01:55:15.059458+0000","last_became_peered":"2024-09-16T01:55:15.059458+0000","last_unstale":"2024-09-16T01:55:15.067753+0000","last_undegraded":"2024-09-16T01:55:15.067753+0000","last_fullsized":"2024-09-16T01:55:15.067753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:26.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080246+0000","last_change":"2024-09-16T01:55:15.077805+0000","last_active":"2024-09-16T01:55:15.080246+0000","last_peered":"2024-09-16T01:55:15.080246+0000","last_clean":"2024-09-16T01:55:15.080246+0000","last_became_active":"2024-09-16T01:55:15.077485+0000","last_became_peered":"2024-09-16T01:55:15.077485+0000","last_unstale":"2024-09-16T01:55:15.080246+0000","last_undegraded":"2024-09-16T01:55:15.080246+0000","last_fullsized":"2024-09-16T01:55:15.080246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063287+0000","last_change":"2024-09-16T01:55:15.058881+0000","last_active":"2024-09-16T01:55:16.063287+0000","last_peered":"2024-09-16T01:55:16.063287+0000","last_clean":"2024-09-16T01:55:16.063287+0000","last_became_active":"2024-09-16T01:55:15.058341+0000","last_became_peered":"2024-09-16T01:55:15.058341+0000","last_unstale":"2024-09-16T01:55:16.063287+0000","last_undegraded":"2024-09-16T01:55:16.063287+0000","last_fullsized":"2024-09-16T01:55:16.063287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:05.641631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063089+0000","last_change":"2024-09-16T01:55:15.059514+0000","last_active":"2024-09-16T01:55:16.063089+0000","last_peered":"2024-09-16T01:55:16.063089+0000","last_clean":"2024-09-16T01:55:16.063089+0000","last_became_active":"2024-09-16T01:55:15.059148+0000","last_became_peered":"2024-09-16T01:55:15.059148+0000","last_unstale":"2024-09-16T01:55:16.063089+0000","last_undegraded":"2024-09-16T01:55:16.063089+0000","last_fullsized":"2024-09-16T01:55:16.063089+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:43.845985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070564+0000","last_change":"2024-09-16T01:55:15.067284+0000","last_active":"2024-09-16T01:55:15.070564+0000","last_peered":"2024-09-16T01:55:15.070564+0000","last_clean":"2024-09-16T01:55:15.070564+0000","last_became_active":"2024-09-16T01:55:15.066918+0000","last_became_peered":"2024-09-16T01:55:15.066918+0000","last_unstale":"2024-09-16T01:55:15.070564+0000","last_undegraded":"2024-09-16T01:55:15.070564+0000","last_fullsized":"2024-09-16T01:55:15.070564+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.077947+0000","last_change":"2024-09-16T01:55:15.074589+0000","last_active":"2024-09-16T01:55:15.077947+0000","last_peered":"2024-09-16T01:55:15.077947+0000","last_clean":"2024-09-16T01:55:15.077947+0000","last_became_active":"2024-09-16T01:55:15.074341+0000","last_became_peered":"2024-09-16T01:55:15.074341+0000","last_unstale":"2024-09-16T01:55:15.077947+0000","last_undegraded":"2024-09-16T01:55:15.077947+0000","last_fullsized":"2024-09-16T01:55:15.077947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.571746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067783+0000","last_change":"2024-09-16T01:55:15.063121+0000","last_active":"2024-09-16T01:55:15.067783+0000","last_peered":"2024-09-16T01:55:15.067783+0000","last_clean":"2024-09-16T01:55:15.067783+0000","last_became_active":"2024-09-16T01:55:15.062819+0000","last_became_peered":"2024-09-16T01:55:15.062819+0000","last_unstale":"2024-09-16T01:55:15.067783+0000","last_undegraded":"2024-09-16T01:55:15.067783+0000","last_fullsized":"2024-09-16T01:55:15.067783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072493+0000","last_change":"2024-09-16T01:55:15.069367+0000","last_active":"2024-09-16T01:55:15.072493+0000","last_peered":"2024-09-16T01:55:15.072493+0000","last_clean":"2024-09-16T01:55:15.072493+0000","last_became_active":"2024-09-16T01:55:15.069079+0000","last_became_peered":"2024-09-16T01:55:15.069079+0000","last_unstale":"2024-09-16T01:55:15.072493+0000","last_undegraded":"2024-09-16T01:55:15.072493+0000","last_fullsized":"2024-09-16T01:55:15.072493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.079096+0000","last_change":"2024-09-16T01:55:15.071490+0000","last_active":"2024-09-16T01:55:15.079096+0000","last_peered":"2024-09-16T01:55:15.079096+0000","last_clean":"2024-09-16T01:55:15.079096+0000","last_became_active":"2024-09-16T01:55:15.071162+0000","last_became_peered":"2024-09-16T01:55:15.071162+0000","last_unstale":"2024-09-16T01:55:15.079096+0000","last_undegraded":"2024-09-16T01:55:15.079096+0000","last_fullsized":"2024-09-16T01:55:15.079096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076910+0000","last_change":"2024-09-16T01:55:15.067585+0000","last_active":"2024-09-16T01:55:15.076910+0000","last_peered":"2024-09-16T01:55:15.076910+0000","last_clean":"2024-09-16T01:55:15.076910+0000","last_became_active":"2024-09-16T01:55:15.067196+0000","last_became_peered":"2024-09-16T01:55:15.067196+0000","last_unstale":"2024-09-16T01:55:15.076910+0000","last_undegraded":"2024-09-16T01:55:15.076910+0000","last_fullsized":"2024-09-16T01:55:15.076910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.064986+0000","last_change":"2024-09-16T01:55:15.063667+0000","last_active":"2024-09-16T01:55:15.064986+0000","last_peered":"2024-09-16T01:55:15.064986+0000","last_clean":"2024-09-16T01:55:15.064986+0000","last_became_active":"2024-09-16T01:55:15.063380+0000","last_became_peered":"2024-09-16T01:55:15.063380+0000","last_unstale":"2024-09-16T01:55:15.064986+0000","last_undegraded":"2024-09-16T01:55:15.064986+0000","last_fullsized":"2024-09-16T01:55:15.064986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075948+0000","last_change":"2024-09-16T01:55:15.072130+0000","last_active":"2024-09-16T01:55:15.075948+0000","last_peered":"2024-09-16T01:55:15.075948+0000","last_clean":"2024-09-16T01:55:15.075948+0000","last_became_active":"2024-09-16T01:55:15.071860+0000","last_became_peered":"2024-09-16T01:55:15.071860+0000","last_unstale":"2024-09-16T01:55:15.075948+0000","last_undegraded":"2024-09-16T01:55:15.075948+0000","last_fullsized":"2024-09-16T01:55:15.075948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074051+0000","last_change":"2024-09-16T01:55:15.068911+0000","last_active":"2024-09-16T01:55:15.074051+0000","last_peered":"2024-09-16T01:55:15.074051+0000","last_clean":"2024-09-16T01:55:15.074051+0000","last_became_active":"2024-09-16T01:55:15.068623+0000","last_became_peered":"2024-09-16T01:55:15.068623+0000","last_unstale":"2024-09-16T01:55:15.074051+0000","last_undegraded":"2024-09-16T01:55:15.074051+0000","last_fullsized":"2024-09-16T01:55:15.074051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076431+0000","last_change":"2024-09-16T01:55:15.070772+0000","last_active":"2024-09-16T01:55:15.076431+0000","last_peered":"2024-09-16T01:55:15.076431+0000","last_clean":"2024-09-16T01:55:15.076431+0000","last_became_active":"2024-09-16T01:55:15.068031+0000","last_became_peered":"2024-09-16T01:55:15.068031+0000","last_unstale":"2024-09-16T01:55:15.076431+0000","last_undegraded":"2024-09-16T01:55:15.076431+0000","last_fullsized":"2024-09-16T01:55:15.076431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068039+0000","last_change":"2024-09-16T01:55:15.066271+0000","last_active":"2024-09-16T01:55:15.068039+0000","last_peered":"2024-09-16T01:55:15.068039+0000","last_clean":"2024-09-16T01:55:15.068039+0000","last_became_active":"2024-09-16T01:55:15.065908+0000","last_became_peered":"2024-09-16T01:55:15.065908+0000","last_unstale":"2024-09-16T01:55:15.068039+0000","last_undegraded":"2024-09-16T01:55:15.068039+0000","last_fullsized":"2024-09-16T01:55:15.068039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:42.161072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063171+0000","last_change":"2024-09-16T01:55:15.065208+0000","last_active":"2024-09-16T01:55:16.063171+0000","last_peered":"2024-09-16T01:55:16.063171+0000","last_clean":"2024-09-16T01:55:16.063171+0000","last_became_active":"2024-09-16T01:55:15.062657+0000","last_became_peered":"2024-09-16T01:55:15.062657+0000","last_unstale":"2024-09-16T01:55:16.063171+0000","last_undegraded":"2024-09-16T01:55:16.063171+0000","last_fullsized":"2024-09-16T01:55:16.063171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:53.907841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068075+0000","last_change":"2024-09-16T01:55:15.065314+0000","last_active":"2024-09-16T01:55:15.068075+0000","last_peered":"2024-09-16T01:55:15.068075+0000","last_clean":"2024-09-16T01:55:15.068075+0000","last_became_active":"2024-09-16T01:55:15.065037+0000","last_became_peered":"2024-09-16T01:55:15.065037+0000","last_unstale":"2024-09-16T01:55:15.068075+0000","last_undegraded":"2024-09-16T01:55:15.068075+0000","last_fullsized":"2024-09-16T01:55:15.068075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:09.030685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075927+0000","last_change":"2024-09-16T01:55:15.066813+0000","last_active":"2024-09-16T01:55:15.075927+0000","last_peered":"2024-09-16T01:55:15.075927+0000","last_clean":"2024-09-16T01:55:15.075927+0000","last_became_active":"2024-09-16T01:55:15.063973+0000","last_became_peered":"2024-09-16T01:55:15.063973+0000","last_unstale":"2024-09-16T01:55:15.075927+0000","last_undegraded":"2024-09-16T01:55:15.075927+0000","last_fullsized":"2024-09-16T01:55:15.075927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.073081+0000","last_change":"2024-09-16T01:55:15.065269+0000","last_active":"2024-09-16T01:55:15.073081+0000","last_peered":"2024-09-16T01:55:15.073081+0000","last_clean":"2024-09-16T01:55:15.073081+0000","last_became_active":"2024-09-16T01:55:15.064860+0000","last_became_peered":"2024-09-16T01:55:15.064860+0000","last_unstale":"2024-09-16T01:55:15.073081+0000","last_undegraded":"2024-09-16T01:55:15.073081+0000","last_fullsized":"2024-09-16T01:55:15.073081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.062949+0000","last_change":"2024-09-16T01:55:15.071896+0000","last_active":"2024-09-16T01:55:16.062949+0000","last_peered":"2024-09-16T01:55:16.062949+0000","last_clean":"2024-09-16T01:55:16.062949+0000","last_became_active":"2024-09-16T01:55:15.071607+0000","last_became_peered":"2024-09-16T01:55:15.071607+0000","last_unstale":"2024-09-16T01:55:16.062949+0000","last_undegraded":"2024-09-16T01:55:16.062949+0000","last_fullsized":"2024-09-16T01:55:16.062949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:21.925734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068536+0000","last_change":"2024-09-16T01:55:15.066489+0000","last_active":"2024-09-16T01:55:15.068536+0000","last_peered":"2024-09-16T01:55:15.068536+0000","last_clean":"2024-09-16T01:55:15.068536+0000","last_became_active":"2024-09-16T01:55:15.066198+0000","last_became_peered":"2024-09-16T01:55:15.066198+0000","last_unstale":"2024-09-16T01:55:15.068536+0000","last_undegraded":"2024-09-16T01:55:15.068536+0000","last_fullsized":"2024-09-16T01:55:15.068536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:13.646813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.069980+0000","last_change":"2024-09-16T01:55:15.065514+0000","last_active":"2024-09-16T01:55:15.069980+0000","last_peered":"2024-09-16T01:55:15.069980+0000","last_clean":"2024-09-16T01:55:15.069980+0000","last_became_active":"2024-09-16T01:55:15.064716+0000","last_became_peered":"2024-09-16T01:55:15.064716+0000","last_unstale":"2024-09-16T01:55:15.069980+0000","last_undegraded":"2024-09-16T01:55:15.069980+0000","last_fullsized":"2024-09-16T01:55:15.069980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080171+0000","last_change":"2024-09-16T01:55:15.074757+0000","last_active":"2024-09-16T01:55:15.080171+0000","last_peered":"2024-09-16T01:55:15.080171+0000","last_clean":"2024-09-16T01:55:15.080171+0000","last_became_active":"2024-09-16T01:55:15.074465+0000","last_became_peered":"2024-09-16T01:55:15.074465+0000","last_unstale":"2024-09-16T01:55:15.080171+0000","last_undegraded":"2024-09-16T01:55:15.080171+0000","last_fullsized":"2024-09-16T01:55:15.080171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076161+0000","last_change":"2024-09-16T01:55:15.073726+0000","last_active":"2024-09-16T01:55:15.076161+0000","last_peered":"2024-09-16T01:55:15.076161+0000","last_clean":"2024-09-16T01:55:15.076161+0000","last_became_active":"2024-09-16T01:55:15.073453+0000","last_became_peered":"2024-09-16T01:55:15.073453+0000","last_unstale":"2024-09-16T01:55:15.076161+0000","last_undegraded":"2024-09-16T01:55:15.076161+0000","last_fullsized":"2024-09-16T01:55:15.076161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:22.978110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068277+0000","last_change":"2024-09-16T01:55:15.066587+0000","last_active":"2024-09-16T01:55:15.068277+0000","last_peered":"2024-09-16T01:55:15.068277+0000","last_clean":"2024-09-16T01:55:15.068277+0000","last_became_active":"2024-09-16T01:55:15.066292+0000","last_became_peered":"2024-09-16T01:55:15.066292+0000","last_unstale":"2024-09-16T01:55:15.068277+0000","last_undegraded":"2024-09-16T01:55:15.068277+0000","last_fullsized":"2024-09-16T01:55:15.068277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:27.843379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080063+0000","last_change":"2024-09-16T01:55:15.070192+0000","last_active":"2024-09-16T01:55:15.080063+0000","last_peered":"2024-09-16T01:55:15.080063+0000","last_clean":"2024-09-16T01:55:15.080063+0000","last_became_active":"2024-09-16T01:55:15.069764+0000","last_became_peered":"2024-09-16T01:55:15.069764+0000","last_unstale":"2024-09-16T01:55:15.080063+0000","last_undegraded":"2024-09-16T01:55:15.080063+0000","last_fullsized":"2024-09-16T01:55:15.080063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068967+0000","last_change":"2024-09-16T01:55:15.063260+0000","last_active":"2024-09-16T01:55:15.068967+0000","last_peered":"2024-09-16T01:55:15.068967+0000","last_clean":"2024-09-16T01:55:15.068967+0000","last_became_active":"2024-09-16T01:55:15.062964+0000","last_became_peered":"2024-09-16T01:55:15.062964+0000","last_unstale":"2024-09-16T01:55:15.068967+0000","last_undegraded":"2024-09-16T01:55:15.068967+0000","last_fullsized":"2024-09-16T01:55:15.068967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083596+0000","last_change":"2024-09-16T01:55:14.067402+0000","last_active":"2024-09-16T01:55:15.083596+0000","last_peered":"2024-09-16T01:55:15.083596+0000","last_clean":"2024-09-16T01:55:15.083596+0000","last_became_active":"2024-09-16T01:55:14.067117+0000","last_became_peered":"2024-09-16T01:55:14.067117+0000","last_unstale":"2024-09-16T01:55:15.083596+0000","last_undegraded":"2024-09-16T01:55:15.083596+0000","last_fullsized":"2024-09-16T01:55:15.083596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.523320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070015+0000","last_change":"2024-09-16T01:55:15.065086+0000","last_active":"2024-09-16T01:55:15.070015+0000","last_peered":"2024-09-16T01:55:15.070015+0000","last_clean":"2024-09-16T01:55:15.070015+0000","last_became_active":"2024-09-16T01:55:15.064785+0000","last_became_peered":"2024-09-16T01:55:15.064785+0000","last_unstale":"2024-09-16T01:55:15.070015+0000","last_undegraded":"2024-09-16T01:55:15.070015+0000","last_fullsized":"2024-09-16T01:55:15.070015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.084033+0000","last_change":"2024-09-16T01:55:14.068738+0000","last_active":"2024-09-16T01:55:15.084033+0000","last_peered":"2024-09-16T01:55:15.084033+0000","last_clean":"2024-09-16T01:55:15.084033+0000","last_became_active":"2024-09-16T01:55:14.068402+0000","last_became_peered":"2024-09-16T01:55:14.068402+0000","last_unstale":"2024-09-16T01:55:15.084033+0000","last_undegraded":"2024-09-16T01:55:15.084033+0000","last_fullsized":"2024-09-16T01:55:15.084033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:12.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074112+0000","last_change":"2024-09-16T01:55:15.068471+0000","last_active":"2024-09-16T01:55:15.074112+0000","last_peered":"2024-09-16T01:55:15.074112+0000","last_clean":"2024-09-16T01:55:15.074112+0000","last_became_active":"2024-09-16T01:55:15.067998+0000","last_became_peered":"2024-09-16T01:55:15.067998+0000","last_unstale":"2024-09-16T01:55:15.074112+0000","last_undegraded":"2024-09-16T01:55:15.074112+0000","last_fullsized":"2024-09-16T01:55:15.074112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083804+0000","last_change":"2024-09-16T01:55:14.068740+0000","last_active":"2024-09-16T01:55:15.083804+0000","last_peered":"2024-09-16T01:55:15.083804+0000","last_clean":"2024-09-16T01:55:15.083804+0000","last_became_active":"2024-09-16T01:55:14.068436+0000","last_became_peered":"2024-09-16T01:55:14.068436+0000","last_unstale":"2024-09-16T01:55:15.083804+0000","last_undegraded":"2024-09-16T01:55:15.083804+0000","last_fullsized":"2024-09-16T01:55:15.083804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074261+0000","last_change":"2024-09-16T01:55:15.073153+0000","last_active":"2024-09-16T01:55:15.074261+0000","last_peered":"2024-09-16T01:55:15.074261+0000","last_clean":"2024-09-16T01:55:15.074261+0000","last_became_active":"2024-09-16T01:55:15.072869+0000","last_became_peered":"2024-09-16T01:55:15.072869+0000","last_unstale":"2024-09-16T01:55:15.074261+0000","last_undegraded":"2024-09-16T01:55:15.074261+0000","last_fullsized":"2024-09-16T01:55:15.074261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:18.529028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083076+0000","last_change":"2024-09-16T01:55:14.064430+0000","last_active":"2024-09-16T01:55:15.083076+0000","last_peered":"2024-09-16T01:55:15.083076+0000","last_clean":"2024-09-16T01:55:15.083076+0000","last_became_active":"2024-09-16T01:55:14.064050+0000","last_became_peered":"2024-09-16T01:55:14.064050+0000","last_unstale":"2024-09-16T01:55:15.083076+0000","last_undegraded":"2024-09-16T01:55:15.083076+0000","last_fullsized":"2024-09-16T01:55:15.083076+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:08.025192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076149+0000","last_change":"2024-09-16T01:55:15.074074+0000","last_active":"2024-09-16T01:55:15.076149+0000","last_peered":"2024-09-16T01:55:15.076149+0000","last_clean":"2024-09-16T01:55:15.076149+0000","last_became_active":"2024-09-16T01:55:15.068752+0000","last_became_peered":"2024-09-16T01:55:15.068752+0000","last_unstale":"2024-09-16T01:55:15.076149+0000","last_undegraded":"2024-09-16T01:55:15.076149+0000","last_fullsized":"2024-09-16T01:55:15.076149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088009+0000","last_change":"2024-09-16T01:55:14.064060+0000","last_active":"2024-09-16T01:55:15.088009+0000","last_peered":"2024-09-16T01:55:15.088009+0000","last_clean":"2024-09-16T01:55:15.088009+0000","last_became_active":"2024-09-16T01:55:14.063169+0000","last_became_peered":"2024-09-16T01:55:14.063169+0000","last_unstale":"2024-09-16T01:55:15.088009+0000","last_undegraded":"2024-09-16T01:55:15.088009+0000","last_fullsized":"2024-09-16T01:55:15.088009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076409+0000","last_change":"2024-09-16T01:55:15.066922+0000","last_active":"2024-09-16T01:55:15.076409+0000","last_peered":"2024-09-16T01:55:15.076409+0000","last_clean":"2024-09-16T01:55:15.076409+0000","last_became_active":"2024-09-16T01:55:15.063924+0000","last_became_peered":"2024-09-16T01:55:15.063924+0000","last_unstale":"2024-09-16T01:55:15.076409+0000","last_undegraded":"2024-09-16T01:55:15.076409+0000","last_fullsized":"2024-09-16T01:55:15.076409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047981+0000","last_change":"2024-09-16T01:55:13.047981+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047981+0000","last_undegraded":"2024-09-16T01:55:13.047981+0000","last_fullsized":"2024-09-16T01:55:13.047981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.073105+0000","last_change":"2024-09-16T01:55:15.065460+0000","last_active":"2024-09-16T01:55:15.073105+0000","last_peered":"2024-09-16T01:55:15.073105+0000","last_clean":"2024-09-16T01:55:15.073105+0000","last_became_active":"2024-09-16T01:55:15.065203+0000","last_became_peered":"2024-09-16T01:55:15.065203+0000","last_unstale":"2024-09-16T01:55:15.073105+0000","last_undegraded":"2024-09-16T01:55:15.073105+0000","last_fullsized":"2024-09-16T01:55:15.073105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053078+0000","last_change":"2024-09-16T01:55:14.063567+0000","last_active":"2024-09-16T01:55:15.053078+0000","last_peered":"2024-09-16T01:55:15.053078+0000","last_clean":"2024-09-16T01:55:15.053078+0000","last_became_active":"2024-09-16T01:55:14.063264+0000","last_became_peered":"2024-09-16T01:55:14.063264+0000","last_unstale":"2024-09-16T01:55:15.053078+0000","last_undegraded":"2024-09-16T01:55:15.053078+0000","last_fullsized":"2024-09-16T01:55:15.053078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:12.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071322+0000","last_change":"2024-09-16T01:55:15.067811+0000","last_active":"2024-09-16T01:55:15.071322+0000","last_peered":"2024-09-16T01:55:15.071322+0000","last_clean":"2024-09-16T01:55:15.071322+0000","last_became_active":"2024-09-16T01:55:15.067505+0000","last_became_peered":"2024-09-16T01:55:15.067505+0000","last_unstale":"2024-09-16T01:55:15.071322+0000","last_undegraded":"2024-09-16T01:55:15.071322+0000","last_fullsized":"2024-09-16T01:55:15.071322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:33.406715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053269+0000","last_change":"2024-09-16T01:55:14.067645+0000","last_active":"2024-09-16T01:55:15.053269+0000","last_peered":"2024-09-16T01:55:15.053269+0000","last_clean":"2024-09-16T01:55:15.053269+0000","last_became_active":"2024-09-16T01:55:14.067386+0000","last_became_peered":"2024-09-16T01:55:14.067386+0000","last_unstale":"2024-09-16T01:55:15.053269+0000","last_undegraded":"2024-09-16T01:55:15.053269+0000","last_fullsized":"2024-09-16T01:55:15.053269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:19.662035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063284+0000","last_change":"2024-09-16T01:55:15.058622+0000","last_active":"2024-09-16T01:55:16.063284+0000","last_peered":"2024-09-16T01:55:16.063284+0000","last_clean":"2024-09-16T01:55:16.063284+0000","last_became_active":"2024-09-16T01:55:15.057958+0000","last_became_peered":"2024-09-16T01:55:15.057958+0000","last_unstale":"2024-09-16T01:55:16.063284+0000","last_undegraded":"2024-09-16T01:55:16.063284+0000","last_fullsized":"2024-09-16T01:55:16.063284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:54.514922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.057787+0000","last_change":"2024-09-16T01:55:14.057478+0000","last_active":"2024-09-16T01:55:15.057787+0000","last_peered":"2024-09-16T01:55:15.057787+0000","last_clean":"2024-09-16T01:55:15.057787+0000","last_became_active":"2024-09-16T01:55:14.057199+0000","last_became_peered":"2024-09-16T01:55:14.057199+0000","last_unstale":"2024-09-16T01:55:15.057787+0000","last_undegraded":"2024-09-16T01:55:15.057787+0000","last_fullsized":"2024-09-16T01:55:15.057787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:26.749150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.061100+0000","last_change":"2024-09-16T01:55:14.068900+0000","last_active":"2024-09-16T01:55:15.061100+0000","last_peered":"2024-09-16T01:55:15.061100+0000","last_clean":"2024-09-16T01:55:15.061100+0000","last_became_active":"2024-09-16T01:55:14.066896+0000","last_became_peered":"2024-09-16T01:55:14.066896+0000","last_unstale":"2024-09-16T01:55:15.061100+0000","last_undegraded":"2024-09-16T01:55:15.061100+0000","last_fullsized":"2024-09-16T01:55:15.061100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:38.976382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074610+0000","last_change":"2024-09-16T01:55:15.069993+0000","last_active":"2024-09-16T01:55:15.074610+0000","last_peered":"2024-09-16T01:55:15.074610+0000","last_clean":"2024-09-16T01:55:15.074610+0000","last_became_active":"2024-09-16T01:55:15.068922+0000","last_became_peered":"2024-09-16T01:55:15.068922+0000","last_unstale":"2024-09-16T01:55:15.074610+0000","last_undegraded":"2024-09-16T01:55:15.074610+0000","last_fullsized":"2024-09-16T01:55:15.074610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088255+0000","last_change":"2024-09-16T01:55:14.065656+0000","last_active":"2024-09-16T01:55:15.088255+0000","last_peered":"2024-09-16T01:55:15.088255+0000","last_clean":"2024-09-16T01:55:15.088255+0000","last_became_active":"2024-09-16T01:55:14.065390+0000","last_became_peered":"2024-09-16T01:55:14.065390+0000","last_unstale":"2024-09-16T01:55:15.088255+0000","last_undegraded":"2024-09-16T01:55:15.088255+0000","last_fullsized":"2024-09-16T01:55:15.088255+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:17.922515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067977+0000","last_change":"2024-09-16T01:55:15.061491+0000","last_active":"2024-09-16T01:55:15.067977+0000","last_peered":"2024-09-16T01:55:15.067977+0000","last_clean":"2024-09-16T01:55:15.067977+0000","last_became_active":"2024-09-16T01:55:15.060771+0000","last_became_peered":"2024-09-16T01:55:15.060771+0000","last_unstale":"2024-09-16T01:55:15.067977+0000","last_undegraded":"2024-09-16T01:55:15.067977+0000","last_fullsized":"2024-09-16T01:55:15.067977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:27.843379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.089771+0000","last_change":"2024-09-16T01:55:14.066984+0000","last_active":"2024-09-16T01:55:15.089771+0000","last_peered":"2024-09-16T01:55:15.089771+0000","last_clean":"2024-09-16T01:55:15.089771+0000","last_became_active":"2024-09-16T01:55:14.066574+0000","last_became_peered":"2024-09-16T01:55:14.066574+0000","last_unstale":"2024-09-16T01:55:15.089771+0000","last_undegraded":"2024-09-16T01:55:15.089771+0000","last_fullsized":"2024-09-16T01:55:15.089771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:16.713685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076819+0000","last_change":"2024-09-16T01:55:15.075252+0000","last_active":"2024-09-16T01:55:15.076819+0000","last_peered":"2024-09-16T01:55:15.076819+0000","last_clean":"2024-09-16T01:55:15.076819+0000","last_became_active":"2024-09-16T01:55:15.074981+0000","last_became_peered":"2024-09-16T01:55:15.074981+0000","last_unstale":"2024-09-16T01:55:15.076819+0000","last_undegraded":"2024-09-16T01:55:15.076819+0000","last_fullsized":"2024-09-16T01:55:15.076819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080750+0000","last_change":"2024-09-16T01:55:14.065205+0000","last_active":"2024-09-16T01:55:15.080750+0000","last_peered":"2024-09-16T01:55:15.080750+0000","last_clean":"2024-09-16T01:55:15.080750+0000","last_became_active":"2024-09-16T01:55:14.064867+0000","last_became_peered":"2024-09-16T01:55:14.064867+0000","last_unstale":"2024-09-16T01:55:15.080750+0000","last_undegraded":"2024-09-16T01:55:15.080750+0000","last_fullsized":"2024-09-16T01:55:15.080750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:40.415556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070269+0000","last_change":"2024-09-16T01:55:15.065359+0000","last_active":"2024-09-16T01:55:15.070269+0000","last_peered":"2024-09-16T01:55:15.070269+0000","last_clean":"2024-09-16T01:55:15.070269+0000","last_became_active":"2024-09-16T01:55:15.065061+0000","last_became_peered":"2024-09-16T01:55:15.065061+0000","last_unstale":"2024-09-16T01:55:15.070269+0000","last_undegraded":"2024-09-16T01:55:15.070269+0000","last_fullsized":"2024-09-16T01:55:15.070269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054606+0000","last_change":"2024-09-16T01:55:14.070545+0000","last_active":"2024-09-16T01:55:15.054606+0000","last_peered":"2024-09-16T01:55:15.054606+0000","last_clean":"2024-09-16T01:55:15.054606+0000","last_became_active":"2024-09-16T01:55:14.070303+0000","last_became_peered":"2024-09-16T01:55:14.070303+0000","last_unstale":"2024-09-16T01:55:15.054606+0000","last_undegraded":"2024-09-16T01:55:15.054606+0000","last_fullsized":"2024-09-16T01:55:15.054606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:38.976382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.056902+0000","last_change":"2024-09-16T01:55:14.067297+0000","last_active":"2024-09-16T01:55:15.056902+0000","last_peered":"2024-09-16T01:55:15.056902+0000","last_clean":"2024-09-16T01:55:15.056902+0000","last_became_active":"2024-09-16T01:55:14.066981+0000","last_became_peered":"2024-09-16T01:55:14.066981+0000","last_unstale":"2024-09-16T01:55:15.056902+0000","last_undegraded":"2024-09-16T01:55:15.056902+0000","last_fullsized":"2024-09-16T01:55:15.056902+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:17.010112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071281+0000","last_change":"2024-09-16T01:55:15.067563+0000","last_active":"2024-09-16T01:55:15.071281+0000","last_peered":"2024-09-16T01:55:15.071281+0000","last_clean":"2024-09-16T01:55:15.071281+0000","last_became_active":"2024-09-16T01:55:15.066882+0000","last_became_peered":"2024-09-16T01:55:15.066882+0000","last_unstale":"2024-09-16T01:55:15.071281+0000","last_undegraded":"2024-09-16T01:55:15.071281+0000","last_fullsized":"2024-09-16T01:55:15.071281+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:29.313718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047780+0000","last_change":"2024-09-16T01:55:13.047780+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047780+0000","last_undegraded":"2024-09-16T01:55:13.047780+0000","last_fullsized":"2024-09-16T01:55:13.047780+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071149+0000","last_change":"2024-09-16T01:55:15.069351+0000","last_active":"2024-09-16T01:55:15.071149+0000","last_peered":"2024-09-16T01:55:15.071149+0000","last_clean":"2024-09-16T01:55:15.071149+0000","last_became_active":"2024-09-16T01:55:15.068952+0000","last_became_peered":"2024-09-16T01:55:15.068952+0000","last_unstale":"2024-09-16T01:55:15.071149+0000","last_undegraded":"2024-09-16T01:55:15.071149+0000","last_fullsized":"2024-09-16T01:55:15.071149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:53:42.620283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088312+0000","last_change":"2024-09-16T01:55:14.068287+0000","last_active":"2024-09-16T01:55:15.088312+0000","last_peered":"2024-09-16T01:55:15.088312+0000","last_clean":"2024-09-16T01:55:15.088312+0000","last_became_active":"2024-09-16T01:55:14.066615+0000","last_became_peered":"2024-09-16T01:55:14.066615+0000","last_unstale":"2024-09-16T01:55:15.088312+0000","last_undegraded":"2024-09-16T01:55:15.088312+0000","last_fullsized":"2024-09-16T01:55:15.088312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:52.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076931+0000","last_change":"2024-09-16T01:55:15.071381+0000","last_active":"2024-09-16T01:55:15.076931+0000","last_peered":"2024-09-16T01:55:15.076931+0000","last_clean":"2024-09-16T01:55:15.076931+0000","last_became_active":"2024-09-16T01:55:15.071076+0000","last_became_peered":"2024-09-16T01:55:15.071076+0000","last_unstale":"2024-09-16T01:55:15.076931+0000","last_undegraded":"2024-09-16T01:55:15.076931+0000","last_fullsized":"2024-09-16T01:55:15.076931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088343+0000","last_change":"2024-09-16T01:55:14.070457+0000","last_active":"2024-09-16T01:55:15.088343+0000","last_peered":"2024-09-16T01:55:15.088343+0000","last_clean":"2024-09-16T01:55:15.088343+0000","last_became_active":"2024-09-16T01:55:14.070109+0000","last_became_peered":"2024-09-16T01:55:14.070109+0000","last_unstale":"2024-09-16T01:55:15.088343+0000","last_undegraded":"2024-09-16T01:55:15.088343+0000","last_fullsized":"2024-09-16T01:55:15.088343+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.523320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068014+0000","last_change":"2024-09-16T01:55:15.062497+0000","last_active":"2024-09-16T01:55:15.068014+0000","last_peered":"2024-09-16T01:55:15.068014+0000","last_clean":"2024-09-16T01:55:15.068014+0000","last_became_active":"2024-09-16T01:55:15.062232+0000","last_became_peered":"2024-09-16T01:55:15.062232+0000","last_unstale":"2024-09-16T01:55:15.068014+0000","last_undegraded":"2024-09-16T01:55:15.068014+0000","last_fullsized":"2024-09-16T01:55:15.068014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063347+0000","last_change":"2024-09-16T01:55:14.069579+0000","last_active":"2024-09-16T01:55:16.063347+0000","last_peered":"2024-09-16T01:55:16.063347+0000","last_clean":"2024-09-16T01:55:16.063347+0000","last_became_active":"2024-09-16T01:55:14.069262+0000","last_became_peered":"2024-09-16T01:55:14.069262+0000","last_unstale":"2024-09-16T01:55:16.063347+0000","last_undegraded":"2024-09-16T01:55:16.063347+0000","last_fullsized":"2024-09-16T01:55:16.063347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:18.137110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063308+0000","last_change":"2024-09-16T01:55:15.061094+0000","last_active":"2024-09-16T01:55:16.063308+0000","last_peered":"2024-09-16T01:55:16.063308+0000","last_clean":"2024-09-16T01:55:16.063308+0000","last_became_active":"2024-09-16T01:55:15.060812+0000","last_became_peered":"2024-09-16T01:55:15.060812+0000","last_unstale":"2024-09-16T01:55:16.063308+0000","last_undegraded":"2024-09-16T01:55:16.063308+0000","last_fullsized":"2024-09-16T01:55:16.063308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:52.593075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054332+0000","last_change":"2024-09-16T01:55:14.064373+0000","last_active":"2024-09-16T01:55:15.054332+0000","last_peered":"2024-09-16T01:55:15.054332+0000","last_clean":"2024-09-16T01:55:15.054332+0000","last_became_active":"2024-09-16T01:55:14.064081+0000","last_became_peered":"2024-09-16T01:55:14.064081+0000","last_unstale":"2024-09-16T01:55:15.054332+0000","last_undegraded":"2024-09-16T01:55:15.054332+0000","last_fullsized":"2024-09-16T01:55:15.054332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:17.922515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063132+0000","last_change":"2024-09-16T01:55:14.064714+0000","last_active":"2024-09-16T01:55:16.063132+0000","last_peered":"2024-09-16T01:55:16.063132+0000","last_clean":"2024-09-16T01:55:16.063132+0000","last_became_active":"2024-09-16T01:55:14.064423+0000","last_became_peered":"2024-09-16T01:55:14.064423+0000","last_unstale":"2024-09-16T01:55:16.063132+0000","last_undegraded":"2024-09-16T01:55:16.063132+0000","last_fullsized":"2024-09-16T01:55:16.063132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:02.564362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072354+0000","last_change":"2024-09-16T01:55:15.068101+0000","last_active":"2024-09-16T01:55:15.072354+0000","last_peered":"2024-09-16T01:55:15.072354+0000","last_clean":"2024-09-16T01:55:15.072354+0000","last_became_active":"2024-09-16T01:55:15.067812+0000","last_became_peered":"2024-09-16T01:55:15.067812+0000","last_unstale":"2024-09-16T01:55:15.072354+0000","last_undegraded":"2024-09-16T01:55:15.072354+0000","last_fullsized":"2024-09-16T01:55:15.072354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063005+0000","last_change":"2024-09-16T01:55:14.063203+0000","last_active":"2024-09-16T01:55:16.063005+0000","last_peered":"2024-09-16T01:55:16.063005+0000","last_clean":"2024-09-16T01:55:16.063005+0000","last_became_active":"2024-09-16T01:55:14.062940+0000","last_became_peered":"2024-09-16T01:55:14.062940+0000","last_unstale":"2024-09-16T01:55:16.063005+0000","last_undegraded":"2024-09-16T01:55:16.063005+0000","last_fullsized":"2024-09-16T01:55:16.063005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:56.080694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075848+0000","last_change":"2024-09-16T01:55:15.071198+0000","last_active":"2024-09-16T01:55:15.075848+0000","last_peered":"2024-09-16T01:55:15.075848+0000","last_clean":"2024-09-16T01:55:15.075848+0000","last_became_active":"2024-09-16T01:55:15.070942+0000","last_became_peered":"2024-09-16T01:55:15.070942+0000","last_unstale":"2024-09-16T01:55:15.075848+0000","last_undegraded":"2024-09-16T01:55:15.075848+0000","last_fullsized":"2024-09-16T01:55:15.075848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:26.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.048045+0000","last_change":"2024-09-16T01:55:13.048045+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.048045+0000","last_undegraded":"2024-09-16T01:55:13.048045+0000","last_fullsized":"2024-09-16T01:55:13.048045+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071304+0000","last_change":"2024-09-16T01:55:15.067797+0000","last_active":"2024-09-16T01:55:15.071304+0000","last_peered":"2024-09-16T01:55:15.071304+0000","last_clean":"2024-09-16T01:55:15.071304+0000","last_became_active":"2024-09-16T01:55:15.067256+0000","last_became_peered":"2024-09-16T01:55:15.067256+0000","last_unstale":"2024-09-16T01:55:15.071304+0000","last_undegraded":"2024-09-16T01:55:15.071304+0000","last_fullsized":"2024-09-16T01:55:15.071304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.571746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.062931+0000","last_change":"2024-09-16T01:55:14.061458+0000","last_active":"2024-09-16T01:55:16.062931+0000","last_peered":"2024-09-16T01:55:16.062931+0000","last_clean":"2024-09-16T01:55:16.062931+0000","last_became_active":"2024-09-16T01:55:14.061101+0000","last_became_peered":"2024-09-16T01:55:14.061101+0000","last_unstale":"2024-09-16T01:55:16.062931+0000","last_undegraded":"2024-09-16T01:55:16.062931+0000","last_fullsized":"2024-09-16T01:55:16.062931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:13.570291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.078125+0000","last_change":"2024-09-16T01:55:15.072888+0000","last_active":"2024-09-16T01:55:15.078125+0000","last_peered":"2024-09-16T01:55:15.078125+0000","last_clean":"2024-09-16T01:55:15.078125+0000","last_became_active":"2024-09-16T01:55:15.072571+0000","last_became_peered":"2024-09-16T01:55:15.072571+0000","last_unstale":"2024-09-16T01:55:15.078125+0000","last_undegraded":"2024-09-16T01:55:15.078125+0000","last_fullsized":"2024-09-16T01:55:15.078125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088241+0000","last_change":"2024-09-16T01:55:14.066143+0000","last_active":"2024-09-16T01:55:15.088241+0000","last_peered":"2024-09-16T01:55:15.088241+0000","last_clean":"2024-09-16T01:55:15.088241+0000","last_became_active":"2024-09-16T01:55:14.065838+0000","last_became_peered":"2024-09-16T01:55:14.065838+0000","last_unstale":"2024-09-16T01:55:15.088241+0000","last_undegraded":"2024-09-16T01:55:15.088241+0000","last_fullsized":"2024-09-16T01:55:15.088241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:07.689683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073154+0000","last_change":"2024-09-16T01:55:14.064101+0000","last_active":"2024-09-16T01:55:16.073154+0000","last_peered":"2024-09-16T01:55:16.073154+0000","last_clean":"2024-09-16T01:55:16.073154+0000","last_became_active":"2024-09-16T01:55:14.063782+0000","last_became_peered":"2024-09-16T01:55:14.063782+0000","last_unstale":"2024-09-16T01:55:16.073154+0000","last_undegraded":"2024-09-16T01:55:16.073154+0000","last_fullsized":"2024-09-16T01:55:16.073154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:53.149175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070227+0000","last_change":"2024-09-16T01:55:15.066052+0000","last_active":"2024-09-16T01:55:15.070227+0000","last_peered":"2024-09-16T01:55:15.070227+0000","last_clean":"2024-09-16T01:55:15.070227+0000","last_became_active":"2024-09-16T01:55:15.065771+0000","last_became_peered":"2024-09-16T01:55:15.065771+0000","last_unstale":"2024-09-16T01:55:15.070227+0000","last_undegraded":"2024-09-16T01:55:15.070227+0000","last_fullsized":"2024-09-16T01:55:15.070227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:22.978110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.059430+0000","last_change":"2024-09-16T01:55:14.064829+0000","last_active":"2024-09-16T01:55:15.059430+0000","last_peered":"2024-09-16T01:55:15.059430+0000","last_clean":"2024-09-16T01:55:15.059430+0000","last_became_active":"2024-09-16T01:55:14.064531+0000","last_became_peered":"2024-09-16T01:55:14.064531+0000","last_unstale":"2024-09-16T01:55:15.059430+0000","last_undegraded":"2024-09-16T01:55:15.059430+0000","last_fullsized":"2024-09-16T01:55:15.059430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:41.155579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076798+0000","last_change":"2024-09-16T01:55:15.074355+0000","last_active":"2024-09-16T01:55:15.076798+0000","last_peered":"2024-09-16T01:55:15.076798+0000","last_clean":"2024-09-16T01:55:15.076798+0000","last_became_active":"2024-09-16T01:55:15.071086+0000","last_became_peered":"2024-09-16T01:55:15.071086+0000","last_unstale":"2024-09-16T01:55:15.076798+0000","last_undegraded":"2024-09-16T01:55:15.076798+0000","last_fullsized":"2024-09-16T01:55:15.076798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.062153+0000","last_change":"2024-09-16T01:55:14.067246+0000","last_active":"2024-09-16T01:55:15.062153+0000","last_peered":"2024-09-16T01:55:15.062153+0000","last_clean":"2024-09-16T01:55:15.062153+0000","last_became_active":"2024-09-16T01:55:14.066819+0000","last_became_peered":"2024-09-16T01:55:14.066819+0000","last_unstale":"2024-09-16T01:55:15.062153+0000","last_undegraded":"2024-09-16T01:55:15.062153+0000","last_fullsized":"2024-09-16T01:55:15.062153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072435+0000","last_change":"2024-09-16T01:55:15.069885+0000","last_active":"2024-09-16T01:55:15.072435+0000","last_peered":"2024-09-16T01:55:15.072435+0000","last_clean":"2024-09-16T01:55:15.072435+0000","last_became_active":"2024-09-16T01:55:15.068666+0000","last_became_peered":"2024-09-16T01:55:15.068666+0000","last_unstale":"2024-09-16T01:55:15.072435+0000","last_undegraded":"2024-09-16T01:55:15.072435+0000","last_fullsized":"2024-09-16T01:55:15.072435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.059227+0000","last_change":"2024-09-16T01:55:14.064031+0000","last_active":"2024-09-16T01:55:15.059227+0000","last_peered":"2024-09-16T01:55:15.059227+0000","last_clean":"2024-09-16T01:55:15.059227+0000","last_became_active":"2024-09-16T01:55:14.063686+0000","last_became_peered":"2024-09-16T01:55:14.063686+0000","last_unstale":"2024-09-16T01:55:15.059227+0000","last_undegraded":"2024-09-16T01:55:15.059227+0000","last_fullsized":"2024-09-16T01:55:15.059227+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:19.662035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.062236+0000","last_change":"2024-09-16T01:55:15.058905+0000","last_active":"2024-09-16T01:55:15.062236+0000","last_peered":"2024-09-16T01:55:15.062236+0000","last_clean":"2024-09-16T01:55:15.062236+0000","last_became_active":"2024-09-16T01:55:15.058632+0000","last_became_peered":"2024-09-16T01:55:15.058632+0000","last_unstale":"2024-09-16T01:55:15.062236+0000","last_undegraded":"2024-09-16T01:55:15.062236+0000","last_fullsized":"2024-09-16T01:55:15.062236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:13.646813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053762+0000","last_change":"2024-09-16T01:55:14.064739+0000","last_active":"2024-09-16T01:55:15.053762+0000","last_peered":"2024-09-16T01:55:15.053762+0000","last_clean":"2024-09-16T01:55:15.053762+0000","last_became_active":"2024-09-16T01:55:14.064446+0000","last_became_peered":"2024-09-16T01:55:14.064446+0000","last_unstale":"2024-09-16T01:55:15.053762+0000","last_undegraded":"2024-09-16T01:55:15.053762+0000","last_fullsized":"2024-09-16T01:55:15.053762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:41.155579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054832+0000","last_change":"2024-09-16T01:55:14.057198+0000","last_active":"2024-09-16T01:55:15.054832+0000","last_peered":"2024-09-16T01:55:15.054832+0000","last_clean":"2024-09-16T01:55:15.054832+0000","last_became_active":"2024-09-16T01:55:14.056723+0000","last_became_peered":"2024-09-16T01:55:14.056723+0000","last_unstale":"2024-09-16T01:55:15.054832+0000","last_undegraded":"2024-09-16T01:55:15.054832+0000","last_fullsized":"2024-09-16T01:55:15.054832+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:53.464988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076035+0000","last_change":"2024-09-16T01:55:15.074182+0000","last_active":"2024-09-16T01:55:15.076035+0000","last_peered":"2024-09-16T01:55:15.076035+0000","last_clean":"2024-09-16T01:55:15.076035+0000","last_became_active":"2024-09-16T01:55:15.073915+0000","last_became_peered":"2024-09-16T01:55:15.073915+0000","last_unstale":"2024-09-16T01:55:15.076035+0000","last_undegraded":"2024-09-16T01:55:15.076035+0000","last_fullsized":"2024-09-16T01:55:15.076035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:29.313718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047989+0000","last_change":"2024-09-16T01:55:13.047989+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047989+0000","last_undegraded":"2024-09-16T01:55:13.047989+0000","last_fullsized":"2024-09-16T01:55:13.047989+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T01:55:13.048552+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:55:13.048552+0000","last_peered":"2024-09-16T01:55:13.048552+0000","last_clean":"2024-09-16T01:55:13.048552+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:55:13.048552+0000","last_undegraded":"2024-09-16T01:55:13.048552+0000","last_fullsized":"2024-09-16T01:55:13.048552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":434176,"data_stored":180254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":178608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":761809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":755142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":434176,"data_stored":185370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:55:18.740 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-09-16T01:55:18.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:14.040041+0000', 'last_change': '2024-09-16T01:55:14.040041+0000', 'last_active': '2024-09-16T01:55:14.040041+0000', 'last_peered': '2024-09-16T01:55:14.040041+0000', 'last_clean': '2024-09-16T01:55:14.040041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:14.040041+0000', 'last_undegraded': '2024-09-16T01:55:14.040041+0000', 'last_fullsized': '2024-09-16T01:55:14.040041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:55:18.740 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-09-16T01:55:18.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:14.040041+0000', 'last_change': '2024-09-16T01:55:14.040041+0000', 'last_active': '2024-09-16T01:55:14.040041+0000', 'last_peered': '2024-09-16T01:55:14.040041+0000', 'last_clean': '2024-09-16T01:55:14.040041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:14.040041+0000', 'last_undegraded': '2024-09-16T01:55:14.040041+0000', 'last_fullsized': '2024-09-16T01:55:14.040041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:14.040041+0000', 'last_change': '2024-09-16T01:55:14.040041+0000', 'last_active': '2024-09-16T01:55:14.040041+0000', 'last_peered': '2024-09-16T01:55:14.040041+0000', 'last_clean': '2024-09-16T01:55:14.040041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:14.040041+0000', 'last_undegraded': '2024-09-16T01:55:14.040041+0000', 'last_fullsized': '2024-09-16T01:55:14.040041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:14.040041+0000', 'last_change': '2024-09-16T01:55:14.040041+0000', 'last_active': '2024-09-16T01:55:14.040041+0000', 'last_peered': '2024-09-16T01:55:14.040041+0000', 'last_clean': '2024-09-16T01:55:14.040041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:14.040041+0000', 'last_undegraded': '2024-09-16T01:55:14.040041+0000', 'last_fullsized': '2024-09-16T01:55:14.040041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:14.040041+0000', 'last_change': '2024-09-16T01:55:14.040041+0000', 'last_active': '2024-09-16T01:55:14.040041+0000', 'last_peered': '2024-09-16T01:55:14.040041+0000', 'last_clean': '2024-09-16T01:55:14.040041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:14.040041+0000', 'last_undegraded': '2024-09-16T01:55:14.040041+0000', 'last_fullsized': '2024-09-16T01:55:14.040041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:55:13.047981+0000', 'last_change': '2024-09-16T01:55:13.047981+0000', 'last_active': '2024-09-16T01:55:13.034548+0000', 'last_peered': '2024-09-16T01:55:13.034548+0000', 'last_clean': '2024-09-16T01:55:13.034548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:13.047981+0000', 'last_undegraded': '2024-09-16T01:55:13.047981+0000', 'last_fullsized': '2024-09-16T01:55:13.047981+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:14.040041+0000', 'last_change': '2024-09-16T01:55:14.040041+0000', 'last_active': '2024-09-16T01:55:14.040041+0000', 'last_peered': '2024-09-16T01:55:14.040041+0000', 'last_clean': '2024-09-16T01:55:14.040041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:14.040041+0000', 'last_undegraded': '2024-09-16T01:55:14.040041+0000', 'last_fullsized': '2024-09-16T01:55:14.040041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-09-16T01:55:18.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:14.040041+0000', 'last_change': '2024-09-16T01:55:14.040041+0000', 'last_active': '2024-09-16T01:55:14.040041+0000', 'last_peered': '2024-09-16T01:55:14.040041+0000', 'last_clean': '2024-09-16T01:55:14.040041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:14.040041+0000', 'last_undegraded': '2024-09-16T01:55:14.040041+0000', 'last_fullsized': '2024-09-16T01:55:14.040041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:55:18.742 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-16T01:55:18.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:55:13.047780+0000', 'last_change': '2024-09-16T01:55:13.047780+0000', 'last_active': '2024-09-16T01:55:13.034548+0000', 'last_peered': '2024-09-16T01:55:13.034548+0000', 'last_clean': '2024-09-16T01:55:13.034548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:13.047780+0000', 'last_undegraded': '2024-09-16T01:55:13.047780+0000', 'last_fullsized': '2024-09-16T01:55:13.047780+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:55:18.743 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-09-16T01:55:18.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:14.040041+0000', 'last_change': '2024-09-16T01:55:14.040041+0000', 'last_active': '2024-09-16T01:55:14.040041+0000', 'last_peered': '2024-09-16T01:55:14.040041+0000', 'last_clean': '2024-09-16T01:55:14.040041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:14.040041+0000', 'last_undegraded': '2024-09-16T01:55:14.040041+0000', 'last_fullsized': '2024-09-16T01:55:14.040041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:55:18.743 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-16T01:55:18.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:55:13.048045+0000', 'last_change': '2024-09-16T01:55:13.048045+0000', 'last_active': '2024-09-16T01:55:13.034548+0000', 'last_peered': '2024-09-16T01:55:13.034548+0000', 'last_clean': '2024-09-16T01:55:13.034548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:13.048045+0000', 'last_undegraded': '2024-09-16T01:55:13.048045+0000', 'last_fullsized': '2024-09-16T01:55:13.048045+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:55:18.743 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-09-16T01:55:18.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:14.040041+0000', 'last_change': '2024-09-16T01:55:14.040041+0000', 'last_active': '2024-09-16T01:55:14.040041+0000', 'last_peered': '2024-09-16T01:55:14.040041+0000', 'last_clean': '2024-09-16T01:55:14.040041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:14.040041+0000', 'last_undegraded': '2024-09-16T01:55:14.040041+0000', 'last_fullsized': '2024-09-16T01:55:14.040041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:55:18.743 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-09-16T01:55:18.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:14.040041+0000', 'last_change': '2024-09-16T01:55:14.040041+0000', 'last_active': '2024-09-16T01:55:14.040041+0000', 'last_peered': '2024-09-16T01:55:14.040041+0000', 'last_clean': '2024-09-16T01:55:14.040041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:14.040041+0000', 'last_undegraded': '2024-09-16T01:55:14.040041+0000', 'last_fullsized': '2024-09-16T01:55:14.040041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:14.040041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:55:18.743 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-16T01:55:18.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:55:13.047989+0000', 'last_change': '2024-09-16T01:55:13.047989+0000', 'last_active': '2024-09-16T01:55:13.034548+0000', 'last_peered': '2024-09-16T01:55:13.034548+0000', 'last_clean': '2024-09-16T01:55:13.034548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:13.047989+0000', 'last_undegraded': '2024-09-16T01:55:13.047989+0000', 'last_fullsized': '2024-09-16T01:55:13.047989+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:13.034548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:55:18.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T01:55:18.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.877+0000 7f046ac8b640 1 Processor -- start 2024-09-16T01:55:18.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.877+0000 7f046ac8b640 1 -- start start 2024-09-16T01:55:18.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.877+0000 7f046ac8b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0464161c80 0x7f046406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.877+0000 7f046ac8b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0464162060 0x7f04640b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.877+0000 7f046ac8b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046406e870 con 0x7f04640b64b0 2024-09-16T01:55:18.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.877+0000 7f046ac8b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f046406d9f0 con 0x7f0464162060 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.877+0000 7f046ac8b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f046406dcd0 con 0x7f0464161c80 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.878+0000 7f0463fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0464162060 0x7f04640b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.878+0000 7f0463fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0464162060 0x7f04640b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48002/0 (socket says 172.21.15.42:48002) 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.878+0000 7f0463fff640 1 -- 172.21.15.42:0/2244935951 learned_addr learned my addr 172.21.15.42:0/2244935951 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.878+0000 7f0468a27640 1 --2- 172.21.15.42:0/2244935951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0464161c80 0x7f046406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.878+0000 7f0463fff640 1 -- 172.21.15.42:0/2244935951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0464161c80 msgr2=0x7f046406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.878+0000 7f0463fff640 1 --2- 172.21.15.42:0/2244935951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0464161c80 0x7f046406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.878+0000 7f0463fff640 1 -- 172.21.15.42:0/2244935951 >> v1:172.21.15.107:6789/0 conn(0x7f04640b64b0 legacy=0x7f0464162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.878+0000 7f0463fff640 1 -- 172.21.15.42:0/2244935951 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046406dfb0 con 0x7f0464162060 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.878+0000 7f0468a27640 1 --2- 172.21.15.42:0/2244935951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0464161c80 0x7f046406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.879+0000 7f0463fff640 1 --2- 172.21.15.42:0/2244935951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464162060 0x7f04640b5f70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0454009e50 tx=0x7f045402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1daf81e5e4349e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:18.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.879+0000 7f04637fe640 1 -- 172.21.15.42:0/2244935951 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454036070 con 0x7f0464162060 2024-09-16T01:55:18.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.879+0000 7f04637fe640 1 -- 172.21.15.42:0/2244935951 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0454031600 con 0x7f0464162060 2024-09-16T01:55:18.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.879+0000 7f04637fe640 1 -- 172.21.15.42:0/2244935951 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04540319d0 con 0x7f0464162060 2024-09-16T01:55:18.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.879+0000 7f046ac8b640 1 -- 172.21.15.42:0/2244935951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464162060 msgr2=0x7f04640b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.879+0000 7f046ac8b640 1 --2- 172.21.15.42:0/2244935951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464162060 0x7f04640b5f70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0454009e50 tx=0x7f045402a710 comp rx=0 tx=0).stop 2024-09-16T01:55:18.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.879+0000 7f046ac8b640 1 -- 172.21.15.42:0/2244935951 shutdown_connections 2024-09-16T01:55:18.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.879+0000 7f046ac8b640 1 --2- 172.21.15.42:0/2244935951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464162060 0x7f04640b5f70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.879+0000 7f046ac8b640 1 --2- 172.21.15.42:0/2244935951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0464161c80 0x7f046406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.879+0000 7f046ac8b640 1 -- 172.21.15.42:0/2244935951 >> 172.21.15.42:0/2244935951 conn(0x7f04640d44f0 msgr2=0x7f04640d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:18.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.880+0000 7f046ac8b640 1 -- 172.21.15.42:0/2244935951 shutdown_connections 2024-09-16T01:55:18.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.880+0000 7f046ac8b640 1 -- 172.21.15.42:0/2244935951 wait complete. 2024-09-16T01:55:18.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.881+0000 7f046ac8b640 1 Processor -- start 2024-09-16T01:55:18.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.881+0000 7f046ac8b640 1 -- start start 2024-09-16T01:55:18.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f046ac8b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04640b64b0 0x7f0464155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f046ac8b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464161c80 0x7f04640cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f046ac8b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0464162060 0x7f04640b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f046ac8b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04640d2a10 con 0x7f0464161c80 2024-09-16T01:55:18.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f046ac8b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f04640d2890 con 0x7f0464162060 2024-09-16T01:55:18.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f046ac8b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f04640b6960 con 0x7f04640b64b0 2024-09-16T01:55:18.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0463fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464161c80 0x7f04640cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0463fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464161c80 0x7f04640cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48004/0 (socket says 172.21.15.42:48004) 2024-09-16T01:55:18.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0463fff640 1 -- 172.21.15.42:0/693185314 learned_addr learned my addr 172.21.15.42:0/693185314 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:18.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0468a27640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04640b64b0 0x7f0464155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0469228640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0464162060 0x7f04640b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0463fff640 1 -- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04640b64b0 msgr2=0x7f0464155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0463fff640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04640b64b0 0x7f0464155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0463fff640 1 -- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0464162060 msgr2=0x7f04640b96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:18.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0463fff640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0464162060 0x7f04640b96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:18.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0463fff640 1 -- 172.21.15.42:0/693185314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04640b7760 con 0x7f0464161c80 2024-09-16T01:55:18.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0469228640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0464162060 0x7f04640b96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:18.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f0463fff640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464161c80 0x7f04640cbf20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0454034040 tx=0x7f0454004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:18.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f04617fa640 1 -- 172.21.15.42:0/693185314 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454041020 con 0x7f0464161c80 2024-09-16T01:55:18.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f04617fa640 1 -- 172.21.15.42:0/693185314 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0454007800 con 0x7f0464161c80 2024-09-16T01:55:18.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f046ac8b640 1 -- 172.21.15.42:0/693185314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04640b7a40 con 0x7f0464161c80 2024-09-16T01:55:18.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.882+0000 7f04617fa640 1 -- 172.21.15.42:0/693185314 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454036040 con 0x7f0464161c80 2024-09-16T01:55:18.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.883+0000 7f046ac8b640 1 -- 172.21.15.42:0/693185314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04640b8000 con 0x7f0464161c80 2024-09-16T01:55:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.884+0000 7f046ac8b640 1 -- 172.21.15.42:0/693185314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04640b8240 con 0x7f0464161c80 2024-09-16T01:55:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.884+0000 7f04617fa640 1 -- 172.21.15.42:0/693185314 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0454044020 con 0x7f0464161c80 2024-09-16T01:55:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.885+0000 7f04617fa640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f044406c2b0 0x7f044406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.885+0000 7f04617fa640 1 -- 172.21.15.42:0/693185314 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f04540ac240 con 0x7f0464161c80 2024-09-16T01:55:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.885+0000 7f0468a27640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f044406c2b0 0x7f044406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:18.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.885+0000 7f0468a27640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f044406c2b0 0x7f044406e770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f044c006fd0 tx=0x7f044c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:18.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:18.889+0000 7f04617fa640 1 -- 172.21.15.42:0/693185314 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f045404b030 con 0x7f0464161c80 2024-09-16T01:55:19.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.134+0000 7f046ac8b640 1 -- 172.21.15.42:0/693185314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f046406e330 con 0x7f0464161c80 2024-09-16T01:55:19.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.134+0000 7f04617fa640 1 -- 172.21.15.42:0/693185314 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1765 (secure 0 0 0) 0x7f045407a810 con 0x7f0464161c80 2024-09-16T01:55:19.136 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:19.137 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":80,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1726451649,"num_in_osds":8,"osd_in_since":1726451640,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":83},{"state_name":"unknown","count":10},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592778,"bytes_used":242970624,"bytes_avail":772851142656,"bytes_total":773094113280,"unknown_pgs_ratio":0.10309278219938278,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":2745,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":15,"btime":"2024-09-16T01:55:17:061679+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":34562}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-16T01:55:12.261235+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T01:55:19.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 -- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f044406c2b0 msgr2=0x7f044406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:19.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f044406c2b0 0x7f044406e770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f044c006fd0 tx=0x7f044c008040 comp rx=0 tx=0).stop 2024-09-16T01:55:19.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 -- 172.21.15.42:0/693185314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464161c80 msgr2=0x7f04640cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:19.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464161c80 0x7f04640cbf20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0454034040 tx=0x7f0454004a40 comp rx=0 tx=0).stop 2024-09-16T01:55:19.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 -- 172.21.15.42:0/693185314 shutdown_connections 2024-09-16T01:55:19.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f044406c2b0 0x7f044406e770 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0464162060 0x7f04640b96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0464161c80 0x7f04640cbf20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 --2- 172.21.15.42:0/693185314 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f04640b64b0 0x7f0464155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 -- 172.21.15.42:0/693185314 >> 172.21.15.42:0/693185314 conn(0x7f04640d44f0 msgr2=0x7f04640b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:19.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 -- 172.21.15.42:0/693185314 shutdown_connections 2024-09-16T01:55:19.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.136+0000 7f046ac8b640 1 -- 172.21.15.42:0/693185314 wait complete. 2024-09-16T01:55:19.149 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T01:55:19.149 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:55:19.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.250+0000 7f976d83c640 1 Processor -- start 2024-09-16T01:55:19.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.250+0000 7f976d83c640 1 -- start start 2024-09-16T01:55:19.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f976d83c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f976815e5f0 0x7f97680d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:19.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f976d83c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f97680b6690 0x7f976806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:19.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f976d83c640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97680d3690 con 0x7f97680d30f0 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f976d83c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f976806d530 con 0x7f976815e5f0 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f976d83c640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f97680d3970 con 0x7f97680b6690 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f9766ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f976815e5f0 0x7f97680d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f9766ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f976815e5f0 0x7f97680d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48010/0 (socket says 172.21.15.42:48010) 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f9766ffd640 1 -- 172.21.15.42:0/702716978 learned_addr learned my addr 172.21.15.42:0/702716978 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f97677fe640 1 --2- 172.21.15.42:0/702716978 >> v2:172.21.15.107:3300/0 conn(0x7f97680b6690 0x7f976806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f9766ffd640 1 -- 172.21.15.42:0/702716978 >> v2:172.21.15.107:3300/0 conn(0x7f97680b6690 msgr2=0x7f976806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f9766ffd640 1 --2- 172.21.15.42:0/702716978 >> v2:172.21.15.107:3300/0 conn(0x7f97680b6690 0x7f976806d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f9766ffd640 1 -- 172.21.15.42:0/702716978 >> v1:172.21.15.107:6789/0 conn(0x7f97680d30f0 legacy=0x7f97680b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.251+0000 7f9766ffd640 1 -- 172.21.15.42:0/702716978 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976806cee0 con 0x7f976815e5f0 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.252+0000 7f9766ffd640 1 --2- 172.21.15.42:0/702716978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 0x7f97680d4dd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9758009e50 tx=0x7f975802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f92ab1d0e23447 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:19.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.252+0000 7f9765ffb640 1 -- 172.21.15.42:0/702716978 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758036070 con 0x7f976815e5f0 2024-09-16T01:55:19.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.252+0000 7f9765ffb640 1 -- 172.21.15.42:0/702716978 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9758031600 con 0x7f976815e5f0 2024-09-16T01:55:19.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.252+0000 7f9765ffb640 1 -- 172.21.15.42:0/702716978 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97580319d0 con 0x7f976815e5f0 2024-09-16T01:55:19.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.253+0000 7f976d83c640 1 -- 172.21.15.42:0/702716978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 msgr2=0x7f97680d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:19.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.253+0000 7f976d83c640 1 --2- 172.21.15.42:0/702716978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 0x7f97680d4dd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9758009e50 tx=0x7f975802a760 comp rx=0 tx=0).stop 2024-09-16T01:55:19.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.253+0000 7f976d83c640 1 -- 172.21.15.42:0/702716978 shutdown_connections 2024-09-16T01:55:19.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.253+0000 7f976d83c640 1 --2- 172.21.15.42:0/702716978 >> v2:172.21.15.107:3300/0 conn(0x7f97680b6690 0x7f976806d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.253+0000 7f976d83c640 1 --2- 172.21.15.42:0/702716978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 0x7f97680d4dd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.253+0000 7f976d83c640 1 -- 172.21.15.42:0/702716978 >> 172.21.15.42:0/702716978 conn(0x7f976808bfc0 msgr2=0x7f97680d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:19.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.253+0000 7f976d83c640 1 -- 172.21.15.42:0/702716978 shutdown_connections 2024-09-16T01:55:19.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.253+0000 7f976d83c640 1 -- 172.21.15.42:0/702716978 wait complete. 2024-09-16T01:55:19.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.254+0000 7f976d83c640 1 Processor -- start 2024-09-16T01:55:19.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.254+0000 7f976d83c640 1 -- start start 2024-09-16T01:55:19.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f976d83c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97680b6690 0x7f97680a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f976d83c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97680d30f0 0x7f97680b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f976d83c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 0x7f976809e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f976d83c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f97680d5310 con 0x7f976815e5f0 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f976d83c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f976815e9d0 con 0x7f97680d30f0 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f976d83c640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f976806df00 con 0x7f97680b6690 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f97677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 0x7f976809e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f97677fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 0x7f976809e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48024/0 (socket says 172.21.15.42:48024) 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f97677fe640 1 -- 172.21.15.42:0/2710020292 learned_addr learned my addr 172.21.15.42:0/2710020292 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f9766ffd640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97680b6690 0x7f97680a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f97667fc640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97680d30f0 0x7f97680b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f97677fe640 1 -- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97680b6690 msgr2=0x7f97680a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:19.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f97677fe640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97680b6690 0x7f97680a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f97677fe640 1 -- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97680d30f0 msgr2=0x7f97680b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f97677fe640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97680d30f0 0x7f97680b97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f97677fe640 1 -- 172.21.15.42:0/2710020292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97680b8720 con 0x7f976815e5f0 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.255+0000 7f97667fc640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97680d30f0 0x7f97680b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.256+0000 7f97677fe640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 0x7f976809e450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f976000d5d0 tx=0x7f976000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.256+0000 7f974ffff640 1 -- 172.21.15.42:0/2710020292 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600125f0 con 0x7f976815e5f0 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.256+0000 7f974ffff640 1 -- 172.21.15.42:0/2710020292 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9760019070 con 0x7f976815e5f0 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.256+0000 7f976d83c640 1 -- 172.21.15.42:0/2710020292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97680b8a00 con 0x7f976815e5f0 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.256+0000 7f974ffff640 1 -- 172.21.15.42:0/2710020292 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600129d0 con 0x7f976815e5f0 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.256+0000 7f976d83c640 1 -- 172.21.15.42:0/2710020292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97680b8fc0 con 0x7f976815e5f0 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.257+0000 7f976d83c640 1 -- 172.21.15.42:0/2710020292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f976806d9a0 con 0x7f976815e5f0 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.257+0000 7f974ffff640 1 -- 172.21.15.42:0/2710020292 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9760012b70 con 0x7f976815e5f0 2024-09-16T01:55:19.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.258+0000 7f974ffff640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f975406c2b0 0x7f975406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:19.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.258+0000 7f974ffff640 1 -- 172.21.15.42:0/2710020292 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f976008b930 con 0x7f976815e5f0 2024-09-16T01:55:19.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.258+0000 7f9766ffd640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f975406c2b0 0x7f975406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:19.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.259+0000 7f9766ffd640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f975406c2b0 0x7f975406e770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9758033000 tx=0x7f9758009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:19.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.262+0000 7f974ffff640 1 -- 172.21.15.42:0/2710020292 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9760059f10 con 0x7f976815e5f0 2024-09-16T01:55:19.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.433+0000 7f976d83c640 1 -- 172.21.15.42:0/2710020292 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97680b4450 con 0x7f975406c2b0 2024-09-16T01:55:19.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.440+0000 7f974ffff640 1 -- 172.21.15.42:0/2710020292 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250188 (secure 0 0 0) 0x7f97680b4450 con 0x7f975406c2b0 2024-09-16T01:55:19.444 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:19.445 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 -- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f975406c2b0 msgr2=0x7f975406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f975406c2b0 0x7f975406e770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9758033000 tx=0x7f9758009000 comp rx=0 tx=0).stop 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 -- 172.21.15.42:0/2710020292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 msgr2=0x7f976809e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 0x7f976809e450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f976000d5d0 tx=0x7f976000da90 comp rx=0 tx=0).stop 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 -- 172.21.15.42:0/2710020292 shutdown_connections 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f975406c2b0 0x7f975406e770 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f976815e5f0 0x7f976809e450 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97680d30f0 0x7f97680b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 --2- 172.21.15.42:0/2710020292 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f97680b6690 0x7f97680a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 -- 172.21.15.42:0/2710020292 >> 172.21.15.42:0/2710020292 conn(0x7f976808bfc0 msgr2=0x7f97680b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:19.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 -- 172.21.15.42:0/2710020292 shutdown_connections 2024-09-16T01:55:19.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:19.443+0000 7f976d83c640 1 -- 172.21.15.42:0/2710020292 wait complete. 2024-09-16T01:55:19.456 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-16T01:55:18.262289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":192,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237276,"kb_used_data":4384,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737444,"statfs":{"total":773094113280,"available":772851142656,"internally_reserved":0,"allocated":4489216,"data_stored":2575506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.222058"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070192+0000","last_change":"2024-09-16T01:55:15.065385+0000","last_active":"2024-09-16T01:55:15.070192+0000","last_peered":"2024-09-16T01:55:15.070192+0000","last_clean":"2024-09-16T01:55:15.070192+0000","last_became_active":"2024-09-16T01:55:15.065095+0000","last_became_peered":"2024-09-16T01:55:15.065095+0000","last_unstale":"2024-09-16T01:55:15.070192+0000","last_undegraded":"2024-09-16T01:55:15.070192+0000","last_fullsized":"2024-09-16T01:55:15.070192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067753+0000","last_change":"2024-09-16T01:55:15.059749+0000","last_active":"2024-09-16T01:55:15.067753+0000","last_peered":"2024-09-16T01:55:15.067753+0000","last_clean":"2024-09-16T01:55:15.067753+0000","last_became_active":"2024-09-16T01:55:15.059458+0000","last_became_peered":"2024-09-16T01:55:15.059458+0000","last_unstale":"2024-09-16T01:55:15.067753+0000","last_undegraded":"2024-09-16T01:55:15.067753+0000","last_fullsized":"2024-09-16T01:55:15.067753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:26.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080246+0000","last_change":"2024-09-16T01:55:15.077805+0000","last_active":"2024-09-16T01:55:15.080246+0000","last_peered":"2024-09-16T01:55:15.080246+0000","last_clean":"2024-09-16T01:55:15.080246+0000","last_became_active":"2024-09-16T01:55:15.077485+0000","last_became_peered":"2024-09-16T01:55:15.077485+0000","last_unstale":"2024-09-16T01:55:15.080246+0000","last_undegraded":"2024-09-16T01:55:15.080246+0000","last_fullsized":"2024-09-16T01:55:15.080246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063287+0000","last_change":"2024-09-16T01:55:15.058881+0000","last_active":"2024-09-16T01:55:16.063287+0000","last_peered":"2024-09-16T01:55:16.063287+0000","last_clean":"2024-09-16T01:55:16.063287+0000","last_became_active":"2024-09-16T01:55:15.058341+0000","last_became_peered":"2024-09-16T01:55:15.058341+0000","last_unstale":"2024-09-16T01:55:16.063287+0000","last_undegraded":"2024-09-16T01:55:16.063287+0000","last_fullsized":"2024-09-16T01:55:16.063287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:05.641631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063089+0000","last_change":"2024-09-16T01:55:15.059514+0000","last_active":"2024-09-16T01:55:16.063089+0000","last_peered":"2024-09-16T01:55:16.063089+0000","last_clean":"2024-09-16T01:55:16.063089+0000","last_became_active":"2024-09-16T01:55:15.059148+0000","last_became_peered":"2024-09-16T01:55:15.059148+0000","last_unstale":"2024-09-16T01:55:16.063089+0000","last_undegraded":"2024-09-16T01:55:16.063089+0000","last_fullsized":"2024-09-16T01:55:16.063089+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:43.845985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070564+0000","last_change":"2024-09-16T01:55:15.067284+0000","last_active":"2024-09-16T01:55:15.070564+0000","last_peered":"2024-09-16T01:55:15.070564+0000","last_clean":"2024-09-16T01:55:15.070564+0000","last_became_active":"2024-09-16T01:55:15.066918+0000","last_became_peered":"2024-09-16T01:55:15.066918+0000","last_unstale":"2024-09-16T01:55:15.070564+0000","last_undegraded":"2024-09-16T01:55:15.070564+0000","last_fullsized":"2024-09-16T01:55:15.070564+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.077947+0000","last_change":"2024-09-16T01:55:15.074589+0000","last_active":"2024-09-16T01:55:15.077947+0000","last_peered":"2024-09-16T01:55:15.077947+0000","last_clean":"2024-09-16T01:55:15.077947+0000","last_became_active":"2024-09-16T01:55:15.074341+0000","last_became_peered":"2024-09-16T01:55:15.074341+0000","last_unstale":"2024-09-16T01:55:15.077947+0000","last_undegraded":"2024-09-16T01:55:15.077947+0000","last_fullsized":"2024-09-16T01:55:15.077947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.571746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067783+0000","last_change":"2024-09-16T01:55:15.063121+0000","last_active":"2024-09-16T01:55:15.067783+0000","last_peered":"2024-09-16T01:55:15.067783+0000","last_clean":"2024-09-16T01:55:15.067783+0000","last_became_active":"2024-09-16T01:55:15.062819+0000","last_became_peered":"2024-09-16T01:55:15.062819+0000","last_unstale":"2024-09-16T01:55:15.067783+0000","last_undegraded":"2024-09-16T01:55:15.067783+0000","last_fullsized":"2024-09-16T01:55:15.067783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072493+0000","last_change":"2024-09-16T01:55:15.069367+0000","last_active":"2024-09-16T01:55:15.072493+0000","last_peered":"2024-09-16T01:55:15.072493+0000","last_clean":"2024-09-16T01:55:15.072493+0000","last_became_active":"2024-09-16T01:55:15.069079+0000","last_became_peered":"2024-09-16T01:55:15.069079+0000","last_unstale":"2024-09-16T01:55:15.072493+0000","last_undegraded":"2024-09-16T01:55:15.072493+0000","last_fullsized":"2024-09-16T01:55:15.072493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.079096+0000","last_change":"2024-09-16T01:55:15.071490+0000","last_active":"2024-09-16T01:55:15.079096+0000","last_peered":"2024-09-16T01:55:15.079096+0000","last_clean":"2024-09-16T01:55:15.079096+0000","last_became_active":"2024-09-16T01:55:15.071162+0000","last_became_peered":"2024-09-16T01:55:15.071162+0000","last_unstale":"2024-09-16T01:55:15.079096+0000","last_undegraded":"2024-09-16T01:55:15.079096+0000","last_fullsized":"2024-09-16T01:55:15.079096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076910+0000","last_change":"2024-09-16T01:55:15.067585+0000","last_active":"2024-09-16T01:55:15.076910+0000","last_peered":"2024-09-16T01:55:15.076910+0000","last_clean":"2024-09-16T01:55:15.076910+0000","last_became_active":"2024-09-16T01:55:15.067196+0000","last_became_peered":"2024-09-16T01:55:15.067196+0000","last_unstale":"2024-09-16T01:55:15.076910+0000","last_undegraded":"2024-09-16T01:55:15.076910+0000","last_fullsized":"2024-09-16T01:55:15.076910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.064986+0000","last_change":"2024-09-16T01:55:15.063667+0000","last_active":"2024-09-16T01:55:15.064986+0000","last_peered":"2024-09-16T01:55:15.064986+0000","last_clean":"2024-09-16T01:55:15.064986+0000","last_became_active":"2024-09-16T01:55:15.063380+0000","last_became_peered":"2024-09-16T01:55:15.063380+0000","last_unstale":"2024-09-16T01:55:15.064986+0000","last_undegraded":"2024-09-16T01:55:15.064986+0000","last_fullsized":"2024-09-16T01:55:15.064986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075948+0000","last_change":"2024-09-16T01:55:15.072130+0000","last_active":"2024-09-16T01:55:15.075948+0000","last_peered":"2024-09-16T01:55:15.075948+0000","last_clean":"2024-09-16T01:55:15.075948+0000","last_became_active":"2024-09-16T01:55:15.071860+0000","last_became_peered":"2024-09-16T01:55:15.071860+0000","last_unstale":"2024-09-16T01:55:15.075948+0000","last_undegraded":"2024-09-16T01:55:15.075948+0000","last_fullsized":"2024-09-16T01:55:15.075948+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074051+0000","last_change":"2024-09-16T01:55:15.068911+0000","last_active":"2024-09-16T01:55:15.074051+0000","last_peered":"2024-09-16T01:55:15.074051+0000","last_clean":"2024-09-16T01:55:15.074051+0000","last_became_active":"2024-09-16T01:55:15.068623+0000","last_became_peered":"2024-09-16T01:55:15.068623+0000","last_unstale":"2024-09-16T01:55:15.074051+0000","last_undegraded":"2024-09-16T01:55:15.074051+0000","last_fullsized":"2024-09-16T01:55:15.074051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076431+0000","last_change":"2024-09-16T01:55:15.070772+0000","last_active":"2024-09-16T01:55:15.076431+0000","last_peered":"2024-09-16T01:55:15.076431+0000","last_clean":"2024-09-16T01:55:15.076431+0000","last_became_active":"2024-09-16T01:55:15.068031+0000","last_became_peered":"2024-09-16T01:55:15.068031+0000","last_unstale":"2024-09-16T01:55:15.076431+0000","last_undegraded":"2024-09-16T01:55:15.076431+0000","last_fullsized":"2024-09-16T01:55:15.076431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068039+0000","last_change":"2024-09-16T01:55:15.066271+0000","last_active":"2024-09-16T01:55:15.068039+0000","last_peered":"2024-09-16T01:55:15.068039+0000","last_clean":"2024-09-16T01:55:15.068039+0000","last_became_active":"2024-09-16T01:55:15.065908+0000","last_became_peered":"2024-09-16T01:55:15.065908+0000","last_unstale":"2024-09-16T01:55:15.068039+0000","last_undegraded":"2024-09-16T01:55:15.068039+0000","last_fullsized":"2024-09-16T01:55:15.068039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:42.161072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063171+0000","last_change":"2024-09-16T01:55:15.065208+0000","last_active":"2024-09-16T01:55:16.063171+0000","last_peered":"2024-09-16T01:55:16.063171+0000","last_clean":"2024-09-16T01:55:16.063171+0000","last_became_active":"2024-09-16T01:55:15.062657+0000","last_became_peered":"2024-09-16T01:55:15.062657+0000","last_unstale":"2024-09-16T01:55:16.063171+0000","last_undegraded":"2024-09-16T01:55:16.063171+0000","last_fullsized":"2024-09-16T01:55:16.063171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:53.907841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068075+0000","last_change":"2024-09-16T01:55:15.065314+0000","last_active":"2024-09-16T01:55:15.068075+0000","last_peered":"2024-09-16T01:55:15.068075+0000","last_clean":"2024-09-16T01:55:15.068075+0000","last_became_active":"2024-09-16T01:55:15.065037+0000","last_became_peered":"2024-09-16T01:55:15.065037+0000","last_unstale":"2024-09-16T01:55:15.068075+0000","last_undegraded":"2024-09-16T01:55:15.068075+0000","last_fullsized":"2024-09-16T01:55:15.068075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:09.030685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075927+0000","last_change":"2024-09-16T01:55:15.066813+0000","last_active":"2024-09-16T01:55:15.075927+0000","last_peered":"2024-09-16T01:55:15.075927+0000","last_clean":"2024-09-16T01:55:15.075927+0000","last_became_active":"2024-09-16T01:55:15.063973+0000","last_became_peered":"2024-09-16T01:55:15.063973+0000","last_unstale":"2024-09-16T01:55:15.075927+0000","last_undegraded":"2024-09-16T01:55:15.075927+0000","last_fullsized":"2024-09-16T01:55:15.075927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.073081+0000","last_change":"2024-09-16T01:55:15.065269+0000","last_active":"2024-09-16T01:55:15.073081+0000","last_peered":"2024-09-16T01:55:15.073081+0000","last_clean":"2024-09-16T01:55:15.073081+0000","last_became_active":"2024-09-16T01:55:15.064860+0000","last_became_peered":"2024-09-16T01:55:15.064860+0000","last_unstale":"2024-09-16T01:55:15.073081+0000","last_undegraded":"2024-09-16T01:55:15.073081+0000","last_fullsized":"2024-09-16T01:55:15.073081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.062949+0000","last_change":"2024-09-16T01:55:15.071896+0000","last_active":"2024-09-16T01:55:16.062949+0000","last_peered":"2024-09-16T01:55:16.062949+0000","last_clean":"2024-09-16T01:55:16.062949+0000","last_became_active":"2024-09-16T01:55:15.071607+0000","last_became_peered":"2024-09-16T01:55:15.071607+0000","last_unstale":"2024-09-16T01:55:16.062949+0000","last_undegraded":"2024-09-16T01:55:16.062949+0000","last_fullsized":"2024-09-16T01:55:16.062949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:21.925734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068536+0000","last_change":"2024-09-16T01:55:15.066489+0000","last_active":"2024-09-16T01:55:15.068536+0000","last_peered":"2024-09-16T01:55:15.068536+0000","last_clean":"2024-09-16T01:55:15.068536+0000","last_became_active":"2024-09-16T01:55:15.066198+0000","last_became_peered":"2024-09-16T01:55:15.066198+0000","last_unstale":"2024-09-16T01:55:15.068536+0000","last_undegraded":"2024-09-16T01:55:15.068536+0000","last_fullsized":"2024-09-16T01:55:15.068536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:13.646813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.069980+0000","last_change":"2024-09-16T01:55:15.065514+0000","last_active":"2024-09-16T01:55:15.069980+0000","last_peered":"2024-09-16T01:55:15.069980+0000","last_clean":"2024-09-16T01:55:15.069980+0000","last_became_active":"2024-09-16T01:55:15.064716+0000","last_became_peered":"2024-09-16T01:55:15.064716+0000","last_unstale":"2024-09-16T01:55:15.069980+0000","last_undegraded":"2024-09-16T01:55:15.069980+0000","last_fullsized":"2024-09-16T01:55:15.069980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080171+0000","last_change":"2024-09-16T01:55:15.074757+0000","last_active":"2024-09-16T01:55:15.080171+0000","last_peered":"2024-09-16T01:55:15.080171+0000","last_clean":"2024-09-16T01:55:15.080171+0000","last_became_active":"2024-09-16T01:55:15.074465+0000","last_became_peered":"2024-09-16T01:55:15.074465+0000","last_unstale":"2024-09-16T01:55:15.080171+0000","last_undegraded":"2024-09-16T01:55:15.080171+0000","last_fullsized":"2024-09-16T01:55:15.080171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076161+0000","last_change":"2024-09-16T01:55:15.073726+0000","last_active":"2024-09-16T01:55:15.076161+0000","last_peered":"2024-09-16T01:55:15.076161+0000","last_clean":"2024-09-16T01:55:15.076161+0000","last_became_active":"2024-09-16T01:55:15.073453+0000","last_became_peered":"2024-09-16T01:55:15.073453+0000","last_unstale":"2024-09-16T01:55:15.076161+0000","last_undegraded":"2024-09-16T01:55:15.076161+0000","last_fullsized":"2024-09-16T01:55:15.076161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:22.978110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068277+0000","last_change":"2024-09-16T01:55:15.066587+0000","last_active":"2024-09-16T01:55:15.068277+0000","last_peered":"2024-09-16T01:55:15.068277+0000","last_clean":"2024-09-16T01:55:15.068277+0000","last_became_active":"2024-09-16T01:55:15.066292+0000","last_became_peered":"2024-09-16T01:55:15.066292+0000","last_unstale":"2024-09-16T01:55:15.068277+0000","last_undegraded":"2024-09-16T01:55:15.068277+0000","last_fullsized":"2024-09-16T01:55:15.068277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:27.843379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080063+0000","last_change":"2024-09-16T01:55:15.070192+0000","last_active":"2024-09-16T01:55:15.080063+0000","last_peered":"2024-09-16T01:55:15.080063+0000","last_clean":"2024-09-16T01:55:15.080063+0000","last_became_active":"2024-09-16T01:55:15.069764+0000","last_became_peered":"2024-09-16T01:55:15.069764+0000","last_unstale":"2024-09-16T01:55:15.080063+0000","last_undegraded":"2024-09-16T01:55:15.080063+0000","last_fullsized":"2024-09-16T01:55:15.080063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068967+0000","last_change":"2024-09-16T01:55:15.063260+0000","last_active":"2024-09-16T01:55:15.068967+0000","last_peered":"2024-09-16T01:55:15.068967+0000","last_clean":"2024-09-16T01:55:15.068967+0000","last_became_active":"2024-09-16T01:55:15.062964+0000","last_became_peered":"2024-09-16T01:55:15.062964+0000","last_unstale":"2024-09-16T01:55:15.068967+0000","last_undegraded":"2024-09-16T01:55:15.068967+0000","last_fullsized":"2024-09-16T01:55:15.068967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083596+0000","last_change":"2024-09-16T01:55:14.067402+0000","last_active":"2024-09-16T01:55:15.083596+0000","last_peered":"2024-09-16T01:55:15.083596+0000","last_clean":"2024-09-16T01:55:15.083596+0000","last_became_active":"2024-09-16T01:55:14.067117+0000","last_became_peered":"2024-09-16T01:55:14.067117+0000","last_unstale":"2024-09-16T01:55:15.083596+0000","last_undegraded":"2024-09-16T01:55:15.083596+0000","last_fullsized":"2024-09-16T01:55:15.083596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.523320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070015+0000","last_change":"2024-09-16T01:55:15.065086+0000","last_active":"2024-09-16T01:55:15.070015+0000","last_peered":"2024-09-16T01:55:15.070015+0000","last_clean":"2024-09-16T01:55:15.070015+0000","last_became_active":"2024-09-16T01:55:15.064785+0000","last_became_peered":"2024-09-16T01:55:15.064785+0000","last_unstale":"2024-09-16T01:55:15.070015+0000","last_undegraded":"2024-09-16T01:55:15.070015+0000","last_fullsized":"2024-09-16T01:55:15.070015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.084033+0000","last_change":"2024-09-16T01:55:14.068738+0000","last_active":"2024-09-16T01:55:15.084033+0000","last_peered":"2024-09-16T01:55:15.084033+0000","last_clean":"2024-09-16T01:55:15.084033+0000","last_became_active":"2024-09-16T01:55:14.068402+0000","last_became_peered":"2024-09-16T01:55:14.068402+0000","last_unstale":"2024-09-16T01:55:15.084033+0000","last_undegraded":"2024-09-16T01:55:15.084033+0000","last_fullsized":"2024-09-16T01:55:15.084033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:12.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074112+0000","last_change":"2024-09-16T01:55:15.068471+0000","last_active":"2024-09-16T01:55:15.074112+0000","last_peered":"2024-09-16T01:55:15.074112+0000","last_clean":"2024-09-16T01:55:15.074112+0000","last_became_active":"2024-09-16T01:55:15.067998+0000","last_became_peered":"2024-09-16T01:55:15.067998+0000","last_unstale":"2024-09-16T01:55:15.074112+0000","last_undegraded":"2024-09-16T01:55:15.074112+0000","last_fullsized":"2024-09-16T01:55:15.074112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083804+0000","last_change":"2024-09-16T01:55:14.068740+0000","last_active":"2024-09-16T01:55:15.083804+0000","last_peered":"2024-09-16T01:55:15.083804+0000","last_clean":"2024-09-16T01:55:15.083804+0000","last_became_active":"2024-09-16T01:55:14.068436+0000","last_became_peered":"2024-09-16T01:55:14.068436+0000","last_unstale":"2024-09-16T01:55:15.083804+0000","last_undegraded":"2024-09-16T01:55:15.083804+0000","last_fullsized":"2024-09-16T01:55:15.083804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074261+0000","last_change":"2024-09-16T01:55:15.073153+0000","last_active":"2024-09-16T01:55:15.074261+0000","last_peered":"2024-09-16T01:55:15.074261+0000","last_clean":"2024-09-16T01:55:15.074261+0000","last_became_active":"2024-09-16T01:55:15.072869+0000","last_became_peered":"2024-09-16T01:55:15.072869+0000","last_unstale":"2024-09-16T01:55:15.074261+0000","last_undegraded":"2024-09-16T01:55:15.074261+0000","last_fullsized":"2024-09-16T01:55:15.074261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:18.529028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.083076+0000","last_change":"2024-09-16T01:55:14.064430+0000","last_active":"2024-09-16T01:55:15.083076+0000","last_peered":"2024-09-16T01:55:15.083076+0000","last_clean":"2024-09-16T01:55:15.083076+0000","last_became_active":"2024-09-16T01:55:14.064050+0000","last_became_peered":"2024-09-16T01:55:14.064050+0000","last_unstale":"2024-09-16T01:55:15.083076+0000","last_undegraded":"2024-09-16T01:55:15.083076+0000","last_fullsized":"2024-09-16T01:55:15.083076+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:08.025192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076149+0000","last_change":"2024-09-16T01:55:15.074074+0000","last_active":"2024-09-16T01:55:15.076149+0000","last_peered":"2024-09-16T01:55:15.076149+0000","last_clean":"2024-09-16T01:55:15.076149+0000","last_became_active":"2024-09-16T01:55:15.068752+0000","last_became_peered":"2024-09-16T01:55:15.068752+0000","last_unstale":"2024-09-16T01:55:15.076149+0000","last_undegraded":"2024-09-16T01:55:15.076149+0000","last_fullsized":"2024-09-16T01:55:15.076149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088009+0000","last_change":"2024-09-16T01:55:14.064060+0000","last_active":"2024-09-16T01:55:15.088009+0000","last_peered":"2024-09-16T01:55:15.088009+0000","last_clean":"2024-09-16T01:55:15.088009+0000","last_became_active":"2024-09-16T01:55:14.063169+0000","last_became_peered":"2024-09-16T01:55:14.063169+0000","last_unstale":"2024-09-16T01:55:15.088009+0000","last_undegraded":"2024-09-16T01:55:15.088009+0000","last_fullsized":"2024-09-16T01:55:15.088009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076409+0000","last_change":"2024-09-16T01:55:15.066922+0000","last_active":"2024-09-16T01:55:15.076409+0000","last_peered":"2024-09-16T01:55:15.076409+0000","last_clean":"2024-09-16T01:55:15.076409+0000","last_became_active":"2024-09-16T01:55:15.063924+0000","last_became_peered":"2024-09-16T01:55:15.063924+0000","last_unstale":"2024-09-16T01:55:15.076409+0000","last_undegraded":"2024-09-16T01:55:15.076409+0000","last_fullsized":"2024-09-16T01:55:15.076409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047981+0000","last_change":"2024-09-16T01:55:13.047981+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047981+0000","last_undegraded":"2024-09-16T01:55:13.047981+0000","last_fullsized":"2024-09-16T01:55:13.047981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.073105+0000","last_change":"2024-09-16T01:55:15.065460+0000","last_active":"2024-09-16T01:55:15.073105+0000","last_peered":"2024-09-16T01:55:15.073105+0000","last_clean":"2024-09-16T01:55:15.073105+0000","last_became_active":"2024-09-16T01:55:15.065203+0000","last_became_peered":"2024-09-16T01:55:15.065203+0000","last_unstale":"2024-09-16T01:55:15.073105+0000","last_undegraded":"2024-09-16T01:55:15.073105+0000","last_fullsized":"2024-09-16T01:55:15.073105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053078+0000","last_change":"2024-09-16T01:55:14.063567+0000","last_active":"2024-09-16T01:55:15.053078+0000","last_peered":"2024-09-16T01:55:15.053078+0000","last_clean":"2024-09-16T01:55:15.053078+0000","last_became_active":"2024-09-16T01:55:14.063264+0000","last_became_peered":"2024-09-16T01:55:14.063264+0000","last_unstale":"2024-09-16T01:55:15.053078+0000","last_undegraded":"2024-09-16T01:55:15.053078+0000","last_fullsized":"2024-09-16T01:55:15.053078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:12.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071322+0000","last_change":"2024-09-16T01:55:15.067811+0000","last_active":"2024-09-16T01:55:15.071322+0000","last_peered":"2024-09-16T01:55:15.071322+0000","last_clean":"2024-09-16T01:55:15.071322+0000","last_became_active":"2024-09-16T01:55:15.067505+0000","last_became_peered":"2024-09-16T01:55:15.067505+0000","last_unstale":"2024-09-16T01:55:15.071322+0000","last_undegraded":"2024-09-16T01:55:15.071322+0000","last_fullsized":"2024-09-16T01:55:15.071322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:33.406715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053269+0000","last_change":"2024-09-16T01:55:14.067645+0000","last_active":"2024-09-16T01:55:15.053269+0000","last_peered":"2024-09-16T01:55:15.053269+0000","last_clean":"2024-09-16T01:55:15.053269+0000","last_became_active":"2024-09-16T01:55:14.067386+0000","last_became_peered":"2024-09-16T01:55:14.067386+0000","last_unstale":"2024-09-16T01:55:15.053269+0000","last_undegraded":"2024-09-16T01:55:15.053269+0000","last_fullsized":"2024-09-16T01:55:15.053269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:19.662035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063284+0000","last_change":"2024-09-16T01:55:15.058622+0000","last_active":"2024-09-16T01:55:16.063284+0000","last_peered":"2024-09-16T01:55:16.063284+0000","last_clean":"2024-09-16T01:55:16.063284+0000","last_became_active":"2024-09-16T01:55:15.057958+0000","last_became_peered":"2024-09-16T01:55:15.057958+0000","last_unstale":"2024-09-16T01:55:16.063284+0000","last_undegraded":"2024-09-16T01:55:16.063284+0000","last_fullsized":"2024-09-16T01:55:16.063284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:54.514922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.057787+0000","last_change":"2024-09-16T01:55:14.057478+0000","last_active":"2024-09-16T01:55:15.057787+0000","last_peered":"2024-09-16T01:55:15.057787+0000","last_clean":"2024-09-16T01:55:15.057787+0000","last_became_active":"2024-09-16T01:55:14.057199+0000","last_became_peered":"2024-09-16T01:55:14.057199+0000","last_unstale":"2024-09-16T01:55:15.057787+0000","last_undegraded":"2024-09-16T01:55:15.057787+0000","last_fullsized":"2024-09-16T01:55:15.057787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:26.749150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.061100+0000","last_change":"2024-09-16T01:55:14.068900+0000","last_active":"2024-09-16T01:55:15.061100+0000","last_peered":"2024-09-16T01:55:15.061100+0000","last_clean":"2024-09-16T01:55:15.061100+0000","last_became_active":"2024-09-16T01:55:14.066896+0000","last_became_peered":"2024-09-16T01:55:14.066896+0000","last_unstale":"2024-09-16T01:55:15.061100+0000","last_undegraded":"2024-09-16T01:55:15.061100+0000","last_fullsized":"2024-09-16T01:55:15.061100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:38.976382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.074610+0000","last_change":"2024-09-16T01:55:15.069993+0000","last_active":"2024-09-16T01:55:15.074610+0000","last_peered":"2024-09-16T01:55:15.074610+0000","last_clean":"2024-09-16T01:55:15.074610+0000","last_became_active":"2024-09-16T01:55:15.068922+0000","last_became_peered":"2024-09-16T01:55:15.068922+0000","last_unstale":"2024-09-16T01:55:15.074610+0000","last_undegraded":"2024-09-16T01:55:15.074610+0000","last_fullsized":"2024-09-16T01:55:15.074610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088255+0000","last_change":"2024-09-16T01:55:14.065656+0000","last_active":"2024-09-16T01:55:15.088255+0000","last_peered":"2024-09-16T01:55:15.088255+0000","last_clean":"2024-09-16T01:55:15.088255+0000","last_became_active":"2024-09-16T01:55:14.065390+0000","last_became_peered":"2024-09-16T01:55:14.065390+0000","last_unstale":"2024-09-16T01:55:15.088255+0000","last_undegraded":"2024-09-16T01:55:15.088255+0000","last_fullsized":"2024-09-16T01:55:15.088255+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:17.922515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.067977+0000","last_change":"2024-09-16T01:55:15.061491+0000","last_active":"2024-09-16T01:55:15.067977+0000","last_peered":"2024-09-16T01:55:15.067977+0000","last_clean":"2024-09-16T01:55:15.067977+0000","last_became_active":"2024-09-16T01:55:15.060771+0000","last_became_peered":"2024-09-16T01:55:15.060771+0000","last_unstale":"2024-09-16T01:55:15.067977+0000","last_undegraded":"2024-09-16T01:55:15.067977+0000","last_fullsized":"2024-09-16T01:55:15.067977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:27.843379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.089771+0000","last_change":"2024-09-16T01:55:14.066984+0000","last_active":"2024-09-16T01:55:15.089771+0000","last_peered":"2024-09-16T01:55:15.089771+0000","last_clean":"2024-09-16T01:55:15.089771+0000","last_became_active":"2024-09-16T01:55:14.066574+0000","last_became_peered":"2024-09-16T01:55:14.066574+0000","last_unstale":"2024-09-16T01:55:15.089771+0000","last_undegraded":"2024-09-16T01:55:15.089771+0000","last_fullsized":"2024-09-16T01:55:15.089771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:16.713685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076819+0000","last_change":"2024-09-16T01:55:15.075252+0000","last_active":"2024-09-16T01:55:15.076819+0000","last_peered":"2024-09-16T01:55:15.076819+0000","last_clean":"2024-09-16T01:55:15.076819+0000","last_became_active":"2024-09-16T01:55:15.074981+0000","last_became_peered":"2024-09-16T01:55:15.074981+0000","last_unstale":"2024-09-16T01:55:15.076819+0000","last_undegraded":"2024-09-16T01:55:15.076819+0000","last_fullsized":"2024-09-16T01:55:15.076819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.080750+0000","last_change":"2024-09-16T01:55:14.065205+0000","last_active":"2024-09-16T01:55:15.080750+0000","last_peered":"2024-09-16T01:55:15.080750+0000","last_clean":"2024-09-16T01:55:15.080750+0000","last_became_active":"2024-09-16T01:55:14.064867+0000","last_became_peered":"2024-09-16T01:55:14.064867+0000","last_unstale":"2024-09-16T01:55:15.080750+0000","last_undegraded":"2024-09-16T01:55:15.080750+0000","last_fullsized":"2024-09-16T01:55:15.080750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:40.415556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070269+0000","last_change":"2024-09-16T01:55:15.065359+0000","last_active":"2024-09-16T01:55:15.070269+0000","last_peered":"2024-09-16T01:55:15.070269+0000","last_clean":"2024-09-16T01:55:15.070269+0000","last_became_active":"2024-09-16T01:55:15.065061+0000","last_became_peered":"2024-09-16T01:55:15.065061+0000","last_unstale":"2024-09-16T01:55:15.070269+0000","last_undegraded":"2024-09-16T01:55:15.070269+0000","last_fullsized":"2024-09-16T01:55:15.070269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054606+0000","last_change":"2024-09-16T01:55:14.070545+0000","last_active":"2024-09-16T01:55:15.054606+0000","last_peered":"2024-09-16T01:55:15.054606+0000","last_clean":"2024-09-16T01:55:15.054606+0000","last_became_active":"2024-09-16T01:55:14.070303+0000","last_became_peered":"2024-09-16T01:55:14.070303+0000","last_unstale":"2024-09-16T01:55:15.054606+0000","last_undegraded":"2024-09-16T01:55:15.054606+0000","last_fullsized":"2024-09-16T01:55:15.054606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:38.976382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.056902+0000","last_change":"2024-09-16T01:55:14.067297+0000","last_active":"2024-09-16T01:55:15.056902+0000","last_peered":"2024-09-16T01:55:15.056902+0000","last_clean":"2024-09-16T01:55:15.056902+0000","last_became_active":"2024-09-16T01:55:14.066981+0000","last_became_peered":"2024-09-16T01:55:14.066981+0000","last_unstale":"2024-09-16T01:55:15.056902+0000","last_undegraded":"2024-09-16T01:55:15.056902+0000","last_fullsized":"2024-09-16T01:55:15.056902+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:17.010112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071281+0000","last_change":"2024-09-16T01:55:15.067563+0000","last_active":"2024-09-16T01:55:15.071281+0000","last_peered":"2024-09-16T01:55:15.071281+0000","last_clean":"2024-09-16T01:55:15.071281+0000","last_became_active":"2024-09-16T01:55:15.066882+0000","last_became_peered":"2024-09-16T01:55:15.066882+0000","last_unstale":"2024-09-16T01:55:15.071281+0000","last_undegraded":"2024-09-16T01:55:15.071281+0000","last_fullsized":"2024-09-16T01:55:15.071281+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:29.313718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047780+0000","last_change":"2024-09-16T01:55:13.047780+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047780+0000","last_undegraded":"2024-09-16T01:55:13.047780+0000","last_fullsized":"2024-09-16T01:55:13.047780+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071149+0000","last_change":"2024-09-16T01:55:15.069351+0000","last_active":"2024-09-16T01:55:15.071149+0000","last_peered":"2024-09-16T01:55:15.071149+0000","last_clean":"2024-09-16T01:55:15.071149+0000","last_became_active":"2024-09-16T01:55:15.068952+0000","last_became_peered":"2024-09-16T01:55:15.068952+0000","last_unstale":"2024-09-16T01:55:15.071149+0000","last_undegraded":"2024-09-16T01:55:15.071149+0000","last_fullsized":"2024-09-16T01:55:15.071149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:53:42.620283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088312+0000","last_change":"2024-09-16T01:55:14.068287+0000","last_active":"2024-09-16T01:55:15.088312+0000","last_peered":"2024-09-16T01:55:15.088312+0000","last_clean":"2024-09-16T01:55:15.088312+0000","last_became_active":"2024-09-16T01:55:14.066615+0000","last_became_peered":"2024-09-16T01:55:14.066615+0000","last_unstale":"2024-09-16T01:55:15.088312+0000","last_undegraded":"2024-09-16T01:55:15.088312+0000","last_fullsized":"2024-09-16T01:55:15.088312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:52.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076931+0000","last_change":"2024-09-16T01:55:15.071381+0000","last_active":"2024-09-16T01:55:15.076931+0000","last_peered":"2024-09-16T01:55:15.076931+0000","last_clean":"2024-09-16T01:55:15.076931+0000","last_became_active":"2024-09-16T01:55:15.071076+0000","last_became_peered":"2024-09-16T01:55:15.071076+0000","last_unstale":"2024-09-16T01:55:15.076931+0000","last_undegraded":"2024-09-16T01:55:15.076931+0000","last_fullsized":"2024-09-16T01:55:15.076931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088343+0000","last_change":"2024-09-16T01:55:14.070457+0000","last_active":"2024-09-16T01:55:15.088343+0000","last_peered":"2024-09-16T01:55:15.088343+0000","last_clean":"2024-09-16T01:55:15.088343+0000","last_became_active":"2024-09-16T01:55:14.070109+0000","last_became_peered":"2024-09-16T01:55:14.070109+0000","last_unstale":"2024-09-16T01:55:15.088343+0000","last_undegraded":"2024-09-16T01:55:15.088343+0000","last_fullsized":"2024-09-16T01:55:15.088343+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.523320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.068014+0000","last_change":"2024-09-16T01:55:15.062497+0000","last_active":"2024-09-16T01:55:15.068014+0000","last_peered":"2024-09-16T01:55:15.068014+0000","last_clean":"2024-09-16T01:55:15.068014+0000","last_became_active":"2024-09-16T01:55:15.062232+0000","last_became_peered":"2024-09-16T01:55:15.062232+0000","last_unstale":"2024-09-16T01:55:15.068014+0000","last_undegraded":"2024-09-16T01:55:15.068014+0000","last_fullsized":"2024-09-16T01:55:15.068014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:18.928008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063347+0000","last_change":"2024-09-16T01:55:14.069579+0000","last_active":"2024-09-16T01:55:16.063347+0000","last_peered":"2024-09-16T01:55:16.063347+0000","last_clean":"2024-09-16T01:55:16.063347+0000","last_became_active":"2024-09-16T01:55:14.069262+0000","last_became_peered":"2024-09-16T01:55:14.069262+0000","last_unstale":"2024-09-16T01:55:16.063347+0000","last_undegraded":"2024-09-16T01:55:16.063347+0000","last_fullsized":"2024-09-16T01:55:16.063347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:18.137110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063308+0000","last_change":"2024-09-16T01:55:15.061094+0000","last_active":"2024-09-16T01:55:16.063308+0000","last_peered":"2024-09-16T01:55:16.063308+0000","last_clean":"2024-09-16T01:55:16.063308+0000","last_became_active":"2024-09-16T01:55:15.060812+0000","last_became_peered":"2024-09-16T01:55:15.060812+0000","last_unstale":"2024-09-16T01:55:16.063308+0000","last_undegraded":"2024-09-16T01:55:16.063308+0000","last_fullsized":"2024-09-16T01:55:16.063308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:52.593075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054332+0000","last_change":"2024-09-16T01:55:14.064373+0000","last_active":"2024-09-16T01:55:15.054332+0000","last_peered":"2024-09-16T01:55:15.054332+0000","last_clean":"2024-09-16T01:55:15.054332+0000","last_became_active":"2024-09-16T01:55:14.064081+0000","last_became_peered":"2024-09-16T01:55:14.064081+0000","last_unstale":"2024-09-16T01:55:15.054332+0000","last_undegraded":"2024-09-16T01:55:15.054332+0000","last_fullsized":"2024-09-16T01:55:15.054332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:17.922515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063132+0000","last_change":"2024-09-16T01:55:14.064714+0000","last_active":"2024-09-16T01:55:16.063132+0000","last_peered":"2024-09-16T01:55:16.063132+0000","last_clean":"2024-09-16T01:55:16.063132+0000","last_became_active":"2024-09-16T01:55:14.064423+0000","last_became_peered":"2024-09-16T01:55:14.064423+0000","last_unstale":"2024-09-16T01:55:16.063132+0000","last_undegraded":"2024-09-16T01:55:16.063132+0000","last_fullsized":"2024-09-16T01:55:16.063132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:02.564362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072354+0000","last_change":"2024-09-16T01:55:15.068101+0000","last_active":"2024-09-16T01:55:15.072354+0000","last_peered":"2024-09-16T01:55:15.072354+0000","last_clean":"2024-09-16T01:55:15.072354+0000","last_became_active":"2024-09-16T01:55:15.067812+0000","last_became_peered":"2024-09-16T01:55:15.067812+0000","last_unstale":"2024-09-16T01:55:15.072354+0000","last_undegraded":"2024-09-16T01:55:15.072354+0000","last_fullsized":"2024-09-16T01:55:15.072354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.981875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063005+0000","last_change":"2024-09-16T01:55:14.063203+0000","last_active":"2024-09-16T01:55:16.063005+0000","last_peered":"2024-09-16T01:55:16.063005+0000","last_clean":"2024-09-16T01:55:16.063005+0000","last_became_active":"2024-09-16T01:55:14.062940+0000","last_became_peered":"2024-09-16T01:55:14.062940+0000","last_unstale":"2024-09-16T01:55:16.063005+0000","last_undegraded":"2024-09-16T01:55:16.063005+0000","last_fullsized":"2024-09-16T01:55:16.063005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:56.080694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.075848+0000","last_change":"2024-09-16T01:55:15.071198+0000","last_active":"2024-09-16T01:55:15.075848+0000","last_peered":"2024-09-16T01:55:15.075848+0000","last_clean":"2024-09-16T01:55:15.075848+0000","last_became_active":"2024-09-16T01:55:15.070942+0000","last_became_peered":"2024-09-16T01:55:15.070942+0000","last_unstale":"2024-09-16T01:55:15.075848+0000","last_undegraded":"2024-09-16T01:55:15.075848+0000","last_fullsized":"2024-09-16T01:55:15.075848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:26.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.048045+0000","last_change":"2024-09-16T01:55:13.048045+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.048045+0000","last_undegraded":"2024-09-16T01:55:13.048045+0000","last_fullsized":"2024-09-16T01:55:13.048045+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.071304+0000","last_change":"2024-09-16T01:55:15.067797+0000","last_active":"2024-09-16T01:55:15.071304+0000","last_peered":"2024-09-16T01:55:15.071304+0000","last_clean":"2024-09-16T01:55:15.071304+0000","last_became_active":"2024-09-16T01:55:15.067256+0000","last_became_peered":"2024-09-16T01:55:15.067256+0000","last_unstale":"2024-09-16T01:55:15.071304+0000","last_undegraded":"2024-09-16T01:55:15.071304+0000","last_fullsized":"2024-09-16T01:55:15.071304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.571746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.062931+0000","last_change":"2024-09-16T01:55:14.061458+0000","last_active":"2024-09-16T01:55:16.062931+0000","last_peered":"2024-09-16T01:55:16.062931+0000","last_clean":"2024-09-16T01:55:16.062931+0000","last_became_active":"2024-09-16T01:55:14.061101+0000","last_became_peered":"2024-09-16T01:55:14.061101+0000","last_unstale":"2024-09-16T01:55:16.062931+0000","last_undegraded":"2024-09-16T01:55:16.062931+0000","last_fullsized":"2024-09-16T01:55:16.062931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:13.570291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.078125+0000","last_change":"2024-09-16T01:55:15.072888+0000","last_active":"2024-09-16T01:55:15.078125+0000","last_peered":"2024-09-16T01:55:15.078125+0000","last_clean":"2024-09-16T01:55:15.078125+0000","last_became_active":"2024-09-16T01:55:15.072571+0000","last_became_peered":"2024-09-16T01:55:15.072571+0000","last_unstale":"2024-09-16T01:55:15.078125+0000","last_undegraded":"2024-09-16T01:55:15.078125+0000","last_fullsized":"2024-09-16T01:55:15.078125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.088241+0000","last_change":"2024-09-16T01:55:14.066143+0000","last_active":"2024-09-16T01:55:15.088241+0000","last_peered":"2024-09-16T01:55:15.088241+0000","last_clean":"2024-09-16T01:55:15.088241+0000","last_became_active":"2024-09-16T01:55:14.065838+0000","last_became_peered":"2024-09-16T01:55:14.065838+0000","last_unstale":"2024-09-16T01:55:15.088241+0000","last_undegraded":"2024-09-16T01:55:15.088241+0000","last_fullsized":"2024-09-16T01:55:15.088241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:07.689683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073154+0000","last_change":"2024-09-16T01:55:14.064101+0000","last_active":"2024-09-16T01:55:16.073154+0000","last_peered":"2024-09-16T01:55:16.073154+0000","last_clean":"2024-09-16T01:55:16.073154+0000","last_became_active":"2024-09-16T01:55:14.063782+0000","last_became_peered":"2024-09-16T01:55:14.063782+0000","last_unstale":"2024-09-16T01:55:16.073154+0000","last_undegraded":"2024-09-16T01:55:16.073154+0000","last_fullsized":"2024-09-16T01:55:16.073154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:53.149175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.070227+0000","last_change":"2024-09-16T01:55:15.066052+0000","last_active":"2024-09-16T01:55:15.070227+0000","last_peered":"2024-09-16T01:55:15.070227+0000","last_clean":"2024-09-16T01:55:15.070227+0000","last_became_active":"2024-09-16T01:55:15.065771+0000","last_became_peered":"2024-09-16T01:55:15.065771+0000","last_unstale":"2024-09-16T01:55:15.070227+0000","last_undegraded":"2024-09-16T01:55:15.070227+0000","last_fullsized":"2024-09-16T01:55:15.070227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:22.978110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.059430+0000","last_change":"2024-09-16T01:55:14.064829+0000","last_active":"2024-09-16T01:55:15.059430+0000","last_peered":"2024-09-16T01:55:15.059430+0000","last_clean":"2024-09-16T01:55:15.059430+0000","last_became_active":"2024-09-16T01:55:14.064531+0000","last_became_peered":"2024-09-16T01:55:14.064531+0000","last_unstale":"2024-09-16T01:55:15.059430+0000","last_undegraded":"2024-09-16T01:55:15.059430+0000","last_fullsized":"2024-09-16T01:55:15.059430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:41.155579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076798+0000","last_change":"2024-09-16T01:55:15.074355+0000","last_active":"2024-09-16T01:55:15.076798+0000","last_peered":"2024-09-16T01:55:15.076798+0000","last_clean":"2024-09-16T01:55:15.076798+0000","last_became_active":"2024-09-16T01:55:15.071086+0000","last_became_peered":"2024-09-16T01:55:15.071086+0000","last_unstale":"2024-09-16T01:55:15.076798+0000","last_undegraded":"2024-09-16T01:55:15.076798+0000","last_fullsized":"2024-09-16T01:55:15.076798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.062153+0000","last_change":"2024-09-16T01:55:14.067246+0000","last_active":"2024-09-16T01:55:15.062153+0000","last_peered":"2024-09-16T01:55:15.062153+0000","last_clean":"2024-09-16T01:55:15.062153+0000","last_became_active":"2024-09-16T01:55:14.066819+0000","last_became_peered":"2024-09-16T01:55:14.066819+0000","last_unstale":"2024-09-16T01:55:15.062153+0000","last_undegraded":"2024-09-16T01:55:15.062153+0000","last_fullsized":"2024-09-16T01:55:15.062153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.072435+0000","last_change":"2024-09-16T01:55:15.069885+0000","last_active":"2024-09-16T01:55:15.072435+0000","last_peered":"2024-09-16T01:55:15.072435+0000","last_clean":"2024-09-16T01:55:15.072435+0000","last_became_active":"2024-09-16T01:55:15.068666+0000","last_became_peered":"2024-09-16T01:55:15.068666+0000","last_unstale":"2024-09-16T01:55:15.072435+0000","last_undegraded":"2024-09-16T01:55:15.072435+0000","last_fullsized":"2024-09-16T01:55:15.072435+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.059227+0000","last_change":"2024-09-16T01:55:14.064031+0000","last_active":"2024-09-16T01:55:15.059227+0000","last_peered":"2024-09-16T01:55:15.059227+0000","last_clean":"2024-09-16T01:55:15.059227+0000","last_became_active":"2024-09-16T01:55:14.063686+0000","last_became_peered":"2024-09-16T01:55:14.063686+0000","last_unstale":"2024-09-16T01:55:15.059227+0000","last_undegraded":"2024-09-16T01:55:15.059227+0000","last_fullsized":"2024-09-16T01:55:15.059227+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:19.662035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.062236+0000","last_change":"2024-09-16T01:55:15.058905+0000","last_active":"2024-09-16T01:55:15.062236+0000","last_peered":"2024-09-16T01:55:15.062236+0000","last_clean":"2024-09-16T01:55:15.062236+0000","last_became_active":"2024-09-16T01:55:15.058632+0000","last_became_peered":"2024-09-16T01:55:15.058632+0000","last_unstale":"2024-09-16T01:55:15.062236+0000","last_undegraded":"2024-09-16T01:55:15.062236+0000","last_fullsized":"2024-09-16T01:55:15.062236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:13.646813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.053762+0000","last_change":"2024-09-16T01:55:14.064739+0000","last_active":"2024-09-16T01:55:15.053762+0000","last_peered":"2024-09-16T01:55:15.053762+0000","last_clean":"2024-09-16T01:55:15.053762+0000","last_became_active":"2024-09-16T01:55:14.064446+0000","last_became_peered":"2024-09-16T01:55:14.064446+0000","last_unstale":"2024-09-16T01:55:15.053762+0000","last_undegraded":"2024-09-16T01:55:15.053762+0000","last_fullsized":"2024-09-16T01:55:15.053762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:41.155579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:14.040041+0000","last_change":"2024-09-16T01:55:14.040041+0000","last_active":"2024-09-16T01:55:14.040041+0000","last_peered":"2024-09-16T01:55:14.040041+0000","last_clean":"2024-09-16T01:55:14.040041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:14.040041+0000","last_undegraded":"2024-09-16T01:55:14.040041+0000","last_fullsized":"2024-09-16T01:55:14.040041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.054832+0000","last_change":"2024-09-16T01:55:14.057198+0000","last_active":"2024-09-16T01:55:15.054832+0000","last_peered":"2024-09-16T01:55:15.054832+0000","last_clean":"2024-09-16T01:55:15.054832+0000","last_became_active":"2024-09-16T01:55:14.056723+0000","last_became_peered":"2024-09-16T01:55:14.056723+0000","last_unstale":"2024-09-16T01:55:15.054832+0000","last_undegraded":"2024-09-16T01:55:15.054832+0000","last_fullsized":"2024-09-16T01:55:15.054832+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:53.464988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T01:55:15.076035+0000","last_change":"2024-09-16T01:55:15.074182+0000","last_active":"2024-09-16T01:55:15.076035+0000","last_peered":"2024-09-16T01:55:15.076035+0000","last_clean":"2024-09-16T01:55:15.076035+0000","last_became_active":"2024-09-16T01:55:15.073915+0000","last_became_peered":"2024-09-16T01:55:15.073915+0000","last_unstale":"2024-09-16T01:55:15.076035+0000","last_undegraded":"2024-09-16T01:55:15.076035+0000","last_fullsized":"2024-09-16T01:55:15.076035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:29.313718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-16T01:55:13.047989+0000","last_change":"2024-09-16T01:55:13.047989+0000","last_active":"2024-09-16T01:55:13.034548+0000","last_peered":"2024-09-16T01:55:13.034548+0000","last_clean":"2024-09-16T01:55:13.034548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:13.047989+0000","last_undegraded":"2024-09-16T01:55:13.047989+0000","last_fullsized":"2024-09-16T01:55:13.047989+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T01:55:13.048552+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:55:13.048552+0000","last_peered":"2024-09-16T01:55:13.048552+0000","last_clean":"2024-09-16T01:55:13.048552+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:55:13.048552+0000","last_undegraded":"2024-09-16T01:55:13.048552+0000","last_fullsized":"2024-09-16T01:55:13.048552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":171441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":434176,"data_stored":180254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":178608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":761809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":755142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":434176,"data_stored":185370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:55:20.039 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-09-16T01:55:20.037+0000 7fa4306de640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:55:22.461 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:55:22.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.576+0000 7f409e5df640 1 Processor -- start 2024-09-16T01:55:22.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.576+0000 7f409e5df640 1 -- start start 2024-09-16T01:55:22.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.576+0000 7f409e5df640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f409815c520 0x7f409809b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.576+0000 7f409e5df640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40980cec00 con 0x7f40980b1620 2024-09-16T01:55:22.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.576+0000 7f409e5df640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f409809bd90 con 0x7f40980d1090 2024-09-16T01:55:22.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.576+0000 7f409e5df640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f40980d0010 con 0x7f409815c520 2024-09-16T01:55:22.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f40977fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f40980b1620 0x7f40980d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59728/0 (socket says 172.21.15.42:59728) 2024-09-16T01:55:22.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f40977fe640 1 -- 172.21.15.42:0/3303176252 learned_addr learned my addr 172.21.15.42:0/3303176252 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:22.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4097fff640 1 --2- 172.21.15.42:0/3303176252 >> v2:172.21.15.107:3300/0 conn(0x7f409815c520 0x7f409809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277091754 0 0) 0x7f40980cec00 con 0x7f40980b1620 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4080003520 con 0x7f40980b1620 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3911375267 0 0) 0x7f4080003520 con 0x7f40980b1620 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 >> v2:172.21.15.107:3300/0 conn(0x7f409815c520 msgr2=0x7f409809b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 --2- 172.21.15.42:0/3303176252 >> v2:172.21.15.107:3300/0 conn(0x7f409815c520 0x7f409809b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 >> v1:172.21.15.107:6789/0 conn(0x7f40980d1090 legacy=0x7f40980cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40980d02f0 con 0x7f40980b1620 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f408c001670 con 0x7f40980b1620 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 >> v1:172.21.15.42:6789/0 conn(0x7f40980b1620 legacy=0x7f40980d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800039b0 0x7f4080003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4080004800 0x7f4080004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40800051c0 0x7f408000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40980d0010 con 0x7f40800051c0 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f408000c060 con 0x7f40800039b0 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.577+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f408000c260 con 0x7f4080004800 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.578+0000 7f4097fff640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800039b0 0x7f4080003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.578+0000 7f409cb7c640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40800051c0 0x7f408000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.578+0000 7f40977fe640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4080004800 0x7f4080004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.578+0000 7f409cb7c640 1 -- 172.21.15.42:0/3303176252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4080004800 msgr2=0x7f4080004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.578+0000 7f409cb7c640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4080004800 0x7f4080004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.578+0000 7f409cb7c640 1 -- 172.21.15.42:0/3303176252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800039b0 msgr2=0x7f4080003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.578+0000 7f409cb7c640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800039b0 0x7f4080003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.578+0000 7f409cb7c640 1 -- 172.21.15.42:0/3303176252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4080003520 con 0x7f40800051c0 2024-09-16T01:55:22.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.578+0000 7f4097fff640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40800039b0 0x7f4080003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:22.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f409cb7c640 1 -- 172.21.15.42:0/3303176252 reap_dead start 2024-09-16T01:55:22.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f409cb7c640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40800051c0 0x7f408000b9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4090001e20 tx=0x7f4080005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415308365f354b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:22.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088009690 con 0x7f40800051c0 2024-09-16T01:55:22.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f409002ae40 con 0x7f40800051c0 2024-09-16T01:55:22.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f4096ffd640 1 -- 172.21.15.42:0/3303176252 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4090001a70 con 0x7f40800051c0 2024-09-16T01:55:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f409e5df640 1 -- 172.21.15.42:0/3303176252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40800051c0 msgr2=0x7f408000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f409e5df640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40800051c0 0x7f408000b9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4090001e20 tx=0x7f4080005830 comp rx=0 tx=0).stop 2024-09-16T01:55:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f409e5df640 1 -- 172.21.15.42:0/3303176252 shutdown_connections 2024-09-16T01:55:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f409e5df640 1 --2- 172.21.15.42:0/3303176252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40800051c0 0x7f408000b9c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f409e5df640 1 -- 172.21.15.42:0/3303176252 >> 172.21.15.42:0/3303176252 conn(0x7f40980d23a0 msgr2=0x7f40980d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f409e5df640 1 -- 172.21.15.42:0/3303176252 shutdown_connections 2024-09-16T01:55:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.579+0000 7f409e5df640 1 -- 172.21.15.42:0/3303176252 wait complete. 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.581+0000 7f409e5df640 1 Processor -- start 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.581+0000 7f409e5df640 1 -- start start 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f409e5df640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800051c0 0x7f40980cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f409e5df640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40980cc380 0x7f409806e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f409e5df640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40980c95b0 0x7f40980b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f409e5df640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f409815c900 con 0x7f40980cc380 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f409e5df640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f40980d05d0 con 0x7f40980c95b0 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f409e5df640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f409806e8c0 con 0x7f40800051c0 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f40977fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40980cc380 0x7f409806e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f40977fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40980cc380 0x7f409806e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48036/0 (socket says 172.21.15.42:48036) 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f40977fe640 1 -- 172.21.15.42:0/1916900401 learned_addr learned my addr 172.21.15.42:0/1916900401 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f4097fff640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800051c0 0x7f40980cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f409cb7c640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40980c95b0 0x7f40980b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f40977fe640 1 -- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800051c0 msgr2=0x7f40980cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f40977fe640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800051c0 0x7f40980cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f40977fe640 1 -- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40980c95b0 msgr2=0x7f40980b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f40977fe640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40980c95b0 0x7f40980b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f40977fe640 1 -- 172.21.15.42:0/1916900401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409806eb00 con 0x7f40980cc380 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.582+0000 7f40977fe640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40980cc380 0x7f409806e380 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f408c0072c0 tx=0x7f408c0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.583+0000 7f4094ff9640 1 -- 172.21.15.42:0/1916900401 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c00f960 con 0x7f40980cc380 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.583+0000 7f4094ff9640 1 -- 172.21.15.42:0/1916900401 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408c018070 con 0x7f40980cc380 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.583+0000 7f409e5df640 1 -- 172.21.15.42:0/1916900401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40981e5ed0 con 0x7f40980cc380 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.583+0000 7f4094ff9640 1 -- 172.21.15.42:0/1916900401 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c00fd60 con 0x7f40980cc380 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.583+0000 7f409e5df640 1 -- 172.21.15.42:0/1916900401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40981e6490 con 0x7f40980cc380 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.584+0000 7f409e5df640 1 -- 172.21.15.42:0/1916900401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40981e6690 con 0x7f40980cc380 2024-09-16T01:55:22.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.584+0000 7f4094ff9640 1 -- 172.21.15.42:0/1916900401 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f408c01c410 con 0x7f40980cc380 2024-09-16T01:55:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.585+0000 7f4094ff9640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f408406c2e0 0x7f408406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.585+0000 7f4094ff9640 1 -- 172.21.15.42:0/1916900401 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f408c08af90 con 0x7f40980cc380 2024-09-16T01:55:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.585+0000 7f4097fff640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f408406c2e0 0x7f408406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.585+0000 7f4097fff640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f408406c2e0 0x7f408406e7a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4088009b40 tx=0x7f4088009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:22.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.589+0000 7f4094ff9640 1 -- 172.21.15.42:0/1916900401 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40981e6690 con 0x7f40980cc380 2024-09-16T01:55:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.762+0000 7f409e5df640 1 -- 172.21.15.42:0/1916900401 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f409809b720 con 0x7f408406c2e0 2024-09-16T01:55:22.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.768+0000 7f4094ff9640 1 -- 172.21.15.42:0/1916900401 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251883 (secure 0 0 0) 0x7f409809b720 con 0x7f408406c2e0 2024-09-16T01:55:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:22.778 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:55:22.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 -- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f408406c2e0 msgr2=0x7f408406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f408406c2e0 0x7f408406e7a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4088009b40 tx=0x7f4088009190 comp rx=0 tx=0).stop 2024-09-16T01:55:22.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 -- 172.21.15.42:0/1916900401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40980cc380 msgr2=0x7f409806e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40980cc380 0x7f409806e380 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f408c0072c0 tx=0x7f408c0076c0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 -- 172.21.15.42:0/1916900401 shutdown_connections 2024-09-16T01:55:22.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f408406c2e0 0x7f408406e7a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40980c95b0 0x7f40980b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40980cc380 0x7f409806e380 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 --2- 172.21.15.42:0/1916900401 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40800051c0 0x7f40980cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 -- 172.21.15.42:0/1916900401 >> 172.21.15.42:0/1916900401 conn(0x7f40980d23a0 msgr2=0x7f40980b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:22.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 -- 172.21.15.42:0/1916900401 shutdown_connections 2024-09-16T01:55:22.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.771+0000 7f409e5df640 1 -- 172.21.15.42:0/1916900401 wait complete. 2024-09-16T01:55:22.785 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-16T01:55:22.263387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237480,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737240,"statfs":{"total":773094113280,"available":772850933760,"internally_reserved":0,"allocated":4694016,"data_stored":2667956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001923"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084837+0000","last_change":"2024-09-16T01:55:15.065385+0000","last_active":"2024-09-16T01:55:16.084837+0000","last_peered":"2024-09-16T01:55:16.084837+0000","last_clean":"2024-09-16T01:55:16.084837+0000","last_became_active":"2024-09-16T01:55:15.065095+0000","last_became_peered":"2024-09-16T01:55:15.065095+0000","last_unstale":"2024-09-16T01:55:16.084837+0000","last_undegraded":"2024-09-16T01:55:16.084837+0000","last_fullsized":"2024-09-16T01:55:16.084837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:13.405870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085161+0000","last_change":"2024-09-16T01:55:15.059749+0000","last_active":"2024-09-16T01:55:16.085161+0000","last_peered":"2024-09-16T01:55:16.085161+0000","last_clean":"2024-09-16T01:55:16.085161+0000","last_became_active":"2024-09-16T01:55:15.059458+0000","last_became_peered":"2024-09-16T01:55:15.059458+0000","last_unstale":"2024-09-16T01:55:16.085161+0000","last_undegraded":"2024-09-16T01:55:16.085161+0000","last_fullsized":"2024-09-16T01:55:16.085161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:08.396514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085637+0000","last_change":"2024-09-16T01:55:15.077805+0000","last_active":"2024-09-16T01:55:16.085637+0000","last_peered":"2024-09-16T01:55:16.085637+0000","last_clean":"2024-09-16T01:55:16.085637+0000","last_became_active":"2024-09-16T01:55:15.077485+0000","last_became_peered":"2024-09-16T01:55:15.077485+0000","last_unstale":"2024-09-16T01:55:16.085637+0000","last_undegraded":"2024-09-16T01:55:16.085637+0000","last_fullsized":"2024-09-16T01:55:16.085637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:22.978110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063287+0000","last_change":"2024-09-16T01:55:15.058881+0000","last_active":"2024-09-16T01:55:16.063287+0000","last_peered":"2024-09-16T01:55:16.063287+0000","last_clean":"2024-09-16T01:55:16.063287+0000","last_became_active":"2024-09-16T01:55:15.058341+0000","last_became_peered":"2024-09-16T01:55:15.058341+0000","last_unstale":"2024-09-16T01:55:16.063287+0000","last_undegraded":"2024-09-16T01:55:16.063287+0000","last_fullsized":"2024-09-16T01:55:16.063287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:05.641631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063089+0000","last_change":"2024-09-16T01:55:15.059514+0000","last_active":"2024-09-16T01:55:16.063089+0000","last_peered":"2024-09-16T01:55:16.063089+0000","last_clean":"2024-09-16T01:55:16.063089+0000","last_became_active":"2024-09-16T01:55:15.059148+0000","last_became_peered":"2024-09-16T01:55:15.059148+0000","last_unstale":"2024-09-16T01:55:16.063089+0000","last_undegraded":"2024-09-16T01:55:16.063089+0000","last_fullsized":"2024-09-16T01:55:16.063089+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:43.845985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085062+0000","last_change":"2024-09-16T01:55:15.067284+0000","last_active":"2024-09-16T01:55:16.085062+0000","last_peered":"2024-09-16T01:55:16.085062+0000","last_clean":"2024-09-16T01:55:16.085062+0000","last_became_active":"2024-09-16T01:55:15.066918+0000","last_became_peered":"2024-09-16T01:55:15.066918+0000","last_unstale":"2024-09-16T01:55:16.085062+0000","last_undegraded":"2024-09-16T01:55:16.085062+0000","last_fullsized":"2024-09-16T01:55:16.085062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:22.978110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073618+0000","last_change":"2024-09-16T01:55:15.074589+0000","last_active":"2024-09-16T01:55:16.073618+0000","last_peered":"2024-09-16T01:55:16.073618+0000","last_clean":"2024-09-16T01:55:16.073618+0000","last_became_active":"2024-09-16T01:55:15.074341+0000","last_became_peered":"2024-09-16T01:55:15.074341+0000","last_unstale":"2024-09-16T01:55:16.073618+0000","last_undegraded":"2024-09-16T01:55:16.073618+0000","last_fullsized":"2024-09-16T01:55:16.073618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:33.406715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084123+0000","last_change":"2024-09-16T01:55:15.063121+0000","last_active":"2024-09-16T01:55:16.084123+0000","last_peered":"2024-09-16T01:55:16.084123+0000","last_clean":"2024-09-16T01:55:16.084123+0000","last_became_active":"2024-09-16T01:55:15.062819+0000","last_became_peered":"2024-09-16T01:55:15.062819+0000","last_unstale":"2024-09-16T01:55:16.084123+0000","last_undegraded":"2024-09-16T01:55:16.084123+0000","last_fullsized":"2024-09-16T01:55:16.084123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:03.836752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.086005+0000","last_change":"2024-09-16T01:55:15.069367+0000","last_active":"2024-09-16T01:55:16.086005+0000","last_peered":"2024-09-16T01:55:16.086005+0000","last_clean":"2024-09-16T01:55:16.086005+0000","last_became_active":"2024-09-16T01:55:15.069079+0000","last_became_peered":"2024-09-16T01:55:15.069079+0000","last_unstale":"2024-09-16T01:55:16.086005+0000","last_undegraded":"2024-09-16T01:55:16.086005+0000","last_fullsized":"2024-09-16T01:55:16.086005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:33.406715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.074072+0000","last_change":"2024-09-16T01:55:15.071490+0000","last_active":"2024-09-16T01:55:16.074072+0000","last_peered":"2024-09-16T01:55:16.074072+0000","last_clean":"2024-09-16T01:55:16.074072+0000","last_became_active":"2024-09-16T01:55:15.071162+0000","last_became_peered":"2024-09-16T01:55:15.071162+0000","last_unstale":"2024-09-16T01:55:16.074072+0000","last_undegraded":"2024-09-16T01:55:16.074072+0000","last_fullsized":"2024-09-16T01:55:16.074072+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:45:02.002197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.074039+0000","last_change":"2024-09-16T01:55:15.067585+0000","last_active":"2024-09-16T01:55:16.074039+0000","last_peered":"2024-09-16T01:55:16.074039+0000","last_clean":"2024-09-16T01:55:16.074039+0000","last_became_active":"2024-09-16T01:55:15.067196+0000","last_became_peered":"2024-09-16T01:55:15.067196+0000","last_unstale":"2024-09-16T01:55:16.074039+0000","last_undegraded":"2024-09-16T01:55:16.074039+0000","last_fullsized":"2024-09-16T01:55:16.074039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:42.823688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085777+0000","last_change":"2024-09-16T01:55:15.063667+0000","last_active":"2024-09-16T01:55:16.085777+0000","last_peered":"2024-09-16T01:55:16.085777+0000","last_clean":"2024-09-16T01:55:16.085777+0000","last_became_active":"2024-09-16T01:55:15.063380+0000","last_became_peered":"2024-09-16T01:55:15.063380+0000","last_unstale":"2024-09-16T01:55:16.085777+0000","last_undegraded":"2024-09-16T01:55:16.085777+0000","last_fullsized":"2024-09-16T01:55:16.085777+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.571746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073760+0000","last_change":"2024-09-16T01:55:15.072130+0000","last_active":"2024-09-16T01:55:16.073760+0000","last_peered":"2024-09-16T01:55:16.073760+0000","last_clean":"2024-09-16T01:55:16.073760+0000","last_became_active":"2024-09-16T01:55:15.071860+0000","last_became_peered":"2024-09-16T01:55:15.071860+0000","last_unstale":"2024-09-16T01:55:16.073760+0000","last_undegraded":"2024-09-16T01:55:16.073760+0000","last_fullsized":"2024-09-16T01:55:16.073760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:29.855719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084321+0000","last_change":"2024-09-16T01:55:15.068911+0000","last_active":"2024-09-16T01:55:16.084321+0000","last_peered":"2024-09-16T01:55:16.084321+0000","last_clean":"2024-09-16T01:55:16.084321+0000","last_became_active":"2024-09-16T01:55:15.068623+0000","last_became_peered":"2024-09-16T01:55:15.068623+0000","last_unstale":"2024-09-16T01:55:16.084321+0000","last_undegraded":"2024-09-16T01:55:16.084321+0000","last_fullsized":"2024-09-16T01:55:16.084321+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073634+0000","last_change":"2024-09-16T01:55:15.070772+0000","last_active":"2024-09-16T01:55:16.073634+0000","last_peered":"2024-09-16T01:55:16.073634+0000","last_clean":"2024-09-16T01:55:16.073634+0000","last_became_active":"2024-09-16T01:55:15.068031+0000","last_became_peered":"2024-09-16T01:55:15.068031+0000","last_unstale":"2024-09-16T01:55:16.073634+0000","last_undegraded":"2024-09-16T01:55:16.073634+0000","last_fullsized":"2024-09-16T01:55:16.073634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:53:42.620283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084636+0000","last_change":"2024-09-16T01:55:15.078801+0000","last_active":"2024-09-16T01:55:16.084636+0000","last_peered":"2024-09-16T01:55:16.084636+0000","last_clean":"2024-09-16T01:55:16.084636+0000","last_became_active":"2024-09-16T01:55:15.077394+0000","last_became_peered":"2024-09-16T01:55:15.077394+0000","last_unstale":"2024-09-16T01:55:16.084636+0000","last_undegraded":"2024-09-16T01:55:16.084636+0000","last_fullsized":"2024-09-16T01:55:16.084636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:44.285341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085254+0000","last_change":"2024-09-16T01:55:15.075529+0000","last_active":"2024-09-16T01:55:16.085254+0000","last_peered":"2024-09-16T01:55:16.085254+0000","last_clean":"2024-09-16T01:55:16.085254+0000","last_became_active":"2024-09-16T01:55:15.075252+0000","last_became_peered":"2024-09-16T01:55:15.075252+0000","last_unstale":"2024-09-16T01:55:16.085254+0000","last_undegraded":"2024-09-16T01:55:16.085254+0000","last_fullsized":"2024-09-16T01:55:16.085254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:21.768833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063791+0000","last_change":"2024-09-16T01:55:15.066271+0000","last_active":"2024-09-16T01:55:16.063791+0000","last_peered":"2024-09-16T01:55:16.063791+0000","last_clean":"2024-09-16T01:55:16.063791+0000","last_became_active":"2024-09-16T01:55:15.065908+0000","last_became_peered":"2024-09-16T01:55:15.065908+0000","last_unstale":"2024-09-16T01:55:16.063791+0000","last_undegraded":"2024-09-16T01:55:16.063791+0000","last_fullsized":"2024-09-16T01:55:16.063791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:08.695176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063171+0000","last_change":"2024-09-16T01:55:15.065208+0000","last_active":"2024-09-16T01:55:16.063171+0000","last_peered":"2024-09-16T01:55:16.063171+0000","last_clean":"2024-09-16T01:55:16.063171+0000","last_became_active":"2024-09-16T01:55:15.062657+0000","last_became_peered":"2024-09-16T01:55:15.062657+0000","last_unstale":"2024-09-16T01:55:16.063171+0000","last_undegraded":"2024-09-16T01:55:16.063171+0000","last_fullsized":"2024-09-16T01:55:16.063171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:53.907841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063816+0000","last_change":"2024-09-16T01:55:15.065314+0000","last_active":"2024-09-16T01:55:16.063816+0000","last_peered":"2024-09-16T01:55:16.063816+0000","last_clean":"2024-09-16T01:55:16.063816+0000","last_became_active":"2024-09-16T01:55:15.065037+0000","last_became_peered":"2024-09-16T01:55:15.065037+0000","last_unstale":"2024-09-16T01:55:16.063816+0000","last_undegraded":"2024-09-16T01:55:16.063816+0000","last_fullsized":"2024-09-16T01:55:16.063816+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:54.470481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073842+0000","last_change":"2024-09-16T01:55:15.066813+0000","last_active":"2024-09-16T01:55:16.073842+0000","last_peered":"2024-09-16T01:55:16.073842+0000","last_clean":"2024-09-16T01:55:16.073842+0000","last_became_active":"2024-09-16T01:55:15.063973+0000","last_became_peered":"2024-09-16T01:55:15.063973+0000","last_unstale":"2024-09-16T01:55:16.073842+0000","last_undegraded":"2024-09-16T01:55:16.073842+0000","last_fullsized":"2024-09-16T01:55:16.073842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:09.430327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084476+0000","last_change":"2024-09-16T01:55:15.065269+0000","last_active":"2024-09-16T01:55:16.084476+0000","last_peered":"2024-09-16T01:55:16.084476+0000","last_clean":"2024-09-16T01:55:16.084476+0000","last_became_active":"2024-09-16T01:55:15.064860+0000","last_became_peered":"2024-09-16T01:55:15.064860+0000","last_unstale":"2024-09-16T01:55:16.084476+0000","last_undegraded":"2024-09-16T01:55:16.084476+0000","last_fullsized":"2024-09-16T01:55:16.084476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084926+0000","last_change":"2024-09-16T01:55:15.073040+0000","last_active":"2024-09-16T01:55:16.084926+0000","last_peered":"2024-09-16T01:55:16.084926+0000","last_clean":"2024-09-16T01:55:16.084926+0000","last_became_active":"2024-09-16T01:55:15.072416+0000","last_became_peered":"2024-09-16T01:55:15.072416+0000","last_unstale":"2024-09-16T01:55:16.084926+0000","last_undegraded":"2024-09-16T01:55:16.084926+0000","last_fullsized":"2024-09-16T01:55:16.084926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:27.331507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.062949+0000","last_change":"2024-09-16T01:55:15.071896+0000","last_active":"2024-09-16T01:55:16.062949+0000","last_peered":"2024-09-16T01:55:16.062949+0000","last_clean":"2024-09-16T01:55:16.062949+0000","last_became_active":"2024-09-16T01:55:15.071607+0000","last_became_peered":"2024-09-16T01:55:15.071607+0000","last_unstale":"2024-09-16T01:55:16.062949+0000","last_undegraded":"2024-09-16T01:55:16.062949+0000","last_fullsized":"2024-09-16T01:55:16.062949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:21.925734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063977+0000","last_change":"2024-09-16T01:55:15.066489+0000","last_active":"2024-09-16T01:55:16.063977+0000","last_peered":"2024-09-16T01:55:16.063977+0000","last_clean":"2024-09-16T01:55:16.063977+0000","last_became_active":"2024-09-16T01:55:15.066198+0000","last_became_peered":"2024-09-16T01:55:15.066198+0000","last_unstale":"2024-09-16T01:55:16.063977+0000","last_undegraded":"2024-09-16T01:55:16.063977+0000","last_fullsized":"2024-09-16T01:55:16.063977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085135+0000","last_change":"2024-09-16T01:55:15.065514+0000","last_active":"2024-09-16T01:55:16.085135+0000","last_peered":"2024-09-16T01:55:16.085135+0000","last_clean":"2024-09-16T01:55:16.085135+0000","last_became_active":"2024-09-16T01:55:15.064716+0000","last_became_peered":"2024-09-16T01:55:15.064716+0000","last_unstale":"2024-09-16T01:55:16.085135+0000","last_undegraded":"2024-09-16T01:55:16.085135+0000","last_fullsized":"2024-09-16T01:55:16.085135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:29.313718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063939+0000","last_change":"2024-09-16T01:55:15.074757+0000","last_active":"2024-09-16T01:55:16.063939+0000","last_peered":"2024-09-16T01:55:16.063939+0000","last_clean":"2024-09-16T01:55:16.063939+0000","last_became_active":"2024-09-16T01:55:15.074465+0000","last_became_peered":"2024-09-16T01:55:15.074465+0000","last_unstale":"2024-09-16T01:55:16.063939+0000","last_undegraded":"2024-09-16T01:55:16.063939+0000","last_fullsized":"2024-09-16T01:55:16.063939+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:17.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073829+0000","last_change":"2024-09-16T01:55:15.073726+0000","last_active":"2024-09-16T01:55:16.073829+0000","last_peered":"2024-09-16T01:55:16.073829+0000","last_clean":"2024-09-16T01:55:16.073829+0000","last_became_active":"2024-09-16T01:55:15.073453+0000","last_became_peered":"2024-09-16T01:55:15.073453+0000","last_unstale":"2024-09-16T01:55:16.073829+0000","last_undegraded":"2024-09-16T01:55:16.073829+0000","last_fullsized":"2024-09-16T01:55:16.073829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:03.836752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063633+0000","last_change":"2024-09-16T01:55:15.066587+0000","last_active":"2024-09-16T01:55:16.063633+0000","last_peered":"2024-09-16T01:55:16.063633+0000","last_clean":"2024-09-16T01:55:16.063633+0000","last_became_active":"2024-09-16T01:55:15.066292+0000","last_became_peered":"2024-09-16T01:55:15.066292+0000","last_unstale":"2024-09-16T01:55:16.063633+0000","last_undegraded":"2024-09-16T01:55:16.063633+0000","last_fullsized":"2024-09-16T01:55:16.063633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:53.621690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063647+0000","last_change":"2024-09-16T01:55:15.070192+0000","last_active":"2024-09-16T01:55:16.063647+0000","last_peered":"2024-09-16T01:55:16.063647+0000","last_clean":"2024-09-16T01:55:16.063647+0000","last_became_active":"2024-09-16T01:55:15.069764+0000","last_became_peered":"2024-09-16T01:55:15.069764+0000","last_unstale":"2024-09-16T01:55:16.063647+0000","last_undegraded":"2024-09-16T01:55:16.063647+0000","last_fullsized":"2024-09-16T01:55:16.063647+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:41.421049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085179+0000","last_change":"2024-09-16T01:55:15.073305+0000","last_active":"2024-09-16T01:55:16.085179+0000","last_peered":"2024-09-16T01:55:16.085179+0000","last_clean":"2024-09-16T01:55:16.085179+0000","last_became_active":"2024-09-16T01:55:15.072748+0000","last_became_peered":"2024-09-16T01:55:15.072748+0000","last_unstale":"2024-09-16T01:55:16.085179+0000","last_undegraded":"2024-09-16T01:55:16.085179+0000","last_fullsized":"2024-09-16T01:55:16.085179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:33.406872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084640+0000","last_change":"2024-09-16T01:55:15.063260+0000","last_active":"2024-09-16T01:55:16.084640+0000","last_peered":"2024-09-16T01:55:16.084640+0000","last_clean":"2024-09-16T01:55:16.084640+0000","last_became_active":"2024-09-16T01:55:15.062964+0000","last_became_peered":"2024-09-16T01:55:15.062964+0000","last_unstale":"2024-09-16T01:55:16.084640+0000","last_undegraded":"2024-09-16T01:55:16.084640+0000","last_fullsized":"2024-09-16T01:55:16.084640+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085048+0000","last_change":"2024-09-16T01:55:15.077723+0000","last_active":"2024-09-16T01:55:16.085048+0000","last_peered":"2024-09-16T01:55:16.085048+0000","last_clean":"2024-09-16T01:55:16.085048+0000","last_became_active":"2024-09-16T01:55:15.077428+0000","last_became_peered":"2024-09-16T01:55:15.077428+0000","last_unstale":"2024-09-16T01:55:16.085048+0000","last_undegraded":"2024-09-16T01:55:16.085048+0000","last_fullsized":"2024-09-16T01:55:16.085048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:32.871149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063830+0000","last_change":"2024-09-16T01:55:14.067402+0000","last_active":"2024-09-16T01:55:16.063830+0000","last_peered":"2024-09-16T01:55:16.063830+0000","last_clean":"2024-09-16T01:55:16.063830+0000","last_became_active":"2024-09-16T01:55:14.067117+0000","last_became_peered":"2024-09-16T01:55:14.067117+0000","last_unstale":"2024-09-16T01:55:16.063830+0000","last_undegraded":"2024-09-16T01:55:16.063830+0000","last_fullsized":"2024-09-16T01:55:16.063830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.523320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085344+0000","last_change":"2024-09-16T01:55:15.065086+0000","last_active":"2024-09-16T01:55:16.085344+0000","last_peered":"2024-09-16T01:55:16.085344+0000","last_clean":"2024-09-16T01:55:16.085344+0000","last_became_active":"2024-09-16T01:55:15.064785+0000","last_became_peered":"2024-09-16T01:55:15.064785+0000","last_unstale":"2024-09-16T01:55:16.085344+0000","last_undegraded":"2024-09-16T01:55:16.085344+0000","last_fullsized":"2024-09-16T01:55:16.085344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.571746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085610+0000","last_change":"2024-09-16T01:55:14.068738+0000","last_active":"2024-09-16T01:55:16.085610+0000","last_peered":"2024-09-16T01:55:16.085610+0000","last_clean":"2024-09-16T01:55:16.085610+0000","last_became_active":"2024-09-16T01:55:14.068402+0000","last_became_peered":"2024-09-16T01:55:14.068402+0000","last_unstale":"2024-09-16T01:55:16.085610+0000","last_undegraded":"2024-09-16T01:55:16.085610+0000","last_fullsized":"2024-09-16T01:55:16.085610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:12.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085308+0000","last_change":"2024-09-16T01:55:15.068471+0000","last_active":"2024-09-16T01:55:16.085308+0000","last_peered":"2024-09-16T01:55:16.085308+0000","last_clean":"2024-09-16T01:55:16.085308+0000","last_became_active":"2024-09-16T01:55:15.067998+0000","last_became_peered":"2024-09-16T01:55:15.067998+0000","last_unstale":"2024-09-16T01:55:16.085308+0000","last_undegraded":"2024-09-16T01:55:16.085308+0000","last_fullsized":"2024-09-16T01:55:16.085308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085352+0000","last_change":"2024-09-16T01:55:14.068740+0000","last_active":"2024-09-16T01:55:16.085352+0000","last_peered":"2024-09-16T01:55:16.085352+0000","last_clean":"2024-09-16T01:55:16.085352+0000","last_became_active":"2024-09-16T01:55:14.068436+0000","last_became_peered":"2024-09-16T01:55:14.068436+0000","last_unstale":"2024-09-16T01:55:16.085352+0000","last_undegraded":"2024-09-16T01:55:16.085352+0000","last_fullsized":"2024-09-16T01:55:16.085352+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084701+0000","last_change":"2024-09-16T01:55:15.073153+0000","last_active":"2024-09-16T01:55:16.084701+0000","last_peered":"2024-09-16T01:55:16.084701+0000","last_clean":"2024-09-16T01:55:16.084701+0000","last_became_active":"2024-09-16T01:55:15.072869+0000","last_became_peered":"2024-09-16T01:55:15.072869+0000","last_unstale":"2024-09-16T01:55:16.084701+0000","last_undegraded":"2024-09-16T01:55:16.084701+0000","last_fullsized":"2024-09-16T01:55:16.084701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:45:02.002197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084744+0000","last_change":"2024-09-16T01:55:14.064430+0000","last_active":"2024-09-16T01:55:16.084744+0000","last_peered":"2024-09-16T01:55:16.084744+0000","last_clean":"2024-09-16T01:55:16.084744+0000","last_became_active":"2024-09-16T01:55:14.064050+0000","last_became_peered":"2024-09-16T01:55:14.064050+0000","last_unstale":"2024-09-16T01:55:16.084744+0000","last_undegraded":"2024-09-16T01:55:16.084744+0000","last_fullsized":"2024-09-16T01:55:16.084744+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:08.025192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084471+0000","last_change":"2024-09-16T01:55:15.074074+0000","last_active":"2024-09-16T01:55:16.084471+0000","last_peered":"2024-09-16T01:55:16.084471+0000","last_clean":"2024-09-16T01:55:16.084471+0000","last_became_active":"2024-09-16T01:55:15.068752+0000","last_became_peered":"2024-09-16T01:55:15.068752+0000","last_unstale":"2024-09-16T01:55:16.084471+0000","last_undegraded":"2024-09-16T01:55:16.084471+0000","last_fullsized":"2024-09-16T01:55:16.084471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:26.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073881+0000","last_change":"2024-09-16T01:55:14.064060+0000","last_active":"2024-09-16T01:55:16.073881+0000","last_peered":"2024-09-16T01:55:16.073881+0000","last_clean":"2024-09-16T01:55:16.073881+0000","last_became_active":"2024-09-16T01:55:14.063169+0000","last_became_peered":"2024-09-16T01:55:14.063169+0000","last_unstale":"2024-09-16T01:55:16.073881+0000","last_undegraded":"2024-09-16T01:55:16.073881+0000","last_fullsized":"2024-09-16T01:55:16.073881+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073843+0000","last_change":"2024-09-16T01:55:15.066922+0000","last_active":"2024-09-16T01:55:16.073843+0000","last_peered":"2024-09-16T01:55:16.073843+0000","last_clean":"2024-09-16T01:55:16.073843+0000","last_became_active":"2024-09-16T01:55:15.063924+0000","last_became_peered":"2024-09-16T01:55:15.063924+0000","last_unstale":"2024-09-16T01:55:16.073843+0000","last_undegraded":"2024-09-16T01:55:16.073843+0000","last_fullsized":"2024-09-16T01:55:16.073843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:28.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085003+0000","last_change":"2024-09-16T01:55:14.069962+0000","last_active":"2024-09-16T01:55:16.085003+0000","last_peered":"2024-09-16T01:55:16.085003+0000","last_clean":"2024-09-16T01:55:16.085003+0000","last_became_active":"2024-09-16T01:55:14.069656+0000","last_became_peered":"2024-09-16T01:55:14.069656+0000","last_unstale":"2024-09-16T01:55:16.085003+0000","last_undegraded":"2024-09-16T01:55:16.085003+0000","last_fullsized":"2024-09-16T01:55:16.085003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:51.587582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084638+0000","last_change":"2024-09-16T01:55:15.065460+0000","last_active":"2024-09-16T01:55:16.084638+0000","last_peered":"2024-09-16T01:55:16.084638+0000","last_clean":"2024-09-16T01:55:16.084638+0000","last_became_active":"2024-09-16T01:55:15.065203+0000","last_became_peered":"2024-09-16T01:55:15.065203+0000","last_unstale":"2024-09-16T01:55:16.084638+0000","last_undegraded":"2024-09-16T01:55:16.084638+0000","last_fullsized":"2024-09-16T01:55:16.084638+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:26.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084742+0000","last_change":"2024-09-16T01:55:14.063567+0000","last_active":"2024-09-16T01:55:16.084742+0000","last_peered":"2024-09-16T01:55:16.084742+0000","last_clean":"2024-09-16T01:55:16.084742+0000","last_became_active":"2024-09-16T01:55:14.063264+0000","last_became_peered":"2024-09-16T01:55:14.063264+0000","last_unstale":"2024-09-16T01:55:16.084742+0000","last_undegraded":"2024-09-16T01:55:16.084742+0000","last_fullsized":"2024-09-16T01:55:16.084742+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:12.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084283+0000","last_change":"2024-09-16T01:55:15.067811+0000","last_active":"2024-09-16T01:55:16.084283+0000","last_peered":"2024-09-16T01:55:16.084283+0000","last_clean":"2024-09-16T01:55:16.084283+0000","last_became_active":"2024-09-16T01:55:15.067505+0000","last_became_peered":"2024-09-16T01:55:15.067505+0000","last_unstale":"2024-09-16T01:55:16.084283+0000","last_undegraded":"2024-09-16T01:55:16.084283+0000","last_fullsized":"2024-09-16T01:55:16.084283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:09.430327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084226+0000","last_change":"2024-09-16T01:55:14.067645+0000","last_active":"2024-09-16T01:55:16.084226+0000","last_peered":"2024-09-16T01:55:16.084226+0000","last_clean":"2024-09-16T01:55:16.084226+0000","last_became_active":"2024-09-16T01:55:14.067386+0000","last_became_peered":"2024-09-16T01:55:14.067386+0000","last_unstale":"2024-09-16T01:55:16.084226+0000","last_undegraded":"2024-09-16T01:55:16.084226+0000","last_fullsized":"2024-09-16T01:55:16.084226+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:19.662035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063284+0000","last_change":"2024-09-16T01:55:15.058622+0000","last_active":"2024-09-16T01:55:16.063284+0000","last_peered":"2024-09-16T01:55:16.063284+0000","last_clean":"2024-09-16T01:55:16.063284+0000","last_became_active":"2024-09-16T01:55:15.057958+0000","last_became_peered":"2024-09-16T01:55:15.057958+0000","last_unstale":"2024-09-16T01:55:16.063284+0000","last_undegraded":"2024-09-16T01:55:16.063284+0000","last_fullsized":"2024-09-16T01:55:16.063284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:54.514922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084928+0000","last_change":"2024-09-16T01:55:14.057478+0000","last_active":"2024-09-16T01:55:16.084928+0000","last_peered":"2024-09-16T01:55:16.084928+0000","last_clean":"2024-09-16T01:55:16.084928+0000","last_became_active":"2024-09-16T01:55:14.057199+0000","last_became_peered":"2024-09-16T01:55:14.057199+0000","last_unstale":"2024-09-16T01:55:16.084928+0000","last_undegraded":"2024-09-16T01:55:16.084928+0000","last_fullsized":"2024-09-16T01:55:16.084928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:26.749150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084884+0000","last_change":"2024-09-16T01:55:15.069263+0000","last_active":"2024-09-16T01:55:16.084884+0000","last_peered":"2024-09-16T01:55:16.084884+0000","last_clean":"2024-09-16T01:55:16.084884+0000","last_became_active":"2024-09-16T01:55:15.068968+0000","last_became_peered":"2024-09-16T01:55:15.068968+0000","last_unstale":"2024-09-16T01:55:16.084884+0000","last_undegraded":"2024-09-16T01:55:16.084884+0000","last_fullsized":"2024-09-16T01:55:16.084884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:43.341336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.074176+0000","last_change":"2024-09-16T01:55:14.068900+0000","last_active":"2024-09-16T01:55:16.074176+0000","last_peered":"2024-09-16T01:55:16.074176+0000","last_clean":"2024-09-16T01:55:16.074176+0000","last_became_active":"2024-09-16T01:55:14.066896+0000","last_became_peered":"2024-09-16T01:55:14.066896+0000","last_unstale":"2024-09-16T01:55:16.074176+0000","last_undegraded":"2024-09-16T01:55:16.074176+0000","last_fullsized":"2024-09-16T01:55:16.074176+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:38.976382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085637+0000","last_change":"2024-09-16T01:55:15.069993+0000","last_active":"2024-09-16T01:55:16.085637+0000","last_peered":"2024-09-16T01:55:16.085637+0000","last_clean":"2024-09-16T01:55:16.085637+0000","last_became_active":"2024-09-16T01:55:15.068922+0000","last_became_peered":"2024-09-16T01:55:15.068922+0000","last_unstale":"2024-09-16T01:55:16.085637+0000","last_undegraded":"2024-09-16T01:55:16.085637+0000","last_fullsized":"2024-09-16T01:55:16.085637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:29.313718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.074156+0000","last_change":"2024-09-16T01:55:14.065656+0000","last_active":"2024-09-16T01:55:16.074156+0000","last_peered":"2024-09-16T01:55:16.074156+0000","last_clean":"2024-09-16T01:55:16.074156+0000","last_became_active":"2024-09-16T01:55:14.065390+0000","last_became_peered":"2024-09-16T01:55:14.065390+0000","last_unstale":"2024-09-16T01:55:16.074156+0000","last_undegraded":"2024-09-16T01:55:16.074156+0000","last_fullsized":"2024-09-16T01:55:16.074156+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:17.922515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085038+0000","last_change":"2024-09-16T01:55:15.061491+0000","last_active":"2024-09-16T01:55:16.085038+0000","last_peered":"2024-09-16T01:55:16.085038+0000","last_clean":"2024-09-16T01:55:16.085038+0000","last_became_active":"2024-09-16T01:55:15.060771+0000","last_became_peered":"2024-09-16T01:55:15.060771+0000","last_unstale":"2024-09-16T01:55:16.085038+0000","last_undegraded":"2024-09-16T01:55:16.085038+0000","last_fullsized":"2024-09-16T01:55:16.085038+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084766+0000","last_change":"2024-09-16T01:55:14.066984+0000","last_active":"2024-09-16T01:55:16.084766+0000","last_peered":"2024-09-16T01:55:16.084766+0000","last_clean":"2024-09-16T01:55:16.084766+0000","last_became_active":"2024-09-16T01:55:14.066574+0000","last_became_peered":"2024-09-16T01:55:14.066574+0000","last_unstale":"2024-09-16T01:55:16.084766+0000","last_undegraded":"2024-09-16T01:55:16.084766+0000","last_fullsized":"2024-09-16T01:55:16.084766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:16.713685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084493+0000","last_change":"2024-09-16T01:55:15.075252+0000","last_active":"2024-09-16T01:55:16.084493+0000","last_peered":"2024-09-16T01:55:16.084493+0000","last_clean":"2024-09-16T01:55:16.084493+0000","last_became_active":"2024-09-16T01:55:15.074981+0000","last_became_peered":"2024-09-16T01:55:15.074981+0000","last_unstale":"2024-09-16T01:55:16.084493+0000","last_undegraded":"2024-09-16T01:55:16.084493+0000","last_fullsized":"2024-09-16T01:55:16.084493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:50.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085051+0000","last_change":"2024-09-16T01:55:14.065205+0000","last_active":"2024-09-16T01:55:16.085051+0000","last_peered":"2024-09-16T01:55:16.085051+0000","last_clean":"2024-09-16T01:55:16.085051+0000","last_became_active":"2024-09-16T01:55:14.064867+0000","last_became_peered":"2024-09-16T01:55:14.064867+0000","last_unstale":"2024-09-16T01:55:16.085051+0000","last_undegraded":"2024-09-16T01:55:16.085051+0000","last_fullsized":"2024-09-16T01:55:16.085051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:40.415556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084243+0000","last_change":"2024-09-16T01:55:15.065359+0000","last_active":"2024-09-16T01:55:16.084243+0000","last_peered":"2024-09-16T01:55:16.084243+0000","last_clean":"2024-09-16T01:55:16.084243+0000","last_became_active":"2024-09-16T01:55:15.065061+0000","last_became_peered":"2024-09-16T01:55:15.065061+0000","last_unstale":"2024-09-16T01:55:16.084243+0000","last_undegraded":"2024-09-16T01:55:16.084243+0000","last_fullsized":"2024-09-16T01:55:16.084243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:28.016571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085155+0000","last_change":"2024-09-16T01:55:14.070545+0000","last_active":"2024-09-16T01:55:16.085155+0000","last_peered":"2024-09-16T01:55:16.085155+0000","last_clean":"2024-09-16T01:55:16.085155+0000","last_became_active":"2024-09-16T01:55:14.070303+0000","last_became_peered":"2024-09-16T01:55:14.070303+0000","last_unstale":"2024-09-16T01:55:16.085155+0000","last_undegraded":"2024-09-16T01:55:16.085155+0000","last_fullsized":"2024-09-16T01:55:16.085155+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:38.976382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085163+0000","last_change":"2024-09-16T01:55:15.076113+0000","last_active":"2024-09-16T01:55:16.085163+0000","last_peered":"2024-09-16T01:55:16.085163+0000","last_clean":"2024-09-16T01:55:16.085163+0000","last_became_active":"2024-09-16T01:55:15.075909+0000","last_became_peered":"2024-09-16T01:55:15.075909+0000","last_unstale":"2024-09-16T01:55:16.085163+0000","last_undegraded":"2024-09-16T01:55:16.085163+0000","last_fullsized":"2024-09-16T01:55:16.085163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:07.446113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063400+0000","last_change":"2024-09-16T01:55:14.067297+0000","last_active":"2024-09-16T01:55:16.063400+0000","last_peered":"2024-09-16T01:55:16.063400+0000","last_clean":"2024-09-16T01:55:16.063400+0000","last_became_active":"2024-09-16T01:55:14.066981+0000","last_became_peered":"2024-09-16T01:55:14.066981+0000","last_unstale":"2024-09-16T01:55:16.063400+0000","last_undegraded":"2024-09-16T01:55:16.063400+0000","last_fullsized":"2024-09-16T01:55:16.063400+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:17.010112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084952+0000","last_change":"2024-09-16T01:55:15.067563+0000","last_active":"2024-09-16T01:55:16.084952+0000","last_peered":"2024-09-16T01:55:16.084952+0000","last_clean":"2024-09-16T01:55:16.084952+0000","last_became_active":"2024-09-16T01:55:15.066882+0000","last_became_peered":"2024-09-16T01:55:15.066882+0000","last_unstale":"2024-09-16T01:55:16.084952+0000","last_undegraded":"2024-09-16T01:55:16.084952+0000","last_fullsized":"2024-09-16T01:55:16.084952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:21:49.451175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084691+0000","last_change":"2024-09-16T01:55:14.069309+0000","last_active":"2024-09-16T01:55:16.084691+0000","last_peered":"2024-09-16T01:55:16.084691+0000","last_clean":"2024-09-16T01:55:16.084691+0000","last_became_active":"2024-09-16T01:55:14.069018+0000","last_became_peered":"2024-09-16T01:55:14.069018+0000","last_unstale":"2024-09-16T01:55:16.084691+0000","last_undegraded":"2024-09-16T01:55:16.084691+0000","last_fullsized":"2024-09-16T01:55:16.084691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:59.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084677+0000","last_change":"2024-09-16T01:55:15.069351+0000","last_active":"2024-09-16T01:55:16.084677+0000","last_peered":"2024-09-16T01:55:16.084677+0000","last_clean":"2024-09-16T01:55:16.084677+0000","last_became_active":"2024-09-16T01:55:15.068952+0000","last_became_peered":"2024-09-16T01:55:15.068952+0000","last_unstale":"2024-09-16T01:55:16.084677+0000","last_undegraded":"2024-09-16T01:55:16.084677+0000","last_fullsized":"2024-09-16T01:55:16.084677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:42.823688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.074185+0000","last_change":"2024-09-16T01:55:14.068287+0000","last_active":"2024-09-16T01:55:16.074185+0000","last_peered":"2024-09-16T01:55:16.074185+0000","last_clean":"2024-09-16T01:55:16.074185+0000","last_became_active":"2024-09-16T01:55:14.066615+0000","last_became_peered":"2024-09-16T01:55:14.066615+0000","last_unstale":"2024-09-16T01:55:16.074185+0000","last_undegraded":"2024-09-16T01:55:16.074185+0000","last_fullsized":"2024-09-16T01:55:16.074185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:52.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.074115+0000","last_change":"2024-09-16T01:55:15.071381+0000","last_active":"2024-09-16T01:55:16.074115+0000","last_peered":"2024-09-16T01:55:16.074115+0000","last_clean":"2024-09-16T01:55:16.074115+0000","last_became_active":"2024-09-16T01:55:15.071076+0000","last_became_peered":"2024-09-16T01:55:15.071076+0000","last_unstale":"2024-09-16T01:55:16.074115+0000","last_undegraded":"2024-09-16T01:55:16.074115+0000","last_fullsized":"2024-09-16T01:55:16.074115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:21:49.451175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085296+0000","last_change":"2024-09-16T01:55:14.070457+0000","last_active":"2024-09-16T01:55:16.085296+0000","last_peered":"2024-09-16T01:55:16.085296+0000","last_clean":"2024-09-16T01:55:16.085296+0000","last_became_active":"2024-09-16T01:55:14.070109+0000","last_became_peered":"2024-09-16T01:55:14.070109+0000","last_unstale":"2024-09-16T01:55:16.085296+0000","last_undegraded":"2024-09-16T01:55:16.085296+0000","last_fullsized":"2024-09-16T01:55:16.085296+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.523320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085199+0000","last_change":"2024-09-16T01:55:15.062497+0000","last_active":"2024-09-16T01:55:16.085199+0000","last_peered":"2024-09-16T01:55:16.085199+0000","last_clean":"2024-09-16T01:55:16.085199+0000","last_became_active":"2024-09-16T01:55:15.062232+0000","last_became_peered":"2024-09-16T01:55:15.062232+0000","last_unstale":"2024-09-16T01:55:16.085199+0000","last_undegraded":"2024-09-16T01:55:16.085199+0000","last_fullsized":"2024-09-16T01:55:16.085199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063347+0000","last_change":"2024-09-16T01:55:14.069579+0000","last_active":"2024-09-16T01:55:16.063347+0000","last_peered":"2024-09-16T01:55:16.063347+0000","last_clean":"2024-09-16T01:55:16.063347+0000","last_became_active":"2024-09-16T01:55:14.069262+0000","last_became_peered":"2024-09-16T01:55:14.069262+0000","last_unstale":"2024-09-16T01:55:16.063347+0000","last_undegraded":"2024-09-16T01:55:16.063347+0000","last_fullsized":"2024-09-16T01:55:16.063347+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:18.137110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063308+0000","last_change":"2024-09-16T01:55:15.061094+0000","last_active":"2024-09-16T01:55:16.063308+0000","last_peered":"2024-09-16T01:55:16.063308+0000","last_clean":"2024-09-16T01:55:16.063308+0000","last_became_active":"2024-09-16T01:55:15.060812+0000","last_became_peered":"2024-09-16T01:55:15.060812+0000","last_unstale":"2024-09-16T01:55:16.063308+0000","last_undegraded":"2024-09-16T01:55:16.063308+0000","last_fullsized":"2024-09-16T01:55:16.063308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:52.593075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084815+0000","last_change":"2024-09-16T01:55:14.064373+0000","last_active":"2024-09-16T01:55:16.084815+0000","last_peered":"2024-09-16T01:55:16.084815+0000","last_clean":"2024-09-16T01:55:16.084815+0000","last_became_active":"2024-09-16T01:55:14.064081+0000","last_became_peered":"2024-09-16T01:55:14.064081+0000","last_unstale":"2024-09-16T01:55:16.084815+0000","last_undegraded":"2024-09-16T01:55:16.084815+0000","last_fullsized":"2024-09-16T01:55:16.084815+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:17.922515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084917+0000","last_change":"2024-09-16T01:55:15.076715+0000","last_active":"2024-09-16T01:55:16.084917+0000","last_peered":"2024-09-16T01:55:16.084917+0000","last_clean":"2024-09-16T01:55:16.084917+0000","last_became_active":"2024-09-16T01:55:15.076472+0000","last_became_peered":"2024-09-16T01:55:15.076472+0000","last_unstale":"2024-09-16T01:55:16.084917+0000","last_undegraded":"2024-09-16T01:55:16.084917+0000","last_fullsized":"2024-09-16T01:55:16.084917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:58.671233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063132+0000","last_change":"2024-09-16T01:55:14.064714+0000","last_active":"2024-09-16T01:55:16.063132+0000","last_peered":"2024-09-16T01:55:16.063132+0000","last_clean":"2024-09-16T01:55:16.063132+0000","last_became_active":"2024-09-16T01:55:14.064423+0000","last_became_peered":"2024-09-16T01:55:14.064423+0000","last_unstale":"2024-09-16T01:55:16.063132+0000","last_undegraded":"2024-09-16T01:55:16.063132+0000","last_fullsized":"2024-09-16T01:55:16.063132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:02.564362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085602+0000","last_change":"2024-09-16T01:55:15.068101+0000","last_active":"2024-09-16T01:55:16.085602+0000","last_peered":"2024-09-16T01:55:16.085602+0000","last_clean":"2024-09-16T01:55:16.085602+0000","last_became_active":"2024-09-16T01:55:15.067812+0000","last_became_peered":"2024-09-16T01:55:15.067812+0000","last_unstale":"2024-09-16T01:55:16.085602+0000","last_undegraded":"2024-09-16T01:55:16.085602+0000","last_fullsized":"2024-09-16T01:55:16.085602+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063005+0000","last_change":"2024-09-16T01:55:14.063203+0000","last_active":"2024-09-16T01:55:16.063005+0000","last_peered":"2024-09-16T01:55:16.063005+0000","last_clean":"2024-09-16T01:55:16.063005+0000","last_became_active":"2024-09-16T01:55:14.062940+0000","last_became_peered":"2024-09-16T01:55:14.062940+0000","last_unstale":"2024-09-16T01:55:16.063005+0000","last_undegraded":"2024-09-16T01:55:16.063005+0000","last_fullsized":"2024-09-16T01:55:16.063005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:56.080694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073726+0000","last_change":"2024-09-16T01:55:15.071198+0000","last_active":"2024-09-16T01:55:16.073726+0000","last_peered":"2024-09-16T01:55:16.073726+0000","last_clean":"2024-09-16T01:55:16.073726+0000","last_became_active":"2024-09-16T01:55:15.070942+0000","last_became_peered":"2024-09-16T01:55:15.070942+0000","last_unstale":"2024-09-16T01:55:16.073726+0000","last_undegraded":"2024-09-16T01:55:16.073726+0000","last_fullsized":"2024-09-16T01:55:16.073726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:18.529028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085130+0000","last_change":"2024-09-16T01:55:14.067817+0000","last_active":"2024-09-16T01:55:16.085130+0000","last_peered":"2024-09-16T01:55:16.085130+0000","last_clean":"2024-09-16T01:55:16.085130+0000","last_became_active":"2024-09-16T01:55:14.067547+0000","last_became_peered":"2024-09-16T01:55:14.067547+0000","last_unstale":"2024-09-16T01:55:16.085130+0000","last_undegraded":"2024-09-16T01:55:16.085130+0000","last_fullsized":"2024-09-16T01:55:16.085130+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:04.636139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085131+0000","last_change":"2024-09-16T01:55:15.067797+0000","last_active":"2024-09-16T01:55:16.085131+0000","last_peered":"2024-09-16T01:55:16.085131+0000","last_clean":"2024-09-16T01:55:16.085131+0000","last_became_active":"2024-09-16T01:55:15.067256+0000","last_became_peered":"2024-09-16T01:55:15.067256+0000","last_unstale":"2024-09-16T01:55:16.085131+0000","last_undegraded":"2024-09-16T01:55:16.085131+0000","last_fullsized":"2024-09-16T01:55:16.085131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:52.490968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.062931+0000","last_change":"2024-09-16T01:55:14.061458+0000","last_active":"2024-09-16T01:55:16.062931+0000","last_peered":"2024-09-16T01:55:16.062931+0000","last_clean":"2024-09-16T01:55:16.062931+0000","last_became_active":"2024-09-16T01:55:14.061101+0000","last_became_peered":"2024-09-16T01:55:14.061101+0000","last_unstale":"2024-09-16T01:55:16.062931+0000","last_undegraded":"2024-09-16T01:55:16.062931+0000","last_fullsized":"2024-09-16T01:55:16.062931+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:13.570291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084746+0000","last_change":"2024-09-16T01:55:15.072888+0000","last_active":"2024-09-16T01:55:16.084746+0000","last_peered":"2024-09-16T01:55:16.084746+0000","last_clean":"2024-09-16T01:55:16.084746+0000","last_became_active":"2024-09-16T01:55:15.072571+0000","last_became_peered":"2024-09-16T01:55:15.072571+0000","last_unstale":"2024-09-16T01:55:16.084746+0000","last_undegraded":"2024-09-16T01:55:16.084746+0000","last_fullsized":"2024-09-16T01:55:16.084746+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.929339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.074276+0000","last_change":"2024-09-16T01:55:14.066143+0000","last_active":"2024-09-16T01:55:16.074276+0000","last_peered":"2024-09-16T01:55:16.074276+0000","last_clean":"2024-09-16T01:55:16.074276+0000","last_became_active":"2024-09-16T01:55:14.065838+0000","last_became_peered":"2024-09-16T01:55:14.065838+0000","last_unstale":"2024-09-16T01:55:16.074276+0000","last_undegraded":"2024-09-16T01:55:16.074276+0000","last_fullsized":"2024-09-16T01:55:16.074276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:07.689683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085052+0000","last_change":"2024-09-16T01:55:15.069700+0000","last_active":"2024-09-16T01:55:16.085052+0000","last_peered":"2024-09-16T01:55:16.085052+0000","last_clean":"2024-09-16T01:55:16.085052+0000","last_became_active":"2024-09-16T01:55:15.069421+0000","last_became_peered":"2024-09-16T01:55:15.069421+0000","last_unstale":"2024-09-16T01:55:16.085052+0000","last_undegraded":"2024-09-16T01:55:16.085052+0000","last_fullsized":"2024-09-16T01:55:16.085052+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:03.773794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.073154+0000","last_change":"2024-09-16T01:55:14.064101+0000","last_active":"2024-09-16T01:55:16.073154+0000","last_peered":"2024-09-16T01:55:16.073154+0000","last_clean":"2024-09-16T01:55:16.073154+0000","last_became_active":"2024-09-16T01:55:14.063782+0000","last_became_peered":"2024-09-16T01:55:14.063782+0000","last_unstale":"2024-09-16T01:55:16.073154+0000","last_undegraded":"2024-09-16T01:55:16.073154+0000","last_fullsized":"2024-09-16T01:55:16.073154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:53.149175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085291+0000","last_change":"2024-09-16T01:55:15.066052+0000","last_active":"2024-09-16T01:55:16.085291+0000","last_peered":"2024-09-16T01:55:16.085291+0000","last_clean":"2024-09-16T01:55:16.085291+0000","last_became_active":"2024-09-16T01:55:15.065771+0000","last_became_peered":"2024-09-16T01:55:15.065771+0000","last_unstale":"2024-09-16T01:55:16.085291+0000","last_undegraded":"2024-09-16T01:55:16.085291+0000","last_fullsized":"2024-09-16T01:55:16.085291+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:17.572186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085703+0000","last_change":"2024-09-16T01:55:14.064829+0000","last_active":"2024-09-16T01:55:16.085703+0000","last_peered":"2024-09-16T01:55:16.085703+0000","last_clean":"2024-09-16T01:55:16.085703+0000","last_became_active":"2024-09-16T01:55:14.064531+0000","last_became_peered":"2024-09-16T01:55:14.064531+0000","last_unstale":"2024-09-16T01:55:16.085703+0000","last_undegraded":"2024-09-16T01:55:16.085703+0000","last_fullsized":"2024-09-16T01:55:16.085703+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:41.155579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085496+0000","last_change":"2024-09-16T01:55:15.074355+0000","last_active":"2024-09-16T01:55:16.085496+0000","last_peered":"2024-09-16T01:55:16.085496+0000","last_clean":"2024-09-16T01:55:16.085496+0000","last_became_active":"2024-09-16T01:55:15.071086+0000","last_became_peered":"2024-09-16T01:55:15.071086+0000","last_unstale":"2024-09-16T01:55:16.085496+0000","last_undegraded":"2024-09-16T01:55:16.085496+0000","last_fullsized":"2024-09-16T01:55:16.085496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085812+0000","last_change":"2024-09-16T01:55:14.067246+0000","last_active":"2024-09-16T01:55:16.085812+0000","last_peered":"2024-09-16T01:55:16.085812+0000","last_clean":"2024-09-16T01:55:16.085812+0000","last_became_active":"2024-09-16T01:55:14.066819+0000","last_became_peered":"2024-09-16T01:55:14.066819+0000","last_unstale":"2024-09-16T01:55:16.085812+0000","last_undegraded":"2024-09-16T01:55:16.085812+0000","last_fullsized":"2024-09-16T01:55:16.085812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:26.837886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084720+0000","last_change":"2024-09-16T01:55:15.069885+0000","last_active":"2024-09-16T01:55:16.084720+0000","last_peered":"2024-09-16T01:55:16.084720+0000","last_clean":"2024-09-16T01:55:16.084720+0000","last_became_active":"2024-09-16T01:55:15.068666+0000","last_became_peered":"2024-09-16T01:55:15.068666+0000","last_unstale":"2024-09-16T01:55:16.084720+0000","last_undegraded":"2024-09-16T01:55:16.084720+0000","last_fullsized":"2024-09-16T01:55:16.084720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:09.033077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.063542+0000","last_change":"2024-09-16T01:55:14.064031+0000","last_active":"2024-09-16T01:55:16.063542+0000","last_peered":"2024-09-16T01:55:16.063542+0000","last_clean":"2024-09-16T01:55:16.063542+0000","last_became_active":"2024-09-16T01:55:14.063686+0000","last_became_peered":"2024-09-16T01:55:14.063686+0000","last_unstale":"2024-09-16T01:55:16.063542+0000","last_undegraded":"2024-09-16T01:55:16.063542+0000","last_fullsized":"2024-09-16T01:55:16.063542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:19.662035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084582+0000","last_change":"2024-09-16T01:55:15.058905+0000","last_active":"2024-09-16T01:55:16.084582+0000","last_peered":"2024-09-16T01:55:16.084582+0000","last_clean":"2024-09-16T01:55:16.084582+0000","last_became_active":"2024-09-16T01:55:15.058632+0000","last_became_peered":"2024-09-16T01:55:15.058632+0000","last_unstale":"2024-09-16T01:55:16.084582+0000","last_undegraded":"2024-09-16T01:55:16.084582+0000","last_fullsized":"2024-09-16T01:55:16.084582+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.754643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084314+0000","last_change":"2024-09-16T01:55:14.064739+0000","last_active":"2024-09-16T01:55:16.084314+0000","last_peered":"2024-09-16T01:55:16.084314+0000","last_clean":"2024-09-16T01:55:16.084314+0000","last_became_active":"2024-09-16T01:55:14.064446+0000","last_became_peered":"2024-09-16T01:55:14.064446+0000","last_unstale":"2024-09-16T01:55:16.084314+0000","last_undegraded":"2024-09-16T01:55:16.084314+0000","last_fullsized":"2024-09-16T01:55:16.084314+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:41.155579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085472+0000","last_change":"2024-09-16T01:55:15.067797+0000","last_active":"2024-09-16T01:55:16.085472+0000","last_peered":"2024-09-16T01:55:16.085472+0000","last_clean":"2024-09-16T01:55:16.085472+0000","last_became_active":"2024-09-16T01:55:15.067516+0000","last_became_peered":"2024-09-16T01:55:15.067516+0000","last_unstale":"2024-09-16T01:55:16.085472+0000","last_undegraded":"2024-09-16T01:55:16.085472+0000","last_fullsized":"2024-09-16T01:55:16.085472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:08.090326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084132+0000","last_change":"2024-09-16T01:55:14.057198+0000","last_active":"2024-09-16T01:55:16.084132+0000","last_peered":"2024-09-16T01:55:16.084132+0000","last_clean":"2024-09-16T01:55:16.084132+0000","last_became_active":"2024-09-16T01:55:14.056723+0000","last_became_peered":"2024-09-16T01:55:14.056723+0000","last_unstale":"2024-09-16T01:55:16.084132+0000","last_undegraded":"2024-09-16T01:55:16.084132+0000","last_fullsized":"2024-09-16T01:55:16.084132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:53.464988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.074131+0000","last_change":"2024-09-16T01:55:15.074182+0000","last_active":"2024-09-16T01:55:16.074131+0000","last_peered":"2024-09-16T01:55:16.074131+0000","last_clean":"2024-09-16T01:55:16.074131+0000","last_became_active":"2024-09-16T01:55:15.073915+0000","last_became_peered":"2024-09-16T01:55:15.073915+0000","last_unstale":"2024-09-16T01:55:16.074131+0000","last_undegraded":"2024-09-16T01:55:16.074131+0000","last_fullsized":"2024-09-16T01:55:16.074131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:14.040041+0000","last_clean_scrub_stamp":"2024-09-16T01:55:14.040041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:13.405870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.085087+0000","last_change":"2024-09-16T01:55:14.068542+0000","last_active":"2024-09-16T01:55:16.085087+0000","last_peered":"2024-09-16T01:55:16.085087+0000","last_clean":"2024-09-16T01:55:16.085087+0000","last_became_active":"2024-09-16T01:55:14.068228+0000","last_became_peered":"2024-09-16T01:55:14.068228+0000","last_unstale":"2024-09-16T01:55:16.085087+0000","last_undegraded":"2024-09-16T01:55:16.085087+0000","last_fullsized":"2024-09-16T01:55:16.085087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:13.034548+0000","last_clean_scrub_stamp":"2024-09-16T01:55:13.034548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:53.509430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T01:55:16.084969+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:55:16.084969+0000","last_peered":"2024-09-16T01:55:16.084969+0000","last_clean":"2024-09-16T01:55:16.084969+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:55:16.084969+0000","last_undegraded":"2024-09-16T01:55:16.084969+0000","last_fullsized":"2024-09-16T01:55:16.084969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":185882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":438272,"data_stored":185412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":438272,"data_stored":185904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":446464,"data_stored":186946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":434176,"data_stored":185390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1028096,"data_stored":775702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":777350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":434176,"data_stored":185370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:55:22.789 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:55:22.789 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:55:22.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.934+0000 7ff0c2f49640 1 Processor -- start 2024-09-16T01:55:22.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.934+0000 7ff0c2f49640 1 -- start start 2024-09-16T01:55:22.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.934+0000 7ff0c2f49640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0bc0b5fe0 0x7ff0bc0aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.934+0000 7ff0c2f49640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0bc06bc10 0x7ff0bc06c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.934+0000 7ff0c2f49640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0bc0ae240 con 0x7ff0bc15e410 2024-09-16T01:55:22.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.934+0000 7ff0c2f49640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff0bc0b6430 con 0x7ff0bc06bc10 2024-09-16T01:55:22.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.935+0000 7ff0c2f49640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc06c580 con 0x7ff0bc0b5fe0 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.935+0000 7ff0c14e6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0bc06bc10 0x7ff0bc06c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.935+0000 7ff0c14e6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0bc06bc10 0x7ff0bc06c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48042/0 (socket says 172.21.15.42:48042) 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.935+0000 7ff0c14e6640 1 -- 172.21.15.42:0/3710422747 learned_addr learned my addr 172.21.15.42:0/3710422747 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.935+0000 7ff0bbfff640 1 --2- 172.21.15.42:0/3710422747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0bc0b5fe0 0x7ff0bc0aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.935+0000 7ff0c14e6640 1 -- 172.21.15.42:0/3710422747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0bc0b5fe0 msgr2=0x7ff0bc0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.935+0000 7ff0c14e6640 1 --2- 172.21.15.42:0/3710422747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0bc0b5fe0 0x7ff0bc0aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.935+0000 7ff0c14e6640 1 -- 172.21.15.42:0/3710422747 >> v1:172.21.15.42:6789/0 conn(0x7ff0bc15e410 legacy=0x7ff0bc0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.935+0000 7ff0c14e6640 1 -- 172.21.15.42:0/3710422747 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc0ae520 con 0x7ff0bc06bc10 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.936+0000 7ff0c14e6640 1 --2- 172.21.15.42:0/3710422747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc06bc10 0x7ff0bc06c040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40098a0 tx=0x7ff0b402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d405208b692634cb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.936+0000 7ff0bb7fe640 1 -- 172.21.15.42:0/3710422747 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4037070 con 0x7ff0bc06bc10 2024-09-16T01:55:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.936+0000 7ff0bb7fe640 1 -- 172.21.15.42:0/3710422747 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b4032440 con 0x7ff0bc06bc10 2024-09-16T01:55:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.936+0000 7ff0bb7fe640 1 -- 172.21.15.42:0/3710422747 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4032810 con 0x7ff0bc06bc10 2024-09-16T01:55:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.936+0000 7ff0c2f49640 1 -- 172.21.15.42:0/3710422747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc06bc10 msgr2=0x7ff0bc06c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.936+0000 7ff0c2f49640 1 --2- 172.21.15.42:0/3710422747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc06bc10 0x7ff0bc06c040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40098a0 tx=0x7ff0b402a200 comp rx=0 tx=0).stop 2024-09-16T01:55:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.936+0000 7ff0c2f49640 1 -- 172.21.15.42:0/3710422747 shutdown_connections 2024-09-16T01:55:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.936+0000 7ff0c2f49640 1 --2- 172.21.15.42:0/3710422747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc06bc10 0x7ff0bc06c040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.936+0000 7ff0c2f49640 1 --2- 172.21.15.42:0/3710422747 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0bc0b5fe0 0x7ff0bc0aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.936+0000 7ff0c2f49640 1 -- 172.21.15.42:0/3710422747 >> 172.21.15.42:0/3710422747 conn(0x7ff0bc09aa30 msgr2=0x7ff0bc0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.937+0000 7ff0c2f49640 1 -- 172.21.15.42:0/3710422747 shutdown_connections 2024-09-16T01:55:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.937+0000 7ff0c2f49640 1 -- 172.21.15.42:0/3710422747 wait complete. 2024-09-16T01:55:22.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.938+0000 7ff0c2f49640 1 Processor -- start 2024-09-16T01:55:22.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.938+0000 7ff0c2f49640 1 -- start start 2024-09-16T01:55:22.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c2f49640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0bc06bc10 0x7ff0bc154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c2f49640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0bc0b5fe0 0x7ff0bc09b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c2f49640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc15e410 0x7ff0bc1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c2f49640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc0b0480 con 0x7ff0bc15e410 2024-09-16T01:55:22.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c2f49640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc0aeae0 con 0x7ff0bc06bc10 2024-09-16T01:55:22.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c2f49640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc15e7f0 con 0x7ff0bc0b5fe0 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c14e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc15e410 0x7ff0bc1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c14e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc15e410 0x7ff0bc1550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48046/0 (socket says 172.21.15.42:48046) 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c14e6640 1 -- 172.21.15.42:0/2489902907 learned_addr learned my addr 172.21.15.42:0/2489902907 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0bbfff640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0bc0b5fe0 0x7ff0bc09b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c0ce5640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0bc06bc10 0x7ff0bc154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c14e6640 1 -- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0bc0b5fe0 msgr2=0x7ff0bc09b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c14e6640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0bc0b5fe0 0x7ff0bc09b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c14e6640 1 -- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0bc06bc10 msgr2=0x7ff0bc154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c14e6640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0bc06bc10 0x7ff0bc154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c14e6640 1 -- 172.21.15.42:0/2489902907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc0cb790 con 0x7ff0bc15e410 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c0ce5640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0bc06bc10 0x7ff0bc154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c14e6640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc15e410 0x7ff0bc1550b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff0b402a240 tx=0x7ff0b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:22.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0b97fa640 1 -- 172.21.15.42:0/2489902907 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4041020 con 0x7ff0bc15e410 2024-09-16T01:55:22.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0b97fa640 1 -- 172.21.15.42:0/2489902907 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b4030780 con 0x7ff0bc15e410 2024-09-16T01:55:22.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0b97fa640 1 -- 172.21.15.42:0/2489902907 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4037040 con 0x7ff0bc15e410 2024-09-16T01:55:22.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.939+0000 7ff0c2f49640 1 -- 172.21.15.42:0/2489902907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0bc0cba70 con 0x7ff0bc15e410 2024-09-16T01:55:22.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.940+0000 7ff0c2f49640 1 -- 172.21.15.42:0/2489902907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0bc0cc030 con 0x7ff0bc15e410 2024-09-16T01:55:22.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.940+0000 7ff0c2f49640 1 -- 172.21.15.42:0/2489902907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0bc06c040 con 0x7ff0bc15e410 2024-09-16T01:55:22.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.941+0000 7ff0b97fa640 1 -- 172.21.15.42:0/2489902907 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff0b4044020 con 0x7ff0bc15e410 2024-09-16T01:55:22.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.941+0000 7ff0b97fa640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff09c06c2b0 0x7ff09c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:22.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.941+0000 7ff0b97fa640 1 -- 172.21.15.42:0/2489902907 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7ff0b40abca0 con 0x7ff0bc15e410 2024-09-16T01:55:22.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.942+0000 7ff0c0ce5640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff09c06c2b0 0x7ff09c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:22.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.942+0000 7ff0c0ce5640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff09c06c2b0 0x7ff09c06e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4001d60 tx=0x7ff0a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:22.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:22.946+0000 7ff0b97fa640 1 -- 172.21.15.42:0/2489902907 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0b404b030 con 0x7ff0bc15e410 2024-09-16T01:55:23.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.194+0000 7ff0c2f49640 1 -- 172.21.15.42:0/2489902907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff0bc1e8c70 con 0x7ff0bc15e410 2024-09-16T01:55:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.196+0000 7ff0b97fa640 1 -- 172.21.15.42:0/2489902907 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7ff0b407a280 con 0x7ff0bc15e410 2024-09-16T01:55:23.198 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-16T01:55:23.198 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dm96TxJBAAoZCGS2uSu2E2+xtA9fj+5g== 2024-09-16T01:55:23.198 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-16T01:55:23.198 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-16T01:55:23.198 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:55:23.198 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-16T01:55:23.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 -- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff09c06c2b0 msgr2=0x7ff09c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:23.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff09c06c2b0 0x7ff09c06e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4001d60 tx=0x7ff0a4009040 comp rx=0 tx=0).stop 2024-09-16T01:55:23.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 -- 172.21.15.42:0/2489902907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc15e410 msgr2=0x7ff0bc1550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc15e410 0x7ff0bc1550b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff0b402a240 tx=0x7ff0b40046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 -- 172.21.15.42:0/2489902907 shutdown_connections 2024-09-16T01:55:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff09c06c2b0 0x7ff09c06e770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0bc15e410 0x7ff0bc1550b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0bc0b5fe0 0x7ff0bc09b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 --2- 172.21.15.42:0/2489902907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0bc06bc10 0x7ff0bc154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 -- 172.21.15.42:0/2489902907 >> 172.21.15.42:0/2489902907 conn(0x7ff0bc09aa30 msgr2=0x7ff0bc0b65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 -- 172.21.15.42:0/2489902907 shutdown_connections 2024-09-16T01:55:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.199+0000 7ff0c2f49640 1 -- 172.21.15.42:0/2489902907 wait complete. 2024-09-16T01:55:23.212 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.312+0000 7f42cfdb9640 1 Processor -- start 2024-09-16T01:55:23.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.312+0000 7f42cfdb9640 1 -- start start 2024-09-16T01:55:23.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.313+0000 7f42cfdb9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 0x7f42c80d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:23.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.313+0000 7f42cfdb9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f42c806df60 0x7f42c809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:23.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.313+0000 7f42cfdb9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f42c80d1630 0x7f42c809af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.313+0000 7f42cfdb9640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f42c806dad0 con 0x7f42c80d1630 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.313+0000 7f42cfdb9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f42c806cec0 con 0x7f42c806df60 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.313+0000 7f42cfdb9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42c806d1a0 con 0x7f42c815e5d0 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.313+0000 7f42ce356640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f42c80d1630 0x7f42c809af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.313+0000 7f42ce356640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f42c80d1630 0x7f42c809af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48058/0 (socket says 172.21.15.42:48058) 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.313+0000 7f42ce356640 1 -- 172.21.15.42:0/936706989 learned_addr learned my addr 172.21.15.42:0/936706989 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.314+0000 7f42cdb55640 1 --2- 172.21.15.42:0/936706989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 0x7f42c80d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.314+0000 7f42ce356640 1 -- 172.21.15.42:0/936706989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 msgr2=0x7f42c80d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.314+0000 7f42ce356640 1 --2- 172.21.15.42:0/936706989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 0x7f42c80d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.314+0000 7f42ce356640 1 -- 172.21.15.42:0/936706989 >> v2:172.21.15.107:3300/0 conn(0x7f42c806df60 msgr2=0x7f42c809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.314+0000 7f42cd354640 1 --2- 172.21.15.42:0/936706989 >> v2:172.21.15.107:3300/0 conn(0x7f42c806df60 0x7f42c809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.314+0000 7f42ce356640 1 --2- 172.21.15.42:0/936706989 >> v2:172.21.15.107:3300/0 conn(0x7f42c806df60 0x7f42c809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.314+0000 7f42ce356640 1 -- 172.21.15.42:0/936706989 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c806d480 con 0x7f42c80d1630 2024-09-16T01:55:23.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.314+0000 7f42cdb55640 1 --2- 172.21.15.42:0/936706989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 0x7f42c80d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:23.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.314+0000 7f42cd354640 1 --2- 172.21.15.42:0/936706989 >> v2:172.21.15.107:3300/0 conn(0x7f42c806df60 0x7f42c809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.314+0000 7f42ce356640 1 --2- 172.21.15.42:0/936706989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c80d1630 0x7f42c809af70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f42c8073d00 tx=0x7f42c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6237f3ca05ee8362 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42ccb53640 1 -- 172.21.15.42:0/936706989 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0037070 con 0x7f42c80d1630 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42ccb53640 1 -- 172.21.15.42:0/936706989 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c0032440 con 0x7f42c80d1630 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42ccb53640 1 -- 172.21.15.42:0/936706989 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0032810 con 0x7f42c80d1630 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42cfdb9640 1 -- 172.21.15.42:0/936706989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c80d1630 msgr2=0x7f42c809af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42cfdb9640 1 --2- 172.21.15.42:0/936706989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c80d1630 0x7f42c809af70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f42c8073d00 tx=0x7f42c002a270 comp rx=0 tx=0).stop 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42cfdb9640 1 -- 172.21.15.42:0/936706989 shutdown_connections 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42cfdb9640 1 --2- 172.21.15.42:0/936706989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c80d1630 0x7f42c809af70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42cfdb9640 1 --2- 172.21.15.42:0/936706989 >> v2:172.21.15.107:3300/0 conn(0x7f42c806df60 0x7f42c809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42cfdb9640 1 --2- 172.21.15.42:0/936706989 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 0x7f42c80d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42cfdb9640 1 -- 172.21.15.42:0/936706989 >> 172.21.15.42:0/936706989 conn(0x7f42c80d23a0 msgr2=0x7f42c80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:23.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42cfdb9640 1 -- 172.21.15.42:0/936706989 shutdown_connections 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.315+0000 7f42cfdb9640 1 -- 172.21.15.42:0/936706989 wait complete. 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cfdb9640 1 Processor -- start 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cfdb9640 1 -- start start 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cfdb9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c806df60 0x7f42c80b7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cfdb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42c80d1630 0x7f42c8161970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cfdb9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 0x7f42c8152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cfdb9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f42c815eb30 con 0x7f42c806df60 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cfdb9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42c815e9b0 con 0x7f42c80d1630 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cfdb9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f42c8162230 con 0x7f42c815e5d0 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cdb55640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c806df60 0x7f42c80b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cdb55640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c806df60 0x7f42c80b7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48064/0 (socket says 172.21.15.42:48064) 2024-09-16T01:55:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.317+0000 7f42cdb55640 1 -- 172.21.15.42:0/3585505758 learned_addr learned my addr 172.21.15.42:0/3585505758 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42ce356640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 0x7f42c8152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42cd354640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42c80d1630 0x7f42c8161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42cdb55640 1 -- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 msgr2=0x7f42c8152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42cdb55640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 0x7f42c8152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42cdb55640 1 -- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42c80d1630 msgr2=0x7f42c8161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42cdb55640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42c80d1630 0x7f42c8161970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42cdb55640 1 -- 172.21.15.42:0/3585505758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c80b79c0 con 0x7f42c806df60 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42cdb55640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c806df60 0x7f42c80b7350 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f42b800ce30 tx=0x7f42b800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42c67fc640 1 -- 172.21.15.42:0/3585505758 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b800f890 con 0x7f42c806df60 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42c67fc640 1 -- 172.21.15.42:0/3585505758 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b800fa30 con 0x7f42c806df60 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42cfdb9640 1 -- 172.21.15.42:0/3585505758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c80b7ca0 con 0x7f42c806df60 2024-09-16T01:55:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42c67fc640 1 -- 172.21.15.42:0/3585505758 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b800fe00 con 0x7f42c806df60 2024-09-16T01:55:23.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.318+0000 7f42cfdb9640 1 -- 172.21.15.42:0/3585505758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c80b0190 con 0x7f42c806df60 2024-09-16T01:55:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.319+0000 7f42cfdb9640 1 -- 172.21.15.42:0/3585505758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c80d10f0 con 0x7f42c806df60 2024-09-16T01:55:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.320+0000 7f42c67fc640 1 -- 172.21.15.42:0/3585505758 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f42b8018400 con 0x7f42c806df60 2024-09-16T01:55:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.320+0000 7f42c67fc640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f42b406c2b0 0x7f42b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.320+0000 7f42c67fc640 1 -- 172.21.15.42:0/3585505758 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f42b808c1e0 con 0x7f42c806df60 2024-09-16T01:55:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.320+0000 7f42cd354640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f42b406c2b0 0x7f42b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.321+0000 7f42cd354640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f42b406c2b0 0x7f42b406e770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f42c80a0490 tx=0x7f42bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:23.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.324+0000 7f42c67fc640 1 -- 172.21.15.42:0/3585505758 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42b8014030 con 0x7f42c806df60 2024-09-16T01:55:23.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.538+0000 7f42cfdb9640 1 -- 172.21.15.42:0/3585505758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42c80b8320 con 0x7f42c806df60 2024-09-16T01:55:23.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.539+0000 7f42c67fc640 1 -- 172.21.15.42:0/3585505758 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f42b800ae20 con 0x7f42c806df60 2024-09-16T01:55:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:23.541 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"btime":"2024-09-16T01:55:17:061679+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/920871952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":920871952},{"type":"v1","addr":"172.21.15.42:6835","nonce":920871952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2239532612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2239532612},{"type":"v1","addr":"172.21.15.42:6833","nonce":2239532612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/663599658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":663599658},{"type":"v1","addr":"172.21.15.107:6836","nonce":663599658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:14.411116+0000","modified":"2024-09-16T01:55:16.402868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34562":{"gid":34562,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3744211154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3744211154},{"type":"v1","addr":"172.21.15.107:6837","nonce":3744211154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34562,"qdb_cluster":[34562]},"id":2}]} 2024-09-16T01:55:23.541 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-09-16T01:55:23.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 -- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f42b406c2b0 msgr2=0x7f42b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f42b406c2b0 0x7f42b406e770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f42c80a0490 tx=0x7f42bc008040 comp rx=0 tx=0).stop 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 -- 172.21.15.42:0/3585505758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c806df60 msgr2=0x7f42c80b7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c806df60 0x7f42c80b7350 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f42b800ce30 tx=0x7f42b800a650 comp rx=0 tx=0).stop 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 -- 172.21.15.42:0/3585505758 shutdown_connections 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f42b406c2b0 0x7f42b406e770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f42c815e5d0 0x7f42c8152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42c80d1630 0x7f42c8161970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 --2- 172.21.15.42:0/3585505758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c806df60 0x7f42c80b7350 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 -- 172.21.15.42:0/3585505758 >> 172.21.15.42:0/3585505758 conn(0x7f42c80d23a0 msgr2=0x7f42c815cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 -- 172.21.15.42:0/3585505758 shutdown_connections 2024-09-16T01:55:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:23.541+0000 7f42cfdb9640 1 -- 172.21.15.42:0/3585505758 wait complete. 2024-09-16T01:55:23.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:55:14.411116+0000', 'modified': '2024-09-16T01:55:16.402868+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34562}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34562': {'gid': 34562, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.107:6837/3744211154', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6835', 'nonce': 3744211154}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 3744211154}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34562, 'qdb_cluster': [34562]} 2024-09-16T01:55:23.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:55:23.957 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-16T01:55:24.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.064+0000 7f88d434b640 1 Processor -- start 2024-09-16T01:55:24.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.064+0000 7f88d434b640 1 -- start start 2024-09-16T01:55:24.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d434b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88cc161c80 0x7f88cc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d434b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc0b6680 0x7f88cc0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d434b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88cc06e870 con 0x7f88cc162060 2024-09-16T01:55:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d434b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f88cc06d9f0 con 0x7f88cc161c80 2024-09-16T01:55:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d434b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f88cc06dcd0 con 0x7f88cc0b6680 2024-09-16T01:55:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d20e7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88cc161c80 0x7f88cc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d20e7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88cc161c80 0x7f88cc06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48072/0 (socket says 172.21.15.42:48072) 2024-09-16T01:55:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d20e7640 1 -- 172.21.15.42:0/755431306 learned_addr learned my addr 172.21.15.42:0/755431306 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d28e8640 1 --2- 172.21.15.42:0/755431306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc0b6680 0x7f88cc0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d20e7640 1 -- 172.21.15.42:0/755431306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc0b6680 msgr2=0x7f88cc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d20e7640 1 --2- 172.21.15.42:0/755431306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc0b6680 0x7f88cc0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d20e7640 1 -- 172.21.15.42:0/755431306 >> v1:172.21.15.107:6789/0 conn(0x7f88cc162060 legacy=0x7f88cc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d20e7640 1 -- 172.21.15.42:0/755431306 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc06dfb0 con 0x7f88cc161c80 2024-09-16T01:55:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.065+0000 7f88d28e8640 1 --2- 172.21.15.42:0/755431306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc0b6680 0x7f88cc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.066+0000 7f88d20e7640 1 --2- 172.21.15.42:0/755431306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc161c80 0x7f88cc06e330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009870 tx=0x7f88c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8260a97b26da205 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.066+0000 7f88d10e5640 1 -- 172.21.15.42:0/755431306 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8037070 con 0x7f88cc161c80 2024-09-16T01:55:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.066+0000 7f88d10e5640 1 -- 172.21.15.42:0/755431306 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c8032440 con 0x7f88cc161c80 2024-09-16T01:55:24.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.066+0000 7f88d10e5640 1 -- 172.21.15.42:0/755431306 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8032810 con 0x7f88cc161c80 2024-09-16T01:55:24.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.067+0000 7f88d434b640 1 -- 172.21.15.42:0/755431306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc161c80 msgr2=0x7f88cc06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.067+0000 7f88d434b640 1 --2- 172.21.15.42:0/755431306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc161c80 0x7f88cc06e330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009870 tx=0x7f88c802a270 comp rx=0 tx=0).stop 2024-09-16T01:55:24.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.067+0000 7f88d434b640 1 -- 172.21.15.42:0/755431306 shutdown_connections 2024-09-16T01:55:24.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.067+0000 7f88d434b640 1 --2- 172.21.15.42:0/755431306 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc0b6680 0x7f88cc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.067+0000 7f88d434b640 1 --2- 172.21.15.42:0/755431306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc161c80 0x7f88cc06e330 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.067+0000 7f88d434b640 1 -- 172.21.15.42:0/755431306 >> 172.21.15.42:0/755431306 conn(0x7f88cc0d44f0 msgr2=0x7f88cc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:24.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.067+0000 7f88d434b640 1 -- 172.21.15.42:0/755431306 shutdown_connections 2024-09-16T01:55:24.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.067+0000 7f88d434b640 1 -- 172.21.15.42:0/755431306 wait complete. 2024-09-16T01:55:24.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.068+0000 7f88d434b640 1 Processor -- start 2024-09-16T01:55:24.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.068+0000 7f88d434b640 1 -- start start 2024-09-16T01:55:24.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d434b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc0b6680 0x7f88cc1f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d434b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc161c80 0x7f88cc0b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d434b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88cc162060 0x7f88cc0d3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d434b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc0b6cb0 con 0x7f88cc0b6680 2024-09-16T01:55:24.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d434b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc0b6b30 con 0x7f88cc162060 2024-09-16T01:55:24.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d434b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f88cc0cf720 con 0x7f88cc161c80 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d20e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc0b6680 0x7f88cc1f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d20e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc0b6680 0x7f88cc1f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48078/0 (socket says 172.21.15.42:48078) 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d20e7640 1 -- 172.21.15.42:0/1215254219 learned_addr learned my addr 172.21.15.42:0/1215254219 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d18e6640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc161c80 0x7f88cc0b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d28e8640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88cc162060 0x7f88cc0d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d20e7640 1 -- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc161c80 msgr2=0x7f88cc0b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d20e7640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc161c80 0x7f88cc0b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d20e7640 1 -- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88cc162060 msgr2=0x7f88cc0d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d20e7640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88cc162060 0x7f88cc0d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d20e7640 1 -- 172.21.15.42:0/1215254219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc0b94e0 con 0x7f88cc0b6680 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d28e8640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88cc162060 0x7f88cc0d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:24.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.069+0000 7f88d20e7640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc0b6680 0x7f88cc1f50d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f88c8000c00 tx=0x7f88c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:24.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.070+0000 7f88c2ffd640 1 -- 172.21.15.42:0/1215254219 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8041020 con 0x7f88cc0b6680 2024-09-16T01:55:24.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.070+0000 7f88c2ffd640 1 -- 172.21.15.42:0/1215254219 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c80306c0 con 0x7f88cc0b6680 2024-09-16T01:55:24.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.070+0000 7f88d434b640 1 -- 172.21.15.42:0/1215254219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88cc0b97c0 con 0x7f88cc0b6680 2024-09-16T01:55:24.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.070+0000 7f88c2ffd640 1 -- 172.21.15.42:0/1215254219 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8037040 con 0x7f88cc0b6680 2024-09-16T01:55:24.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.070+0000 7f88d434b640 1 -- 172.21.15.42:0/1215254219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88cc0b9d80 con 0x7f88cc0b6680 2024-09-16T01:55:24.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.072+0000 7f88c2ffd640 1 -- 172.21.15.42:0/1215254219 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f88c8044020 con 0x7f88cc0b6680 2024-09-16T01:55:24.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.072+0000 7f88c2ffd640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88b006c2b0 0x7f88b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.072+0000 7f88c2ffd640 1 -- 172.21.15.42:0/1215254219 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f88c80abcd0 con 0x7f88cc0b6680 2024-09-16T01:55:24.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.072+0000 7f88d18e6640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88b006c2b0 0x7f88b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.073+0000 7f88d18e6640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88b006c2b0 0x7f88b006e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0cea90 tx=0x7f88bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:24.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.073+0000 7f88d6d22740 1 Processor -- start 2024-09-16T01:55:24.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.073+0000 7f88d6d22740 1 -- start start 2024-09-16T01:55:24.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1992c0 0x559b1e1dea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e196a80 0x559b1e1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e1938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d6d22740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b1e0fb520 con 0x559b1e19aa50 2024-09-16T01:55:24.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d6d22740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559b1e0a33e0 con 0x559b1e196a80 2024-09-16T01:55:24.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d6d22740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x559b1e0f74e0 con 0x559b1e1992c0 2024-09-16T01:55:24.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d28e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e1938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d28e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e1938b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48080/0 (socket says 172.21.15.42:48080) 2024-09-16T01:55:24.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d28e8640 1 -- 172.21.15.42:0/2684708490 learned_addr learned my addr 172.21.15.42:0/2684708490 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:24.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d20e7640 1 --2- 172.21.15.42:0/2684708490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1992c0 0x559b1e1dea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d18e6640 1 --2- 172.21.15.42:0/2684708490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e196a80 0x559b1e1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d28e8640 1 -- 172.21.15.42:0/2684708490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1992c0 msgr2=0x559b1e1dea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:24.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d28e8640 1 --2- 172.21.15.42:0/2684708490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1992c0 0x559b1e1dea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d28e8640 1 -- 172.21.15.42:0/2684708490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e196a80 msgr2=0x559b1e1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:24.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d28e8640 1 --2- 172.21.15.42:0/2684708490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e196a80 0x559b1e1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.074+0000 7f88d28e8640 1 -- 172.21.15.42:0/2684708490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b1e0be2f0 con 0x559b1e19aa50 2024-09-16T01:55:24.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88d28e8640 1 --2- 172.21.15.42:0/2684708490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e1938b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009bf0 tx=0x7f88c4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48811b988672548d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:24.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88affff640 1 -- 172.21.15.42:0/2684708490 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4013780 con 0x559b1e19aa50 2024-09-16T01:55:24.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88affff640 1 -- 172.21.15.42:0/2684708490 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c4019070 con 0x559b1e19aa50 2024-09-16T01:55:24.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88affff640 1 -- 172.21.15.42:0/2684708490 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4013b20 con 0x559b1e19aa50 2024-09-16T01:55:24.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88d6d22740 1 -- 172.21.15.42:0/2684708490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 msgr2=0x559b1e1938b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2684708490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e1938b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009bf0 tx=0x7f88c4004410 comp rx=0 tx=0).stop 2024-09-16T01:55:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88d6d22740 1 -- 172.21.15.42:0/2684708490 shutdown_connections 2024-09-16T01:55:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2684708490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e1938b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2684708490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e196a80 0x559b1e1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2684708490 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1992c0 0x559b1e1dea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.075+0000 7f88d6d22740 1 -- 172.21.15.42:0/2684708490 >> 172.21.15.42:0/2684708490 conn(0x559b1e195a80 msgr2=0x559b1e1ddf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.076+0000 7f88d6d22740 1 -- 172.21.15.42:0/2684708490 shutdown_connections 2024-09-16T01:55:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.076+0000 7f88d6d22740 1 -- 172.21.15.42:0/2684708490 wait complete. 2024-09-16T01:55:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.076+0000 7f88d6d22740 1 -- start start 2024-09-16T01:55:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.076+0000 7f88d6d22740 1 Processor -- start 2024-09-16T01:55:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1daf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 0x559b1e1b9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1ba0e0 0x559b1e1dbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d6d22740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b1e194f20 con 0x559b1e1992c0 2024-09-16T01:55:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d6d22740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559b1e084450 con 0x559b1e19aa50 2024-09-16T01:55:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d6d22740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x559b1e1df290 con 0x559b1e1ba0e0 2024-09-16T01:55:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d6d22740 10 client.0 _ll_register_callbacks cb 0x559b1de0dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d20e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1daf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d20e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1daf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48096/0 (socket says 172.21.15.42:48096) 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d20e7640 1 -- 172.21.15.42:0/2688888561 learned_addr learned my addr 172.21.15.42:0/2688888561 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d18e6640 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 0x559b1e1b9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.077+0000 7f88d28e8640 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1ba0e0 0x559b1e1dbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.078+0000 7f88d20e7640 1 -- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1ba0e0 msgr2=0x559b1e1dbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.078+0000 7f88d20e7640 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1ba0e0 0x559b1e1dbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.078+0000 7f88d20e7640 1 -- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 msgr2=0x559b1e1b9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.078+0000 7f88d20e7640 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 0x559b1e1b9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.078+0000 7f88d20e7640 1 -- 172.21.15.42:0/2688888561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b1de0e2d0 con 0x559b1e1992c0 2024-09-16T01:55:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.078+0000 7f88d20e7640 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1daf60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88c8079940 tx=0x7f88c807a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd69e7589235111 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.078+0000 7f88ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88ad7fa640 1 -- 172.21.15.42:0/2688888561 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8082390 con 0x559b1e1992c0 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88ad7fa640 1 -- 172.21.15.42:0/2688888561 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f88c8082530 con 0x559b1e1992c0 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88d6d22740 1 -- 172.21.15.42:0/2688888561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c4019070 con 0x559b1e1992c0 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88ad7fa640 1 -- 172.21.15.42:0/2688888561 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f88c8079090 con 0x559b1e1992c0 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88d6d22740 10 client.5055 fetch_fsmap learned FSMap version 15 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88d6d22740 1 -- 172.21.15.42:0/2688888561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x559b1ded86b0 con 0x559b1e1992c0 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88ad7fa640 1 -- 172.21.15.42:0/2688888561 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c4019070 con 0x559b1e1992c0 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88ad7fa640 1 -- 172.21.15.42:0/2688888561 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f88c803a030 con 0x559b1e1992c0 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88d6d22740 10 client.5055 fetch_fsmap finished waiting for FSMap version 15 2024-09-16T01:55:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88d6d22740 10 client.5055 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88d6d22740 20 client.5055 populate_metadata read hostname 'smithi042' 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:6835/3744211154,v1:172.21.15.107:6837/3744211154] conn(0x559b1e193bd0 0x559b1e193fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88d6d22740 4 client.5055 mds_command: new command op to 34562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.080+0000 7f88d6d22740 1 -- 172.21.15.42:0/2688888561 --> [v2:172.21.15.107:6835/3744211154,v1:172.21.15.107:6837/3744211154] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b1e108c50 con 0x559b1e193bd0 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.081+0000 7f88d18e6640 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:6835/3744211154,v1:172.21.15.107:6837/3744211154] conn(0x559b1e193bd0 0x559b1e193fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.081+0000 7f88d18e6640 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:6835/3744211154,v1:172.21.15.107:6837/3744211154] conn(0x559b1e193bd0 0x559b1e193fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b42797bad619530a server_cookie=4c53fb4389db80e7 in_seq=0 out_seq=0 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.081+0000 7f88ad7fa640 10 client.5055 ms_handle_connect on v2:172.21.15.107:6835/3744211154 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88ad7fa640 1 -- 172.21.15.42:0/2688888561 <== mds.0 v2:172.21.15.107:6835/3744211154 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b1e108c50 con 0x559b1e193bd0 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88ad7fa640 10 client.5055 handle_command_reply: tid=0 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 client.5055 shutdown 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 -- 172.21.15.42:0/2688888561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 msgr2=0x559b1e1daf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1daf60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88c8079940 tx=0x7f88c807a480 comp rx=0 tx=0).stop 2024-09-16T01:55:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 -- 172.21.15.42:0/2688888561 shutdown_connections 2024-09-16T01:55:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:6835/3744211154,v1:172.21.15.107:6837/3744211154] conn(0x559b1e193bd0 0x559b1e193fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1ba0e0 0x559b1e1dbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88ad7fa640 0 client.5055 ms_handle_reset on v2:172.21.15.107:6835/3744211154 2024-09-16T01:55:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 0x559b1e1b9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2688888561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1daf60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 -- 172.21.15.42:0/2688888561 >> 172.21.15.42:0/2688888561 conn(0x559b1e196a80 msgr2=0x559b1e1e1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 -- 172.21.15.42:0/2688888561 shutdown_connections 2024-09-16T01:55:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 1 -- 172.21.15.42:0/2688888561 wait complete. 2024-09-16T01:55:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.082+0000 7f88d6d22740 20 client.5055 trim_cache size 0 max 16384 2024-09-16T01:55:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.101+0000 7f88d6d22740 1 Processor -- start 2024-09-16T01:55:24.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.101+0000 7f88d6d22740 1 -- start start 2024-09-16T01:55:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.101+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1e15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.101+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 0x559b1e1f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.101+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1ba0e0 0x559b1e201e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.101+0000 7f88d6d22740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc200250 con 0x559b1e1992c0 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.101+0000 7f88d6d22740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc0cc500 con 0x559b1e19aa50 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.101+0000 7f88d6d22740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f88cc0ccb50 con 0x559b1e1ba0e0 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.101+0000 7f88d20e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1e15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.101+0000 7f88d20e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1e15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48098/0 (socket says 172.21.15.42:48098) 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88d20e7640 1 -- 172.21.15.42:0/2607320649 learned_addr learned my addr 172.21.15.42:0/2607320649 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88d28e8640 1 --2- 172.21.15.42:0/2607320649 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1ba0e0 0x559b1e201e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88d18e6640 1 --2- 172.21.15.42:0/2607320649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 0x559b1e1f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88d20e7640 1 -- 172.21.15.42:0/2607320649 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1ba0e0 msgr2=0x559b1e201e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88d20e7640 1 --2- 172.21.15.42:0/2607320649 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1ba0e0 0x559b1e201e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88d20e7640 1 -- 172.21.15.42:0/2607320649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 msgr2=0x559b1e1f07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88d20e7640 1 --2- 172.21.15.42:0/2607320649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 0x559b1e1f07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88d20e7640 1 -- 172.21.15.42:0/2607320649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b1e18f6c0 con 0x559b1e1992c0 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88d18e6640 1 --2- 172.21.15.42:0/2607320649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 0x559b1e1f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88d20e7640 1 --2- 172.21.15.42:0/2607320649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1e15b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009870 tx=0x7f88c8047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be26c675cec69059 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88af7fe640 1 -- 172.21.15.42:0/2607320649 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c80795a0 con 0x559b1e1992c0 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88af7fe640 1 -- 172.21.15.42:0/2607320649 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c8080040 con 0x559b1e1992c0 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.102+0000 7f88af7fe640 1 -- 172.21.15.42:0/2607320649 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c80801f0 con 0x559b1e1992c0 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 -- 172.21.15.42:0/2607320649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 msgr2=0x559b1e1e15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2607320649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1e15b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009870 tx=0x7f88c8047000 comp rx=0 tx=0).stop 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 -- 172.21.15.42:0/2607320649 shutdown_connections 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2607320649 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1ba0e0 0x559b1e201e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2607320649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e19aa50 0x559b1e1f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 --2- 172.21.15.42:0/2607320649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e1992c0 0x559b1e1e15b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 -- 172.21.15.42:0/2607320649 >> 172.21.15.42:0/2607320649 conn(0x559b1e196a80 msgr2=0x559b1e1ba940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 -- 172.21.15.42:0/2607320649 shutdown_connections 2024-09-16T01:55:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 -- 172.21.15.42:0/2607320649 wait complete. 2024-09-16T01:55:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 -- start start 2024-09-16T01:55:24.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.103+0000 7f88d6d22740 1 Processor -- start 2024-09-16T01:55:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1992c0 0x559b1e25c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e245500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d6d22740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e1ba0e0 0x559b1e1ba860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d6d22740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b1e193710 con 0x559b1e19aa50 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d6d22740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559b1e1931a0 con 0x559b1e1ba0e0 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d6d22740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x559b1e1b7300 con 0x559b1e1992c0 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d6d22740 10 client.0 _ll_register_callbacks cb 0x7f88c8006cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d18e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e245500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d18e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e245500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48102/0 (socket says 172.21.15.42:48102) 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d18e6640 1 -- 172.21.15.42:0/3836677480 learned_addr learned my addr 172.21.15.42:0/3836677480 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d20e7640 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1992c0 0x559b1e25c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.104+0000 7f88d28e8640 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e1ba0e0 0x559b1e1ba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d18e6640 1 -- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1992c0 msgr2=0x559b1e25c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d18e6640 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1992c0 0x559b1e25c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d18e6640 1 -- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e1ba0e0 msgr2=0x559b1e1ba860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:24.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d18e6640 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e1ba0e0 0x559b1e1ba860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d18e6640 1 -- 172.21.15.42:0/3836677480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b1e25c760 con 0x559b1e19aa50 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d18e6640 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e245500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f88bc001510 tx=0x7f88bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d013822ba14348ff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88ad7fa640 1 -- 172.21.15.42:0/3836677480 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc007030 con 0x559b1e19aa50 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88ad7fa640 1 -- 172.21.15.42:0/3836677480 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f88bc02ea20 con 0x559b1e19aa50 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d6d22740 1 -- 172.21.15.42:0/3836677480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c8080040 con 0x559b1e19aa50 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88ad7fa640 1 -- 172.21.15.42:0/3836677480 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f88bc039050 con 0x559b1e19aa50 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d6d22740 10 client.5061 fetch_fsmap learned FSMap version 15 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d6d22740 1 -- 172.21.15.42:0/3836677480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x559b1e25d120 con 0x559b1e19aa50 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88ad7fa640 1 -- 172.21.15.42:0/3836677480 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c8080040 con 0x559b1e19aa50 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88ad7fa640 1 -- 172.21.15.42:0/3836677480 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f88bc03c020 con 0x559b1e19aa50 2024-09-16T01:55:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d6d22740 10 client.5061 fetch_fsmap finished waiting for FSMap version 15 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d6d22740 10 client.5061 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d6d22740 20 client.5061 populate_metadata read hostname 'smithi042' 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d6d22740 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:6835/3744211154,v1:172.21.15.107:6837/3744211154] conn(0x559b1e1ddcd0 0x559b1e1b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d6d22740 4 client.5061 mds_command: new command op to 34562 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.105+0000 7f88d6d22740 1 -- 172.21.15.42:0/3836677480 --> [v2:172.21.15.107:6835/3744211154,v1:172.21.15.107:6837/3744211154] -- command(tid 0: {"prefix": "status"}) -- 0x559b1e102fa0 con 0x559b1e1ddcd0 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d20e7640 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:6835/3744211154,v1:172.21.15.107:6837/3744211154] conn(0x559b1e1ddcd0 0x559b1e1b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d20e7640 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:6835/3744211154,v1:172.21.15.107:6837/3744211154] conn(0x559b1e1ddcd0 0x559b1e1b5b50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bcd9d8c010ff5b4 server_cookie=485db37f5df13089 in_seq=0 out_seq=0 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88ad7fa640 10 client.5061 ms_handle_connect on v2:172.21.15.107:6835/3744211154 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88ad7fa640 1 -- 172.21.15.42:0/3836677480 <== mds.0 v2:172.21.15.107:6835/3744211154 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x559b1e102fa0 con 0x559b1e1ddcd0 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88ad7fa640 10 client.5061 handle_command_reply: tid=0 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 client.5061 shutdown 2024-09-16T01:55:24.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 -- 172.21.15.42:0/3836677480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 msgr2=0x559b1e245500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e245500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f88bc001510 tx=0x7f88bc000bc0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 -- 172.21.15.42:0/3836677480 shutdown_connections 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:6835/3744211154,v1:172.21.15.107:6837/3744211154] conn(0x559b1e1ddcd0 0x559b1e1b5b50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b1e1ba0e0 0x559b1e1ba860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b1e19aa50 0x559b1e245500 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 --2- 172.21.15.42:0/3836677480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b1e1992c0 0x559b1e25c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88ad7fa640 0 client.5061 ms_handle_reset on v2:172.21.15.107:6835/3744211154 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 -- 172.21.15.42:0/3836677480 >> 172.21.15.42:0/3836677480 conn(0x559b1e196a80 msgr2=0x559b1e1c15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 -- 172.21.15.42:0/3836677480 shutdown_connections 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.106+0000 7f88d6d22740 1 -- 172.21.15.42:0/3836677480 wait complete. 2024-09-16T01:55:24.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d6d22740 20 client.5061 trim_cache size 0 max 16384 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "356ce71f-2ad9-4fe3-af21-266c510b09c8", 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 34562, 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 9.0492171110000008, 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 15, 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 38, 2024-09-16T01:55:24.115 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 38, 2024-09-16T01:55:24.116 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 15.935935898 2024-09-16T01:55:24.116 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:55:24.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 -- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88b006c2b0 msgr2=0x7f88b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88b006c2b0 0x7f88b006e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0cea90 tx=0x7f88bc009040 comp rx=0 tx=0).stop 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 -- 172.21.15.42:0/1215254219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc0b6680 msgr2=0x7f88cc1f50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc0b6680 0x7f88cc1f50d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f88c8000c00 tx=0x7f88c80046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 -- 172.21.15.42:0/1215254219 shutdown_connections 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f88b006c2b0 0x7f88b006e770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88cc162060 0x7f88cc0d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88cc161c80 0x7f88cc0b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 --2- 172.21.15.42:0/1215254219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88cc0b6680 0x7f88cc1f50d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 -- 172.21.15.42:0/1215254219 >> 172.21.15.42:0/1215254219 conn(0x7f88cc0d44f0 msgr2=0x7f88cc1566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 -- 172.21.15.42:0/1215254219 shutdown_connections 2024-09-16T01:55:24.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.107+0000 7f88d434b640 1 -- 172.21.15.42:0/1215254219 wait complete. 2024-09-16T01:55:24.119 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:55:24.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.220+0000 7efd07c5e640 1 Processor -- start 2024-09-16T01:55:24.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.221+0000 7efd07c5e640 1 -- start start 2024-09-16T01:55:24.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.221+0000 7efd07c5e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efd00161c80 0x7efd0006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.221+0000 7efd07c5e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efd000b6680 0x7efd000cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.221+0000 7efd07c5e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd0006e870 con 0x7efd00162060 2024-09-16T01:55:24.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.221+0000 7efd07c5e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7efd0006d9f0 con 0x7efd00161c80 2024-09-16T01:55:24.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.221+0000 7efd07c5e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7efd0006dcd0 con 0x7efd000b6680 2024-09-16T01:55:24.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.221+0000 7efd059fa640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efd00161c80 0x7efd0006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.222+0000 7efd059fa640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efd00161c80 0x7efd0006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48106/0 (socket says 172.21.15.42:48106) 2024-09-16T01:55:24.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.222+0000 7efd051f9640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7efd00162060 0x7efd000b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59746/0 (socket says 172.21.15.42:59746) 2024-09-16T01:55:24.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.222+0000 7efd059fa640 1 -- 172.21.15.42:0/3663644124 learned_addr learned my addr 172.21.15.42:0/3663644124 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:24.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.222+0000 7efd061fb640 1 --2- 172.21.15.42:0/3663644124 >> v2:172.21.15.107:3300/0 conn(0x7efd000b6680 0x7efd000cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.222+0000 7efd059fa640 1 -- 172.21.15.42:0/3663644124 >> v2:172.21.15.107:3300/0 conn(0x7efd000b6680 msgr2=0x7efd000cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:24.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.222+0000 7efd059fa640 1 --2- 172.21.15.42:0/3663644124 >> v2:172.21.15.107:3300/0 conn(0x7efd000b6680 0x7efd000cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.222+0000 7efd059fa640 1 -- 172.21.15.42:0/3663644124 >> v1:172.21.15.42:6789/0 conn(0x7efd00162060 legacy=0x7efd000b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.222+0000 7efd059fa640 1 -- 172.21.15.42:0/3663644124 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0006dfb0 con 0x7efd00161c80 2024-09-16T01:55:24.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.222+0000 7efd061fb640 1 --2- 172.21.15.42:0/3663644124 >> v2:172.21.15.107:3300/0 conn(0x7efd000b6680 0x7efd000cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:24.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.223+0000 7efd059fa640 1 --2- 172.21.15.42:0/3663644124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd00161c80 0x7efd0006e330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd0008d750 tx=0x7efcf002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ef329e9e0d0ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:24.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.223+0000 7efd049f8640 1 -- 172.21.15.42:0/3663644124 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0036070 con 0x7efd00161c80 2024-09-16T01:55:24.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.223+0000 7efd049f8640 1 -- 172.21.15.42:0/3663644124 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf0031600 con 0x7efd00161c80 2024-09-16T01:55:24.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.223+0000 7efd049f8640 1 -- 172.21.15.42:0/3663644124 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf00319d0 con 0x7efd00161c80 2024-09-16T01:55:24.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.223+0000 7efd07c5e640 1 -- 172.21.15.42:0/3663644124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd00161c80 msgr2=0x7efd0006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.223+0000 7efd07c5e640 1 --2- 172.21.15.42:0/3663644124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd00161c80 0x7efd0006e330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd0008d750 tx=0x7efcf002a630 comp rx=0 tx=0).stop 2024-09-16T01:55:24.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.223+0000 7efd07c5e640 1 -- 172.21.15.42:0/3663644124 shutdown_connections 2024-09-16T01:55:24.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.223+0000 7efd07c5e640 1 --2- 172.21.15.42:0/3663644124 >> v2:172.21.15.107:3300/0 conn(0x7efd000b6680 0x7efd000cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.223+0000 7efd07c5e640 1 --2- 172.21.15.42:0/3663644124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd00161c80 0x7efd0006e330 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.223+0000 7efd07c5e640 1 -- 172.21.15.42:0/3663644124 >> 172.21.15.42:0/3663644124 conn(0x7efd000d44f0 msgr2=0x7efd000d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:24.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.224+0000 7efd07c5e640 1 -- 172.21.15.42:0/3663644124 shutdown_connections 2024-09-16T01:55:24.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.224+0000 7efd07c5e640 1 -- 172.21.15.42:0/3663644124 wait complete. 2024-09-16T01:55:24.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.225+0000 7efd07c5e640 1 Processor -- start 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.225+0000 7efd07c5e640 1 -- start start 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.225+0000 7efd07c5e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd000b6680 0x7efd001564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.225+0000 7efd07c5e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd00161c80 0x7efd000b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.225+0000 7efd07c5e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd00162060 0x7efd000b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.225+0000 7efd07c5e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efd000b6b30 con 0x7efd000b6680 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.225+0000 7efd07c5e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efd000d2aa0 con 0x7efd00161c80 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.225+0000 7efd07c5e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efd000b6cb0 con 0x7efd00162060 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd059fa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd000b6680 0x7efd001564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd059fa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd000b6680 0x7efd001564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48112/0 (socket says 172.21.15.42:48112) 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd059fa640 1 -- 172.21.15.42:0/3894028169 learned_addr learned my addr 172.21.15.42:0/3894028169 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd051f9640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd00161c80 0x7efd000b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd061fb640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd00162060 0x7efd000b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd059fa640 1 -- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd00162060 msgr2=0x7efd000b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd059fa640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd00162060 0x7efd000b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd059fa640 1 -- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd00161c80 msgr2=0x7efd000b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd059fa640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd00161c80 0x7efd000b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd059fa640 1 -- 172.21.15.42:0/3894028169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd000b7ae0 con 0x7efd000b6680 2024-09-16T01:55:24.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd059fa640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd000b6680 0x7efd001564b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efcf0034040 tx=0x7efcf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:24.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efcfe7fc640 1 -- 172.21.15.42:0/3894028169 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0036050 con 0x7efd000b6680 2024-09-16T01:55:24.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efcfe7fc640 1 -- 172.21.15.42:0/3894028169 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf0037040 con 0x7efd000b6680 2024-09-16T01:55:24.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efcfe7fc640 1 -- 172.21.15.42:0/3894028169 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0009510 con 0x7efd000b6680 2024-09-16T01:55:24.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd07c5e640 1 -- 172.21.15.42:0/3894028169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd000b7dc0 con 0x7efd000b6680 2024-09-16T01:55:24.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.226+0000 7efd07c5e640 1 -- 172.21.15.42:0/3894028169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd000b8380 con 0x7efd000b6680 2024-09-16T01:55:24.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.227+0000 7efd07c5e640 1 -- 172.21.15.42:0/3894028169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd0006e330 con 0x7efd000b6680 2024-09-16T01:55:24.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.228+0000 7efcfe7fc640 1 -- 172.21.15.42:0/3894028169 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efcf0007c50 con 0x7efd000b6680 2024-09-16T01:55:24.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.228+0000 7efcfe7fc640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcec06c2b0 0x7efcec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:24.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.228+0000 7efcfe7fc640 1 -- 172.21.15.42:0/3894028169 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7efcf00ac090 con 0x7efd000b6680 2024-09-16T01:55:24.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.228+0000 7efd051f9640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcec06c2b0 0x7efcec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:24.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.229+0000 7efd051f9640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcec06c2b0 0x7efcec06e770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efd000cb360 tx=0x7efcf4000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:24.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.233+0000 7efcfe7fc640 1 -- 172.21.15.42:0/3894028169 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efcf007a670 con 0x7efd000b6680 2024-09-16T01:55:24.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.444+0000 7efd07c5e640 1 -- 172.21.15.42:0/3894028169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efd000cf500 con 0x7efd000b6680 2024-09-16T01:55:24.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.444+0000 7efcfe7fc640 1 -- 172.21.15.42:0/3894028169 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7efcf0079f70 con 0x7efd000b6680 2024-09-16T01:55:24.446 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:55:24.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.446+0000 7efd07c5e640 1 -- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcec06c2b0 msgr2=0x7efcec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.446+0000 7efd07c5e640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcec06c2b0 0x7efcec06e770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efd000cb360 tx=0x7efcf4000bc0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.446+0000 7efd07c5e640 1 -- 172.21.15.42:0/3894028169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd000b6680 msgr2=0x7efd001564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:24.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.446+0000 7efd07c5e640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd000b6680 0x7efd001564b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efcf0034040 tx=0x7efcf0004a40 comp rx=0 tx=0).stop 2024-09-16T01:55:24.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.446+0000 7efd07c5e640 1 -- 172.21.15.42:0/3894028169 shutdown_connections 2024-09-16T01:55:24.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.446+0000 7efd07c5e640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efcec06c2b0 0x7efcec06e770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.446+0000 7efd07c5e640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efd00162060 0x7efd000b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.446+0000 7efd07c5e640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd00161c80 0x7efd000b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.446+0000 7efd07c5e640 1 --2- 172.21.15.42:0/3894028169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd000b6680 0x7efd001564b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:24.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.446+0000 7efd07c5e640 1 -- 172.21.15.42:0/3894028169 >> 172.21.15.42:0/3894028169 conn(0x7efd000d44f0 msgr2=0x7efd000b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:24.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.447+0000 7efd07c5e640 1 -- 172.21.15.42:0/3894028169 shutdown_connections 2024-09-16T01:55:24.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24.447+0000 7efd07c5e640 1 -- 172.21.15.42:0/3894028169 wait complete. 2024-09-16T01:55:24.459 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:55:24.459 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:55:24.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-16T01:55:24.459 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:55:24.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:55:24.459 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:55:24.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:55:24.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:55:24.460 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:55:24.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:24.460 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-16T01:55:24.477 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:55:24.477 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:55:24.477 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:55:24.477 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:55:24.477 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-16T01:55:24.477 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:55:24.477 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:55:24.477 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-16T01:55:24.478 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-16T01:55:24.478 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:55:24.478 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-16T01:55:24.478 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-16T01:55:24.478 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:55:24.478 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:55:24.478 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-16T01:55:24.478 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-16T01:55:24.478 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42730sec preferred_lft 42730sec 2024-09-16T01:55:24.479 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-16T01:55:24.479 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:55:24.479 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:55:24.479 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:55:24.479 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-16T01:55:24.479 INFO:teuthology.orchestra.run.smithi042.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:55:24.479 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 5e:ba:0a:2b:0d:4d brd ff:ff:ff:ff:ff:ff 2024-09-16T01:55:24.479 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::9414:18ff:fe6a:9503/64 scope link 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 5e:ba:0a:2b:0d:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::5cba:aff:fe2b:d4d/64 scope link 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 72:25:74:79:3d:69 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::7025:74ff:fe79:3d69/64 scope link 2024-09-16T01:55:24.480 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:55:24.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:24.481 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:55:24.542 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-16T01:55:24.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:24.544 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-16T01:55:24.601 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-16T01:55:24.601 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:55:24.601 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-16T01:55:24.601 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-16T01:55:24.601 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:55:24.601 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:55:24.602 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:55:24.602 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-16T01:55:24.602 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-16T01:55:24.602 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-16T01:55:24.602 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:55:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:55:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:55:24.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:24.731 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-16T01:55:24.747 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:55:24.748 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:55:24.748 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:55:24.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:24.749 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-16T01:55:24.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:55:24.815 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:55:24.871 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:55:24.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:55:24.871 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:55:24.927 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:55:24.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:24.928 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-16T01:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-16T01:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=356ce71f-2ad9-4fe3-af21-266c510b09c8" will pass to kernel 2024-09-16T01:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:55:25.042 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:55:25.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:25.042 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:55:25.069 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:55:25.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:55:25.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:55:25.172 INFO:teuthology.orchestra.run.smithi042.stdout:client4978 2024-09-16T01:55:25.173 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:55:25.173 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:25.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:25.189 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-09-16T01:55:25.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:25.252 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-09-16T01:55:25.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:25.310 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-09-16T01:55:25.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:25.367 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-09-16T01:55:25.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:25.428 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-09-16T01:55:25.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:25.486 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-09-16T01:55:25.546 INFO:teuthology.orchestra.run.smithi042.stdout:./ 2024-09-16T01:55:25.546 INFO:teuthology.orchestra.run.smithi042.stdout:./rfile 2024-09-16T01:55:25.547 INFO:teuthology.orchestra.run.smithi042.stdout:./parentdir 2024-09-16T01:55:25.547 INFO:teuthology.orchestra.run.smithi042.stdout:./parentdir/pfile 2024-09-16T01:55:25.547 INFO:teuthology.orchestra.run.smithi042.stdout:./parentdir/childdir 2024-09-16T01:55:25.547 INFO:teuthology.orchestra.run.smithi042.stdout:./parentdir/childdir/cfile 2024-09-16T01:55:25.548 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-16T01:55:25.548 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-16T01:55:25.548 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-16T01:55:25.549 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:55:25.549 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-09-16T01:55:25.549 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-16T01:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-16T01:55:25.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:55:25.665 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-16T01:55:25.665 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-16T01:55:25.665 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-16T01:55:25.665 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:55:25.665 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-09-16T01:55:25.665 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-16T01:55:25.773 INFO:teuthology.orchestra.run.smithi042.stdout:1099511627778 2024-09-16T01:55:25.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:55:25.785 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-16T01:55:25.785 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-16T01:55:25.785 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-16T01:55:25.785 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:55:25.785 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-09-16T01:55:25.785 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-16T01:55:25.893 INFO:teuthology.orchestra.run.smithi042.stdout:1099511627776 2024-09-16T01:55:25.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:55:25.903 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-16T01:55:25.903 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-16T01:55:25.903 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-16T01:55:25.903 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:55:25.903 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-09-16T01:55:25.903 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-16T01:55:26.011 INFO:teuthology.orchestra.run.smithi042.stdout:1099511628279 2024-09-16T01:55:26.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:55:26.020 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-16T01:55:26.020 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-16T01:55:26.020 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-16T01:55:26.020 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:55:26.020 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-09-16T01:55:26.020 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-16T01:55:26.128 INFO:teuthology.orchestra.run.smithi042.stdout:1099511627777 2024-09-16T01:55:26.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:55:26.137 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-16T01:55:26.137 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-16T01:55:26.137 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-16T01:55:26.137 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:55:26.137 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-09-16T01:55:26.137 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-16T01:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout:1099511628280 2024-09-16T01:55:26.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:55:26.252 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:55:26.253 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:26.310 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:55:26.310 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:26.366 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:55:26.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.508+0000 7f223d645640 1 Processor -- start 2024-09-16T01:55:26.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.508+0000 7f223d645640 1 -- start start 2024-09-16T01:55:26.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.509+0000 7f223d645640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f22380cf330 0x7f2238169070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.509+0000 7f223d645640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f223806e820 con 0x7f2238161a20 2024-09-16T01:55:26.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.509+0000 7f223d645640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22380cf980 con 0x7f22380d15f0 2024-09-16T01:55:26.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.509+0000 7f223d645640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f22380cf760 con 0x7f22380cf330 2024-09-16T01:55:26.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.509+0000 7f2236ffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2238161a20 0x7f22380d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59748/0 (socket says 172.21.15.42:59748) 2024-09-16T01:55:26.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.509+0000 7f2236ffd640 1 -- 172.21.15.42:0/3378324919 learned_addr learned my addr 172.21.15.42:0/3378324919 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:26.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.509+0000 7f22377fe640 1 --2- 172.21.15.42:0/3378324919 >> v2:172.21.15.107:3300/0 conn(0x7f22380cf330 0x7f2238169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.509+0000 7f2235ffb640 1 -- 172.21.15.42:0/3378324919 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 272447710 0 0) 0x7f223806e820 con 0x7f2238161a20 2024-09-16T01:55:26.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.509+0000 7f2235ffb640 1 -- 172.21.15.42:0/3378324919 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2224003520 con 0x7f2238161a20 2024-09-16T01:55:26.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.509+0000 7f2235ffb640 1 -- 172.21.15.42:0/3378324919 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098310479 0 0) 0x7f22380cf980 con 0x7f22380d15f0 2024-09-16T01:55:26.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.510+0000 7f2235ffb640 1 -- 172.21.15.42:0/3378324919 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f223806e820 con 0x7f22380d15f0 2024-09-16T01:55:26.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.510+0000 7f22377fe640 1 -- 172.21.15.42:0/3378324919 >> v1:172.21.15.107:6789/0 conn(0x7f22380d15f0 legacy=0x7f22380cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.510+0000 7f22377fe640 1 -- 172.21.15.42:0/3378324919 >> v1:172.21.15.42:6789/0 conn(0x7f2238161a20 legacy=0x7f22380d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.510+0000 7f2235ffb640 1 -- 172.21.15.42:0/3378324919 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1031664752 0 0) 0x7f2224003520 con 0x7f2238161a20 2024-09-16T01:55:26.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.510+0000 7f22377fe640 1 -- 172.21.15.42:0/3378324919 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223806d050 con 0x7f22380cf330 2024-09-16T01:55:26.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.510+0000 7f22377fe640 1 --2- 172.21.15.42:0/3378324919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22380cf330 0x7f2238169070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2230009d90 tx=0x7f223002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e53af02e6bf4f636 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:26.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.511+0000 7f2235ffb640 1 -- 172.21.15.42:0/3378324919 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2228001670 con 0x7f22380cf330 2024-09-16T01:55:26.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.511+0000 7f2235ffb640 1 -- 172.21.15.42:0/3378324919 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2230007540 con 0x7f22380cf330 2024-09-16T01:55:26.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.511+0000 7f2235ffb640 1 -- 172.21.15.42:0/3378324919 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300078f0 con 0x7f22380cf330 2024-09-16T01:55:26.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.511+0000 7f223d645640 1 -- 172.21.15.42:0/3378324919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22380cf330 msgr2=0x7f2238169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.511+0000 7f223d645640 1 --2- 172.21.15.42:0/3378324919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22380cf330 0x7f2238169070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2230009d90 tx=0x7f223002a680 comp rx=0 tx=0).stop 2024-09-16T01:55:26.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.511+0000 7f223d645640 1 -- 172.21.15.42:0/3378324919 shutdown_connections 2024-09-16T01:55:26.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.511+0000 7f223d645640 1 --2- 172.21.15.42:0/3378324919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22380cf330 0x7f2238169070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.511+0000 7f223d645640 1 -- 172.21.15.42:0/3378324919 >> 172.21.15.42:0/3378324919 conn(0x7f223809d850 msgr2=0x7f223808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:26.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.511+0000 7f223d645640 1 -- 172.21.15.42:0/3378324919 shutdown_connections 2024-09-16T01:55:26.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.511+0000 7f223d645640 1 -- 172.21.15.42:0/3378324919 wait complete. 2024-09-16T01:55:26.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.513+0000 7f223d645640 1 Processor -- start 2024-09-16T01:55:26.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.513+0000 7f223d645640 1 -- start start 2024-09-16T01:55:26.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f223d645640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22380cf330 0x7f22381f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f223d645640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380d15f0 0x7f22381f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f223d645640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2238161a20 0x7f22380b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f223d645640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f22380cff00 con 0x7f22380d15f0 2024-09-16T01:55:26.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f223d645640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2238161e00 con 0x7f2238161a20 2024-09-16T01:55:26.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f223d645640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f223806d2f0 con 0x7f22380cf330 2024-09-16T01:55:26.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22367fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380d15f0 0x7f22381f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22367fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380d15f0 0x7f22381f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48126/0 (socket says 172.21.15.42:48126) 2024-09-16T01:55:26.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22367fc640 1 -- 172.21.15.42:0/1741221362 learned_addr learned my addr 172.21.15.42:0/1741221362 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:26.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22377fe640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2238161a20 0x7f22380b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f2236ffd640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22380cf330 0x7f22381f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22367fc640 1 -- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22380cf330 msgr2=0x7f22381f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22367fc640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22380cf330 0x7f22381f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22367fc640 1 -- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2238161a20 msgr2=0x7f22380b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22367fc640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2238161a20 0x7f22380b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22367fc640 1 -- 172.21.15.42:0/1741221362 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22380b62d0 con 0x7f22380d15f0 2024-09-16T01:55:26.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22377fe640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2238161a20 0x7f22380b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:26.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f22367fc640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380d15f0 0x7f22381f5a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f222000c490 tx=0x7f222000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:26.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f222f7fe640 1 -- 172.21.15.42:0/1741221362 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22200052d0 con 0x7f22380d15f0 2024-09-16T01:55:26.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f222f7fe640 1 -- 172.21.15.42:0/1741221362 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2220005470 con 0x7f22380d15f0 2024-09-16T01:55:26.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f223d645640 1 -- 172.21.15.42:0/1741221362 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22380b7450 con 0x7f22380d15f0 2024-09-16T01:55:26.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.514+0000 7f222f7fe640 1 -- 172.21.15.42:0/1741221362 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2220012850 con 0x7f22380d15f0 2024-09-16T01:55:26.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.515+0000 7f223d645640 1 -- 172.21.15.42:0/1741221362 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22380b7a10 con 0x7f22380d15f0 2024-09-16T01:55:26.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.516+0000 7f223d645640 1 -- 172.21.15.42:0/1741221362 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22380b1040 con 0x7f22380d15f0 2024-09-16T01:55:26.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.516+0000 7f222f7fe640 1 -- 172.21.15.42:0/1741221362 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f22200129f0 con 0x7f22380d15f0 2024-09-16T01:55:26.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.516+0000 7f222f7fe640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f221806c2b0 0x7f221806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.516+0000 7f222f7fe640 1 -- 172.21.15.42:0/1741221362 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f222008b220 con 0x7f22380d15f0 2024-09-16T01:55:26.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.517+0000 7f2236ffd640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f221806c2b0 0x7f221806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.517+0000 7f2236ffd640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f221806c2b0 0x7f221806e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f22280011e0 tx=0x7f2228009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:26.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.521+0000 7f222f7fe640 1 -- 172.21.15.42:0/1741221362 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2220059870 con 0x7f22380d15f0 2024-09-16T01:55:26.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.709+0000 7f223d645640 1 -- 172.21.15.42:0/1741221362 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f22380cf110 con 0x7f22380d15f0 2024-09-16T01:55:26.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.709+0000 7f222f7fe640 1 -- 172.21.15.42:0/1741221362 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) ==== 80+0+0 (secure 0 0 0) 0x7f2220059170 con 0x7f22380d15f0 2024-09-16T01:55:26.711 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-16T01:55:26.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.711+0000 7f223d645640 1 -- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f221806c2b0 msgr2=0x7f221806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.711+0000 7f223d645640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f221806c2b0 0x7f221806e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f22280011e0 tx=0x7f2228009040 comp rx=0 tx=0).stop 2024-09-16T01:55:26.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.711+0000 7f223d645640 1 -- 172.21.15.42:0/1741221362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380d15f0 msgr2=0x7f22381f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.711+0000 7f223d645640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380d15f0 0x7f22381f5a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f222000c490 tx=0x7f222000c950 comp rx=0 tx=0).stop 2024-09-16T01:55:26.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.711+0000 7f223d645640 1 -- 172.21.15.42:0/1741221362 shutdown_connections 2024-09-16T01:55:26.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.711+0000 7f223d645640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f221806c2b0 0x7f221806e770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.711+0000 7f223d645640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2238161a20 0x7f22380b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.711+0000 7f223d645640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380d15f0 0x7f22381f5a20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.711+0000 7f223d645640 1 --2- 172.21.15.42:0/1741221362 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22380cf330 0x7f22381f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.711+0000 7f223d645640 1 -- 172.21.15.42:0/1741221362 >> 172.21.15.42:0/1741221362 conn(0x7f223809d850 msgr2=0x7f22381609c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:26.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.712+0000 7f223d645640 1 -- 172.21.15.42:0/1741221362 shutdown_connections 2024-09-16T01:55:26.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.712+0000 7f223d645640 1 -- 172.21.15.42:0/1741221362 wait complete. 2024-09-16T01:55:26.723 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:55:26.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:26.724 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:55:26.772 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:55:26.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:55:26.773 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:55:26.798 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:26.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.939+0000 7f3183a65640 1 Processor -- start 2024-09-16T01:55:26.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.940+0000 7f3183a65640 1 -- start start 2024-09-16T01:55:26.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.940+0000 7f3183a65640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f317c15e5f0 0x7f317c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.940+0000 7f3183a65640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f317c0b6690 0x7f317c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.940+0000 7f3183a65640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f317c0d3690 con 0x7f317c0d30f0 2024-09-16T01:55:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.940+0000 7f3183a65640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f317c06d530 con 0x7f317c0b6690 2024-09-16T01:55:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.940+0000 7f3183a65640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f317c0d3970 con 0x7f317c15e5f0 2024-09-16T01:55:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.941+0000 7f3182002640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f317c0b6690 0x7f317c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.941+0000 7f3182002640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f317c0b6690 0x7f317c06d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48142/0 (socket says 172.21.15.42:48142) 2024-09-16T01:55:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.941+0000 7f3182002640 1 -- 172.21.15.42:0/4285846665 learned_addr learned my addr 172.21.15.42:0/4285846665 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.941+0000 7f3181801640 1 --2- 172.21.15.42:0/4285846665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f317c15e5f0 0x7f317c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.941+0000 7f3182002640 1 -- 172.21.15.42:0/4285846665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f317c15e5f0 msgr2=0x7f317c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.941+0000 7f3182002640 1 --2- 172.21.15.42:0/4285846665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f317c15e5f0 0x7f317c0d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.941+0000 7f3182002640 1 -- 172.21.15.42:0/4285846665 >> v1:172.21.15.107:6789/0 conn(0x7f317c0d30f0 legacy=0x7f317c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.941+0000 7f3182002640 1 -- 172.21.15.42:0/4285846665 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c06cee0 con 0x7f317c0b6690 2024-09-16T01:55:26.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.942+0000 7f3182002640 1 --2- 172.21.15.42:0/4285846665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 0x7f317c06d9c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f316c009e50 tx=0x7f316c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab60f3d626d3d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.942+0000 7f317bfff640 1 -- 172.21.15.42:0/4285846665 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c036070 con 0x7f317c0b6690 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.942+0000 7f317bfff640 1 -- 172.21.15.42:0/4285846665 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c031600 con 0x7f317c0b6690 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.942+0000 7f317bfff640 1 -- 172.21.15.42:0/4285846665 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c0319d0 con 0x7f317c0b6690 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.943+0000 7f3183a65640 1 -- 172.21.15.42:0/4285846665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 msgr2=0x7f317c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.943+0000 7f3183a65640 1 --2- 172.21.15.42:0/4285846665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 0x7f317c06d9c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f316c009e50 tx=0x7f316c02a710 comp rx=0 tx=0).stop 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.943+0000 7f3183a65640 1 -- 172.21.15.42:0/4285846665 shutdown_connections 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.943+0000 7f3183a65640 1 --2- 172.21.15.42:0/4285846665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 0x7f317c06d9c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.943+0000 7f3183a65640 1 --2- 172.21.15.42:0/4285846665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f317c15e5f0 0x7f317c0d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.943+0000 7f3183a65640 1 -- 172.21.15.42:0/4285846665 >> 172.21.15.42:0/4285846665 conn(0x7f317c08bfc0 msgr2=0x7f317c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.943+0000 7f3183a65640 1 -- 172.21.15.42:0/4285846665 shutdown_connections 2024-09-16T01:55:26.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.943+0000 7f3183a65640 1 -- 172.21.15.42:0/4285846665 wait complete. 2024-09-16T01:55:26.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.944+0000 7f3183a65640 1 Processor -- start 2024-09-16T01:55:26.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.944+0000 7f3183a65640 1 -- start start 2024-09-16T01:55:26.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3183a65640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 0x7f317c15daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3183a65640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f317c0d30f0 0x7f317c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3183a65640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f317c15e5f0 0x7f317c160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3183a65640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f317c0d5310 con 0x7f317c0b6690 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3183a65640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f317c15e9d0 con 0x7f317c15e5f0 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3183a65640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f317c06df00 con 0x7f317c0d30f0 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3181801640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 0x7f317c15daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3181801640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 0x7f317c15daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48150/0 (socket says 172.21.15.42:48150) 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3181801640 1 -- 172.21.15.42:0/3635045850 learned_addr learned my addr 172.21.15.42:0/3635045850 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3182002640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f317c15e5f0 0x7f317c160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3181000640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f317c0d30f0 0x7f317c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3181801640 1 -- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f317c0d30f0 msgr2=0x7f317c0c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3181801640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f317c0d30f0 0x7f317c0c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3181801640 1 -- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f317c15e5f0 msgr2=0x7f317c160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:26.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3181801640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f317c15e5f0 0x7f317c160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:26.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3181801640 1 -- 172.21.15.42:0/3635045850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c09edb0 con 0x7f317c0b6690 2024-09-16T01:55:26.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3181801640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 0x7f317c15daf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f317400e870 tx=0x7f317400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:26.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.945+0000 7f3179ffb640 1 -- 172.21.15.42:0/3635045850 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174017070 con 0x7f317c0b6690 2024-09-16T01:55:26.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.946+0000 7f3179ffb640 1 -- 172.21.15.42:0/3635045850 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317400c940 con 0x7f317c0b6690 2024-09-16T01:55:26.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.946+0000 7f3183a65640 1 -- 172.21.15.42:0/3635045850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317c0a0dd0 con 0x7f317c0b6690 2024-09-16T01:55:26.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.946+0000 7f3179ffb640 1 -- 172.21.15.42:0/3635045850 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317400cd30 con 0x7f317c0b6690 2024-09-16T01:55:26.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.946+0000 7f3183a65640 1 -- 172.21.15.42:0/3635045850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317c0a1390 con 0x7f317c0b6690 2024-09-16T01:55:26.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.947+0000 7f3183a65640 1 -- 172.21.15.42:0/3635045850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f317c06d9c0 con 0x7f317c0b6690 2024-09-16T01:55:26.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.947+0000 7f3179ffb640 1 -- 172.21.15.42:0/3635045850 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f317401a070 con 0x7f317c0b6690 2024-09-16T01:55:26.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.948+0000 7f3179ffb640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f316806c2e0 0x7f316806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:26.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.948+0000 7f3179ffb640 1 -- 172.21.15.42:0/3635045850 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f317408b330 con 0x7f317c0b6690 2024-09-16T01:55:26.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.948+0000 7f3181000640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f316806c2e0 0x7f316806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:26.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.949+0000 7f3181000640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f316806c2e0 0x7f316806e7a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f317c0d2d00 tx=0x7f3170009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:26.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:26.952+0000 7f3179ffb640 1 -- 172.21.15.42:0/3635045850 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3174059350 con 0x7f317c0b6690 2024-09-16T01:55:27.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.162+0000 7f3183a65640 1 -- 172.21.15.42:0/3635045850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f317c0b2b30 con 0x7f317c0b6690 2024-09-16T01:55:27.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.163+0000 7f3179ffb640 1 -- 172.21.15.42:0/3635045850 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f317405d650 con 0x7f317c0b6690 2024-09-16T01:55:27.165 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:27.165 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"btime":"2024-09-16T01:55:17:061679+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/920871952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":920871952},{"type":"v1","addr":"172.21.15.42:6835","nonce":920871952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2239532612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2239532612},{"type":"v1","addr":"172.21.15.42:6833","nonce":2239532612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/663599658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":663599658},{"type":"v1","addr":"172.21.15.107:6836","nonce":663599658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:14.411116+0000","modified":"2024-09-16T01:55:16.402868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34562":{"gid":34562,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3744211154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3744211154},{"type":"v1","addr":"172.21.15.107:6837","nonce":3744211154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34562,"qdb_cluster":[34562]},"id":2}]} 2024-09-16T01:55:27.165 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-09-16T01:55:27.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 -- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f316806c2e0 msgr2=0x7f316806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:27.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f316806c2e0 0x7f316806e7a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f317c0d2d00 tx=0x7f3170009040 comp rx=0 tx=0).stop 2024-09-16T01:55:27.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 -- 172.21.15.42:0/3635045850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 msgr2=0x7f317c15daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:27.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 0x7f317c15daf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f317400e870 tx=0x7f317400ed30 comp rx=0 tx=0).stop 2024-09-16T01:55:27.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 -- 172.21.15.42:0/3635045850 shutdown_connections 2024-09-16T01:55:27.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f316806c2e0 0x7f316806e7a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f317c15e5f0 0x7f317c160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f317c0d30f0 0x7f317c0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 --2- 172.21.15.42:0/3635045850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f317c0b6690 0x7f317c15daf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 -- 172.21.15.42:0/3635045850 >> 172.21.15.42:0/3635045850 conn(0x7f317c08bfc0 msgr2=0x7f317c0b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:27.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 -- 172.21.15.42:0/3635045850 shutdown_connections 2024-09-16T01:55:27.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.165+0000 7f3183a65640 1 -- 172.21.15.42:0/3635045850 wait complete. 2024-09-16T01:55:27.177 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-16T01:55:27.312 INFO:teuthology.orchestra.run.smithi107.stdout:{"message":"","return_code":0} 2024-09-16T01:55:27.312 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-16T01:55:27.312 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.414+0000 7f4be4749640 1 Processor -- start 2024-09-16T01:55:27.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.414+0000 7f4be4749640 1 -- start start 2024-09-16T01:55:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be4749640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4bdc0d30f0 0x7f4bdc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be4749640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bdc0b64c0 0x7f4bdc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be4749640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bdc0d3690 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be4749640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f4bdc06d530 con 0x7f4bdc0d30f0 2024-09-16T01:55:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be4749640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4bdc0d3970 con 0x7f4bdc0b64c0 2024-09-16T01:55:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be1ce4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4bdc0d30f0 0x7f4bdc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be24e5640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4bdc15e5f0 0x7f4bdc0d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59760/0 (socket says 172.21.15.42:59760) 2024-09-16T01:55:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be24e5640 1 -- 172.21.15.42:0/1556670149 learned_addr learned my addr 172.21.15.42:0/1556670149 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be2ce6640 1 --2- 172.21.15.42:0/1556670149 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bdc0b64c0 0x7f4bdc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be1ce4640 1 -- 172.21.15.42:0/1556670149 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bdc0b64c0 msgr2=0x7f4bdc06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be1ce4640 1 --2- 172.21.15.42:0/1556670149 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bdc0b64c0 0x7f4bdc06d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be1ce4640 1 -- 172.21.15.42:0/1556670149 >> v1:172.21.15.42:6789/0 conn(0x7f4bdc15e5f0 legacy=0x7f4bdc0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:27.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.415+0000 7f4be1ce4640 1 -- 172.21.15.42:0/1556670149 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bdc06cee0 con 0x7f4bdc0d30f0 2024-09-16T01:55:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.416+0000 7f4be1ce4640 1 --2- 172.21.15.42:0/1556670149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc0d30f0 0x7f4bdc0b5f80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0097a0 tx=0x7f4bcc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f1a823b4e57108 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.416+0000 7f4be14e3640 1 -- 172.21.15.42:0/1556670149 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc037070 con 0x7f4bdc0d30f0 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.416+0000 7f4be14e3640 1 -- 172.21.15.42:0/1556670149 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc032440 con 0x7f4bdc0d30f0 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.416+0000 7f4be14e3640 1 -- 172.21.15.42:0/1556670149 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc032810 con 0x7f4bdc0d30f0 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.417+0000 7f4be4749640 1 -- 172.21.15.42:0/1556670149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc0d30f0 msgr2=0x7f4bdc0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.417+0000 7f4be4749640 1 --2- 172.21.15.42:0/1556670149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc0d30f0 0x7f4bdc0b5f80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0097a0 tx=0x7f4bcc02a180 comp rx=0 tx=0).stop 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.417+0000 7f4be4749640 1 -- 172.21.15.42:0/1556670149 shutdown_connections 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.417+0000 7f4be4749640 1 --2- 172.21.15.42:0/1556670149 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bdc0b64c0 0x7f4bdc06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.417+0000 7f4be4749640 1 --2- 172.21.15.42:0/1556670149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc0d30f0 0x7f4bdc0b5f80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.417+0000 7f4be4749640 1 -- 172.21.15.42:0/1556670149 >> 172.21.15.42:0/1556670149 conn(0x7f4bdc08bfc0 msgr2=0x7f4bdc0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.417+0000 7f4be4749640 1 -- 172.21.15.42:0/1556670149 shutdown_connections 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.417+0000 7f4be4749640 1 -- 172.21.15.42:0/1556670149 wait complete. 2024-09-16T01:55:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.418+0000 7f4be4749640 1 Processor -- start 2024-09-16T01:55:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.418+0000 7f4be4749640 1 -- start start 2024-09-16T01:55:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be4749640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bdc0b64c0 0x7f4bdc1f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be4749640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bdc0d30f0 0x7f4bdc1f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be4749640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc15e5f0 0x7f4bdc1f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be4749640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4bdc06df00 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be4749640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4bdc15e9d0 con 0x7f4bdc0b64c0 2024-09-16T01:55:27.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be4749640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4bdc06e080 con 0x7f4bdc0d30f0 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be2ce6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc15e5f0 0x7f4bdc1f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be2ce6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc15e5f0 0x7f4bdc1f8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48168/0 (socket says 172.21.15.42:48168) 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be2ce6640 1 -- 172.21.15.42:0/2619327502 learned_addr learned my addr 172.21.15.42:0/2619327502 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be1ce4640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bdc0d30f0 0x7f4bdc1f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be24e5640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bdc0b64c0 0x7f4bdc1f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be2ce6640 1 -- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bdc0d30f0 msgr2=0x7f4bdc1f7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be2ce6640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bdc0d30f0 0x7f4bdc1f7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be2ce6640 1 -- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bdc0b64c0 msgr2=0x7f4bdc1f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be2ce6640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bdc0b64c0 0x7f4bdc1f76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be2ce6640 1 -- 172.21.15.42:0/2619327502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bdc0b8220 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be2ce6640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc15e5f0 0x7f4bdc1f8140 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009dd0 tx=0x7f4bd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:27.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4bd2ffd640 1 -- 172.21.15.42:0/2619327502 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4018020 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4bd2ffd640 1 -- 172.21.15.42:0/2619327502 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd4014480 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be4749640 1 -- 172.21.15.42:0/2619327502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bdc0b8500 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4bd2ffd640 1 -- 172.21.15.42:0/2619327502 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4014870 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.419+0000 7f4be4749640 1 -- 172.21.15.42:0/2619327502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bdc0b8ac0 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.421+0000 7f4be4749640 1 -- 172.21.15.42:0/2619327502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bdc06d9c0 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.421+0000 7f4bd2ffd640 1 -- 172.21.15.42:0/2619327502 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4bd401b020 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.421+0000 7f4bd2ffd640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bc006c2b0 0x7f4bc006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.422+0000 7f4bd2ffd640 1 -- 172.21.15.42:0/2619327502 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f4bd408c160 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.422+0000 7f4be24e5640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bc006c2b0 0x7f4bc006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.422+0000 7f4be24e5640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bc006c2b0 0x7f4bc006e770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8000f60 tx=0x7f4bd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.426+0000 7f4bd2ffd640 1 -- 172.21.15.42:0/2619327502 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bd4022030 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.636+0000 7f4be4749640 1 -- 172.21.15.42:0/2619327502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bdc0b1a00 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.637+0000 7f4bd2ffd640 1 -- 172.21.15.42:0/2619327502 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f4bd4010040 con 0x7f4bdc15e5f0 2024-09-16T01:55:27.638 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:27.638 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"btime":"2024-09-16T01:55:17:061679+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/920871952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":920871952},{"type":"v1","addr":"172.21.15.42:6835","nonce":920871952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2239532612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2239532612},{"type":"v1","addr":"172.21.15.42:6833","nonce":2239532612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/663599658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":663599658},{"type":"v1","addr":"172.21.15.107:6836","nonce":663599658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:14.411116+0000","modified":"2024-09-16T01:55:16.402868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34562":{"gid":34562,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3744211154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3744211154},{"type":"v1","addr":"172.21.15.107:6837","nonce":3744211154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34562,"qdb_cluster":[34562]},"id":2}]} 2024-09-16T01:55:27.639 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-09-16T01:55:27.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.638+0000 7f4be4749640 1 -- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bc006c2b0 msgr2=0x7f4bc006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:27.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.638+0000 7f4be4749640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bc006c2b0 0x7f4bc006e770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8000f60 tx=0x7f4bd8009040 comp rx=0 tx=0).stop 2024-09-16T01:55:27.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.638+0000 7f4be4749640 1 -- 172.21.15.42:0/2619327502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc15e5f0 msgr2=0x7f4bdc1f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:27.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.638+0000 7f4be4749640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc15e5f0 0x7f4bdc1f8140 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009dd0 tx=0x7f4bd400c490 comp rx=0 tx=0).stop 2024-09-16T01:55:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.638+0000 7f4be4749640 1 -- 172.21.15.42:0/2619327502 shutdown_connections 2024-09-16T01:55:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.639+0000 7f4be4749640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bc006c2b0 0x7f4bc006e770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.639+0000 7f4be4749640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc15e5f0 0x7f4bdc1f8140 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.639+0000 7f4be4749640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4bdc0d30f0 0x7f4bdc1f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.639+0000 7f4be4749640 1 --2- 172.21.15.42:0/2619327502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bdc0b64c0 0x7f4bdc1f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.639+0000 7f4be4749640 1 -- 172.21.15.42:0/2619327502 >> 172.21.15.42:0/2619327502 conn(0x7f4bdc08bfc0 msgr2=0x7f4bdc0b5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.639+0000 7f4be4749640 1 -- 172.21.15.42:0/2619327502 shutdown_connections 2024-09-16T01:55:27.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:27.639+0000 7f4be4749640 1 -- 172.21.15.42:0/2619327502 wait complete. 2024-09-16T01:55:27.651 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json tag path /parentdir mytag 2024-09-16T01:55:27.772 INFO:teuthology.orchestra.run.smithi107.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-09-16T01:55:27.773 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-09-16T01:55:37.774 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-09-16T01:55:37.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.826+0000 7f050e45ff40 1 Processor -- start 2024-09-16T01:55:37.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.826+0000 7f050e45ff40 1 -- start start 2024-09-16T01:55:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050e45ff40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbd6af70 0x564bfbe421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050e45ff40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564bfbd6b350 0x564bfbe36000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050e45ff40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bfbe3a8e0 0x564bfbe36540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050e45ff40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564bfbcba510 con 0x564bfbd6af70 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050e45ff40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564bfbd13c50 con 0x564bfbe3a8e0 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050e45ff40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x564bfbd96760 con 0x564bfbd6b350 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050bf55640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbd6af70 0x564bfbe421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050bf55640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbd6af70 0x564bfbe421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59972/0 (socket says 172.21.15.42:59972) 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050bf55640 1 -- 172.21.15.42:0/2547440468 learned_addr learned my addr 172.21.15.42:0/2547440468 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050b754640 1 --2- 172.21.15.42:0/2547440468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564bfbd6b350 0x564bfbe36000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050c756640 1 --2- 172.21.15.42:0/2547440468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bfbe3a8e0 0x564bfbe36540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050bf55640 1 -- 172.21.15.42:0/2547440468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564bfbd6b350 msgr2=0x564bfbe36000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050bf55640 1 --2- 172.21.15.42:0/2547440468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564bfbd6b350 0x564bfbe36000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050bf55640 1 -- 172.21.15.42:0/2547440468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bfbe3a8e0 msgr2=0x564bfbe36540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050bf55640 1 --2- 172.21.15.42:0/2547440468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bfbe3a8e0 0x564bfbe36540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.827+0000 7f050bf55640 1 -- 172.21.15.42:0/2547440468 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bfbe39510 con 0x564bfbd6af70 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050bf55640 1 --2- 172.21.15.42:0/2547440468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbd6af70 0x564bfbe421d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f04fc001e00 tx=0x7f04fc00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39360092abe8217a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050a752640 1 -- 172.21.15.42:0/2547440468 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc00be40 con 0x564bfbd6af70 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050a752640 1 -- 172.21.15.42:0/2547440468 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04fc00f400 con 0x564bfbd6af70 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050a752640 1 -- 172.21.15.42:0/2547440468 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc00f7f0 con 0x564bfbd6af70 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050e45ff40 1 -- 172.21.15.42:0/2547440468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbd6af70 msgr2=0x564bfbe421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050e45ff40 1 --2- 172.21.15.42:0/2547440468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbd6af70 0x564bfbe421d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f04fc001e00 tx=0x7f04fc00b670 comp rx=0 tx=0).stop 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050e45ff40 1 -- 172.21.15.42:0/2547440468 shutdown_connections 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050e45ff40 1 --2- 172.21.15.42:0/2547440468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bfbe3a8e0 0x564bfbe36540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050e45ff40 1 --2- 172.21.15.42:0/2547440468 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564bfbd6b350 0x564bfbe36000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050e45ff40 1 --2- 172.21.15.42:0/2547440468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbd6af70 0x564bfbe421d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050e45ff40 1 -- 172.21.15.42:0/2547440468 >> 172.21.15.42:0/2547440468 conn(0x564bfbd6a1d0 msgr2=0x564bfbe38a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:37.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050e45ff40 1 -- 172.21.15.42:0/2547440468 shutdown_connections 2024-09-16T01:55:37.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.828+0000 7f050e45ff40 1 -- 172.21.15.42:0/2547440468 wait complete. 2024-09-16T01:55:37.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.829+0000 7f050e45ff40 1 Processor -- start 2024-09-16T01:55:37.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.829+0000 7f050e45ff40 1 -- start start 2024-09-16T01:55:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050e45ff40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564bfbd6af70 0x564bfbdaca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050e45ff40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bfbd6b350 0x564bfbdacf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050e45ff40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbe3a8e0 0x564bfbdad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050e45ff40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564bfbe42bb0 con 0x564bfbe3a8e0 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050e45ff40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564bfbe404e0 con 0x564bfbd6b350 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050e45ff40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x564bfbdb2920 con 0x564bfbd6af70 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050c756640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbe3a8e0 0x564bfbdad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050c756640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbe3a8e0 0x564bfbdad480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59976/0 (socket says 172.21.15.42:59976) 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050c756640 1 -- 172.21.15.42:0/2805835521 learned_addr learned my addr 172.21.15.42:0/2805835521 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050bf55640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564bfbd6af70 0x564bfbdaca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050b754640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bfbd6b350 0x564bfbdacf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050c756640 1 -- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564bfbd6af70 msgr2=0x564bfbdaca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050c756640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564bfbd6af70 0x564bfbdaca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050c756640 1 -- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bfbd6b350 msgr2=0x564bfbdacf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050c756640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bfbd6b350 0x564bfbdacf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050c756640 1 -- 172.21.15.42:0/2805835521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bfbe2da50 con 0x564bfbe3a8e0 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.830+0000 7f050bf55640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x564bfbd6af70 0x564bfbdaca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.831+0000 7f050c756640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbe3a8e0 0x564bfbdad480 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f050400e7c0 tx=0x7f050400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.831+0000 7f0509750640 1 -- 172.21.15.42:0/2805835521 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504016020 con 0x564bfbe3a8e0 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.831+0000 7f0509750640 1 -- 172.21.15.42:0/2805835521 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0504001fd0 con 0x564bfbe3a8e0 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.831+0000 7f050e45ff40 1 -- 172.21.15.42:0/2805835521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564bfbdadcd0 con 0x564bfbe3a8e0 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.831+0000 7f0509750640 1 -- 172.21.15.42:0/2805835521 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050400c930 con 0x564bfbe3a8e0 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.831+0000 7f050e45ff40 1 -- 172.21.15.42:0/2805835521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bfbdad9c0 con 0x564bfbe3a8e0 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.832+0000 7f0509750640 1 -- 172.21.15.42:0/2805835521 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0504019020 con 0x564bfbe3a8e0 2024-09-16T01:55:37.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.833+0000 7f0509750640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f04f806ac90 0x7f04f806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.833+0000 7f0509750640 1 -- 172.21.15.42:0/2805835521 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f050408a220 con 0x564bfbe3a8e0 2024-09-16T01:55:37.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.833+0000 7f050e45ff40 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x564bfbe2c660 0x564bfbe2ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.833+0000 7f050e45ff40 1 -- 172.21.15.42:0/2805835521 --> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x564bfbe2cfc0 con 0x564bfbe2c660 2024-09-16T01:55:37.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.833+0000 7f050bf55640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f04f806ac90 0x7f04f806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.833+0000 7f050b754640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x564bfbe2c660 0x564bfbe2ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.834+0000 7f050bf55640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f04f806ac90 0x7f04f806d150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f04fc001e00 tx=0x7f04fc009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.834+0000 7f050b754640 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x564bfbe2c660 0x564bfbe2ca80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.834+0000 7f050b754640 1 -- 172.21.15.42:0/2805835521 <== osd.7 v2:172.21.15.107:6800/1756026323 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f050005c040 con 0x564bfbe2c660 2024-09-16T01:55:37.840 INFO:teuthology.orchestra.run.smithi042.stdout:mytag 2024-09-16T01:55:37.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.834+0000 7f050e45ff40 1 -- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x564bfbe2c660 msgr2=0x564bfbe2ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.834+0000 7f050e45ff40 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x564bfbe2c660 0x564bfbe2ca80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.835+0000 7f050e45ff40 1 -- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f04f806ac90 msgr2=0x7f04f806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.835+0000 7f050e45ff40 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f04f806ac90 0x7f04f806d150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f04fc001e00 tx=0x7f04fc009000 comp rx=0 tx=0).stop 2024-09-16T01:55:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.835+0000 7f050e45ff40 1 -- 172.21.15.42:0/2805835521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbe3a8e0 msgr2=0x564bfbdad480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.835+0000 7f050e45ff40 1 --2- 172.21.15.42:0/2805835521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564bfbe3a8e0 0x564bfbdad480 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f050400e7c0 tx=0x7f050400ec80 comp rx=0 tx=0).stop 2024-09-16T01:55:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.835+0000 7f050c756640 1 -- 172.21.15.42:0/2805835521 reap_dead start 2024-09-16T01:55:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.835+0000 7f050e45ff40 1 -- 172.21.15.42:0/2805835521 shutdown_connections 2024-09-16T01:55:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.835+0000 7f050e45ff40 1 -- 172.21.15.42:0/2805835521 >> 172.21.15.42:0/2805835521 conn(0x564bfbd6a1d0 msgr2=0x564bfbd94c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.835+0000 7f050e45ff40 1 -- 172.21.15.42:0/2805835521 shutdown_connections 2024-09-16T01:55:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.835+0000 7f050e45ff40 1 -- 172.21.15.42:0/2805835521 wait complete. 2024-09-16T01:55:37.844 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-09-16T01:55:37.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.889+0000 7efcc7d21f40 1 Processor -- start 2024-09-16T01:55:37.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.889+0000 7efcc7d21f40 1 -- start start 2024-09-16T01:55:37.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc7d21f40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2db7e20 0x55c0c2e90380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc7d21f40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55c0c2de5450 0x55c0c2dfcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc7d21f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2e76730 0x55c0c2dfcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc7d21f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c0c2de64e0 con 0x55c0c2e76730 2024-09-16T01:55:37.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc7d21f40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c0c2d09510 con 0x55c0c2db7e20 2024-09-16T01:55:37.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc7d21f40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55c0c2db8260 con 0x55c0c2de5450 2024-09-16T01:55:37.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc55d0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2e76730 0x55c0c2dfcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc4dcf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2db7e20 0x55c0c2e90380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc45ce640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55c0c2de5450 0x55c0c2dfcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc55d0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2e76730 0x55c0c2dfcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59994/0 (socket says 172.21.15.42:59994) 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.890+0000 7efcc55d0640 1 -- 172.21.15.42:0/596361740 learned_addr learned my addr 172.21.15.42:0/596361740 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc4dcf640 1 -- 172.21.15.42:0/596361740 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55c0c2de5450 msgr2=0x55c0c2dfcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc4dcf640 1 --2- 172.21.15.42:0/596361740 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55c0c2de5450 0x55c0c2dfcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc4dcf640 1 -- 172.21.15.42:0/596361740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2e76730 msgr2=0x55c0c2dfcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc4dcf640 1 --2- 172.21.15.42:0/596361740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2e76730 0x55c0c2dfcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc4dcf640 1 -- 172.21.15.42:0/596361740 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c2e908c0 con 0x55c0c2db7e20 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc45ce640 1 --2- 172.21.15.42:0/596361740 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55c0c2de5450 0x55c0c2dfcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc55d0640 1 --2- 172.21.15.42:0/596361740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2e76730 0x55c0c2dfcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc4dcf640 1 --2- 172.21.15.42:0/596361740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2db7e20 0x55c0c2e90380 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efcb4053000 tx=0x7efcb4050000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6760760e3e83183 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc35cc640 1 -- 172.21.15.42:0/596361740 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4054040 con 0x55c0c2db7e20 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc35cc640 1 -- 172.21.15.42:0/596361740 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb4050920 con 0x55c0c2db7e20 2024-09-16T01:55:37.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.891+0000 7efcc35cc640 1 -- 172.21.15.42:0/596361740 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4050d30 con 0x55c0c2db7e20 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 -- 172.21.15.42:0/596361740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2db7e20 msgr2=0x55c0c2e90380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 --2- 172.21.15.42:0/596361740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2db7e20 0x55c0c2e90380 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efcb4053000 tx=0x7efcb4050000 comp rx=0 tx=0).stop 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 -- 172.21.15.42:0/596361740 shutdown_connections 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 --2- 172.21.15.42:0/596361740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2e76730 0x55c0c2dfcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 --2- 172.21.15.42:0/596361740 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55c0c2de5450 0x55c0c2dfcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 --2- 172.21.15.42:0/596361740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2db7e20 0x55c0c2e90380 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 -- 172.21.15.42:0/596361740 >> 172.21.15.42:0/596361740 conn(0x55c0c2db8ad0 msgr2=0x55c0c2db7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 -- 172.21.15.42:0/596361740 shutdown_connections 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 -- 172.21.15.42:0/596361740 wait complete. 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 Processor -- start 2024-09-16T01:55:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.892+0000 7efcc7d21f40 1 -- start start 2024-09-16T01:55:37.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc7d21f40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55c0c2db7e20 0x55c0c2e8a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc7d21f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2de5450 0x55c0c2e6d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc7d21f40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2e76730 0x55c0c2de2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc7d21f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c0c2e714b0 con 0x55c0c2de5450 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc7d21f40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55c0c2e8fe60 con 0x55c0c2e76730 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc7d21f40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55c0c2e8fb80 con 0x55c0c2db7e20 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc45ce640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2de5450 0x55c0c2e6d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc45ce640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2de5450 0x55c0c2e6d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60008/0 (socket says 172.21.15.42:60008) 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc45ce640 1 -- 172.21.15.42:0/1560374020 learned_addr learned my addr 172.21.15.42:0/1560374020 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc4dcf640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55c0c2db7e20 0x55c0c2e8a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc55d0640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2e76730 0x55c0c2de2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc45ce640 1 -- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55c0c2db7e20 msgr2=0x55c0c2e8a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc45ce640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55c0c2db7e20 0x55c0c2e8a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc45ce640 1 -- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2e76730 msgr2=0x55c0c2de2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc45ce640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2e76730 0x55c0c2de2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc45ce640 1 -- 172.21.15.42:0/1560374020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c2de4e30 con 0x55c0c2de5450 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.893+0000 7efcc55d0640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c2e76730 0x55c0c2de2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.894+0000 7efcc45ce640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2de5450 0x55c0c2e6d9e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efcac009e80 tx=0x7efcac009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.894+0000 7efcc25ca640 1 -- 172.21.15.42:0/1560374020 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac01b070 con 0x55c0c2de5450 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.894+0000 7efcc25ca640 1 -- 172.21.15.42:0/1560374020 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcac016480 con 0x55c0c2de5450 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.894+0000 7efcc7d21f40 1 -- 172.21.15.42:0/1560374020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0c2e6cfa0 con 0x55c0c2de5450 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.894+0000 7efcc25ca640 1 -- 172.21.15.42:0/1560374020 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac016870 con 0x55c0c2de5450 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.894+0000 7efcc7d21f40 1 -- 172.21.15.42:0/1560374020 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c2da5d30 con 0x55c0c2de5450 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.895+0000 7efcc25ca640 1 -- 172.21.15.42:0/1560374020 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efcac01e070 con 0x55c0c2de5450 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.896+0000 7efcc25ca640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efca406ac90 0x7efca406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.896+0000 7efcc25ca640 1 -- 172.21.15.42:0/1560374020 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7efcac089a50 con 0x55c0c2de5450 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.896+0000 7efcc4dcf640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efca406ac90 0x7efca406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.896+0000 7efcc7d21f40 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x55c0c2e8af20 0x55c0c2e72320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.896+0000 7efcc7d21f40 1 -- 172.21.15.42:0/1560374020 --> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x55c0c2e8c890 con 0x55c0c2e8af20 2024-09-16T01:55:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.896+0000 7efcc55d0640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x55c0c2e8af20 0x55c0c2e72320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.896+0000 7efcc4dcf640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efca406ac90 0x7efca406d150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55c0c2de3b60 tx=0x7efcb4051000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.897+0000 7efcc55d0640 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x55c0c2e8af20 0x55c0c2e72320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.897+0000 7efcc55d0640 1 -- 172.21.15.42:0/1560374020 <== osd.5 v2:172.21.15.107:6816/188494589 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7efcbc010700 con 0x55c0c2e8af20 2024-09-16T01:55:37.902 INFO:teuthology.orchestra.run.smithi042.stdout:mytag 2024-09-16T01:55:37.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.897+0000 7efcc7d21f40 1 -- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x55c0c2e8af20 msgr2=0x55c0c2e72320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.897+0000 7efcc7d21f40 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x55c0c2e8af20 0x55c0c2e72320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.898+0000 7efcc7d21f40 1 -- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efca406ac90 msgr2=0x7efca406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.898+0000 7efcc7d21f40 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7efca406ac90 0x7efca406d150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55c0c2de3b60 tx=0x7efcb4051000 comp rx=0 tx=0).stop 2024-09-16T01:55:37.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.898+0000 7efcc7d21f40 1 -- 172.21.15.42:0/1560374020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2de5450 msgr2=0x55c0c2e6d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.898+0000 7efcc7d21f40 1 --2- 172.21.15.42:0/1560374020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c0c2de5450 0x55c0c2e6d9e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efcac009e80 tx=0x7efcac009f70 comp rx=0 tx=0).stop 2024-09-16T01:55:37.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.898+0000 7efcc55d0640 1 -- 172.21.15.42:0/1560374020 reap_dead start 2024-09-16T01:55:37.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.898+0000 7efcc7d21f40 1 -- 172.21.15.42:0/1560374020 shutdown_connections 2024-09-16T01:55:37.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.898+0000 7efcc7d21f40 1 -- 172.21.15.42:0/1560374020 >> 172.21.15.42:0/1560374020 conn(0x55c0c2db8ad0 msgr2=0x55c0c2e6d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:37.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.898+0000 7efcc7d21f40 1 -- 172.21.15.42:0/1560374020 shutdown_connections 2024-09-16T01:55:37.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.898+0000 7efcc7d21f40 1 -- 172.21.15.42:0/1560374020 wait complete. 2024-09-16T01:55:37.905 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-09-16T01:55:37.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.950+0000 7f259c385f40 1 Processor -- start 2024-09-16T01:55:37.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.950+0000 7f259c385f40 1 -- start start 2024-09-16T01:55:37.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259c385f40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5602aaf53350 0x5602ab01a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259c385f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf99fc0 0x5602aaf4ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259c385f40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5602ab0203d0 0x5602aaf4f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259c385f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5602ab026890 con 0x5602aaf99fc0 2024-09-16T01:55:37.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259c385f40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5602aaea2510 con 0x5602aaf53350 2024-09-16T01:55:37.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259c385f40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5602ab026b70 con 0x5602ab0203d0 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259967a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf99fc0 0x5602aaf4ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259967a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf99fc0 0x5602aaf4ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60022/0 (socket says 172.21.15.42:60022) 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259967a640 1 -- 172.21.15.42:0/3973356422 learned_addr learned my addr 172.21.15.42:0/3973356422 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259a67c640 1 --2- 172.21.15.42:0/3973356422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5602ab0203d0 0x5602aaf4f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f2599e7b640 1 --2- 172.21.15.42:0/3973356422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5602aaf53350 0x5602ab01a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259967a640 1 -- 172.21.15.42:0/3973356422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5602ab0203d0 msgr2=0x5602aaf4f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259967a640 1 --2- 172.21.15.42:0/3973356422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5602ab0203d0 0x5602aaf4f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259967a640 1 -- 172.21.15.42:0/3973356422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5602aaf53350 msgr2=0x5602ab01a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259967a640 1 --2- 172.21.15.42:0/3973356422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5602aaf53350 0x5602ab01a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259967a640 1 -- 172.21.15.42:0/3973356422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ab022740 con 0x5602aaf99fc0 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f259967a640 1 --2- 172.21.15.42:0/3973356422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf99fc0 0x5602aaf4ee10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2584000c00 tx=0x7f2584051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a354dacba280160d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f2593fff640 1 -- 172.21.15.42:0/3973356422 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584055070 con 0x5602aaf99fc0 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f2593fff640 1 -- 172.21.15.42:0/3973356422 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25840518b0 con 0x5602aaf99fc0 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.951+0000 7f2593fff640 1 -- 172.21.15.42:0/3973356422 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584051c80 con 0x5602aaf99fc0 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.952+0000 7f259c385f40 1 -- 172.21.15.42:0/3973356422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf99fc0 msgr2=0x5602aaf4ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.952+0000 7f259c385f40 1 --2- 172.21.15.42:0/3973356422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf99fc0 0x5602aaf4ee10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2584000c00 tx=0x7f2584051000 comp rx=0 tx=0).stop 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.952+0000 7f259c385f40 1 -- 172.21.15.42:0/3973356422 shutdown_connections 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.952+0000 7f259c385f40 1 --2- 172.21.15.42:0/3973356422 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5602ab0203d0 0x5602aaf4f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.952+0000 7f259c385f40 1 --2- 172.21.15.42:0/3973356422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf99fc0 0x5602aaf4ee10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.952+0000 7f259c385f40 1 --2- 172.21.15.42:0/3973356422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5602aaf53350 0x5602ab01a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.952+0000 7f259c385f40 1 -- 172.21.15.42:0/3973356422 >> 172.21.15.42:0/3973356422 conn(0x5602aaf509e0 msgr2=0x5602aaf7ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.952+0000 7f259c385f40 1 -- 172.21.15.42:0/3973356422 shutdown_connections 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.952+0000 7f259c385f40 1 -- 172.21.15.42:0/3973356422 wait complete. 2024-09-16T01:55:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f259c385f40 1 Processor -- start 2024-09-16T01:55:37.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f259c385f40 1 -- start start 2024-09-16T01:55:37.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f259c385f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf53350 0x5602ab028000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f259c385f40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5602aaf99fc0 0x5602ab025c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f259c385f40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5602ab0203d0 0x5602ab0bbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f259c385f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5602ab01a7b0 con 0x5602aaf53350 2024-09-16T01:55:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f259c385f40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5602ab01cf10 con 0x5602ab0203d0 2024-09-16T01:55:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f259c385f40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5602aaf50e30 con 0x5602aaf99fc0 2024-09-16T01:55:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f2599e7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf53350 0x5602ab028000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f2599e7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf53350 0x5602ab028000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60028/0 (socket says 172.21.15.42:60028) 2024-09-16T01:55:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f2599e7b640 1 -- 172.21.15.42:0/850772540 learned_addr learned my addr 172.21.15.42:0/850772540 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.953+0000 7f259967a640 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5602aaf99fc0 0x5602ab025c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f259a67c640 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5602ab0203d0 0x5602ab0bbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f2599e7b640 1 -- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5602aaf99fc0 msgr2=0x5602ab025c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f2599e7b640 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5602aaf99fc0 0x5602ab025c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f2599e7b640 1 -- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5602ab0203d0 msgr2=0x5602ab0bbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f2599e7b640 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5602ab0203d0 0x5602ab0bbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f2599e7b640 1 -- 172.21.15.42:0/850772540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ab028710 con 0x5602aaf53350 2024-09-16T01:55:37.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f2599e7b640 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf53350 0x5602ab028000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f258c00b480 tx=0x7f258c00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f2592ffd640 1 -- 172.21.15.42:0/850772540 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c00f580 con 0x5602aaf53350 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f2592ffd640 1 -- 172.21.15.42:0/850772540 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f258c00f740 con 0x5602aaf53350 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f2592ffd640 1 -- 172.21.15.42:0/850772540 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c00fb30 con 0x5602aaf53350 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f259c385f40 1 -- 172.21.15.42:0/850772540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602ab0289f0 con 0x5602aaf53350 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.954+0000 7f259c385f40 1 -- 172.21.15.42:0/850772540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ab028fb0 con 0x5602aaf53350 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.956+0000 7f2592ffd640 1 -- 172.21.15.42:0/850772540 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f258c00fcd0 con 0x5602aaf53350 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.956+0000 7f2592ffd640 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f257c06ac90 0x7f257c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.956+0000 7f2592ffd640 1 -- 172.21.15.42:0/850772540 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f258c08a550 con 0x5602aaf53350 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.956+0000 7f259967a640 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f257c06ac90 0x7f257c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.956+0000 7f259c385f40 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x5602ab01aa30 0x5602ab01ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.956+0000 7f259c385f40 1 -- 172.21.15.42:0/850772540 --> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x5602ab01b350 con 0x5602ab01aa30 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.956+0000 7f259a67c640 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x5602ab01aa30 0x5602ab01ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259967a640 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f257c06ac90 0x7f257c06d150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2584045be0 tx=0x7f2584053000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259a67c640 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x5602ab01aa30 0x5602ab01ae10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:37.963 INFO:teuthology.orchestra.run.smithi042.stdout:mytag 2024-09-16T01:55:37.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259a67c640 1 -- 172.21.15.42:0/850772540 <== osd.5 v2:172.21.15.107:6816/188494589 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f25940099f0 con 0x5602ab01aa30 2024-09-16T01:55:37.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259c385f40 1 -- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x5602ab01aa30 msgr2=0x5602ab01ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259c385f40 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x5602ab01aa30 0x5602ab01ae10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:37.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259c385f40 1 -- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f257c06ac90 msgr2=0x7f257c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259c385f40 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f257c06ac90 0x7f257c06d150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2584045be0 tx=0x7f2584053000 comp rx=0 tx=0).stop 2024-09-16T01:55:37.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259c385f40 1 -- 172.21.15.42:0/850772540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf53350 msgr2=0x5602ab028000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:37.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259c385f40 1 --2- 172.21.15.42:0/850772540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5602aaf53350 0x5602ab028000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f258c00b480 tx=0x7f258c00b940 comp rx=0 tx=0).stop 2024-09-16T01:55:37.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259a67c640 1 -- 172.21.15.42:0/850772540 reap_dead start 2024-09-16T01:55:37.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259c385f40 1 -- 172.21.15.42:0/850772540 shutdown_connections 2024-09-16T01:55:37.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259c385f40 1 -- 172.21.15.42:0/850772540 >> 172.21.15.42:0/850772540 conn(0x5602aaf509e0 msgr2=0x5602aaf4f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:37.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259c385f40 1 -- 172.21.15.42:0/850772540 shutdown_connections 2024-09-16T01:55:37.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:37.957+0000 7f259c385f40 1 -- 172.21.15.42:0/850772540 wait complete. 2024-09-16T01:55:37.966 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-09-16T01:55:38.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.009+0000 7fe4d5958f40 1 Processor -- start 2024-09-16T01:55:38.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.009+0000 7fe4d5958f40 1 -- start start 2024-09-16T01:55:38.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d5958f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x556247519770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d5958f40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5562475c1130 0x5562475b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d5958f40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5562475b6fb0 0x556247533a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d5958f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5562475316f0 con 0x556247531a10 2024-09-16T01:55:38.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d5958f40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55624743b510 con 0x5562475c1130 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d5958f40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5562474ec0d0 con 0x5562475b6fb0 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d344e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x556247519770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d344e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x556247519770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36814/0 (socket says 172.21.15.42:36814) 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d344e640 1 -- 172.21.15.42:0/289748 learned_addr learned my addr 172.21.15.42:0/289748 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d3c4f640 1 --2- 172.21.15.42:0/289748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5562475b6fb0 0x556247533a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d2c4d640 1 --2- 172.21.15.42:0/289748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5562475c1130 0x5562475b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d344e640 1 -- 172.21.15.42:0/289748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5562475b6fb0 msgr2=0x556247533a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d344e640 1 --2- 172.21.15.42:0/289748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5562475b6fb0 0x556247533a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d344e640 1 -- 172.21.15.42:0/289748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5562475c1130 msgr2=0x5562475b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d344e640 1 --2- 172.21.15.42:0/289748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5562475c1130 0x5562475b6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d344e640 1 -- 172.21.15.42:0/289748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562475aef00 con 0x556247531a10 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.010+0000 7fe4d344e640 1 --2- 172.21.15.42:0/289748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x556247519770 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4001620 tx=0x7fe4c4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71439d4dd70c1ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d1c4b640 1 -- 172.21.15.42:0/289748 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4017070 con 0x556247531a10 2024-09-16T01:55:38.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d1c4b640 1 -- 172.21.15.42:0/289748 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c400f730 con 0x556247531a10 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d1c4b640 1 -- 172.21.15.42:0/289748 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400fb20 con 0x556247531a10 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d5958f40 1 -- 172.21.15.42:0/289748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 msgr2=0x556247519770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d5958f40 1 --2- 172.21.15.42:0/289748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x556247519770 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4001620 tx=0x7fe4c4001ae0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d5958f40 1 -- 172.21.15.42:0/289748 shutdown_connections 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d5958f40 1 --2- 172.21.15.42:0/289748 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5562475b6fb0 0x556247533a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d5958f40 1 --2- 172.21.15.42:0/289748 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5562475c1130 0x5562475b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d5958f40 1 --2- 172.21.15.42:0/289748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x556247519770 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d5958f40 1 -- 172.21.15.42:0/289748 >> 172.21.15.42:0/289748 conn(0x5562474e99e0 msgr2=0x556247518d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d5958f40 1 -- 172.21.15.42:0/289748 shutdown_connections 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.011+0000 7fe4d5958f40 1 -- 172.21.15.42:0/289748 wait complete. 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.012+0000 7fe4d5958f40 1 Processor -- start 2024-09-16T01:55:38.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.012+0000 7fe4d5958f40 1 -- start start 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.012+0000 7fe4d5958f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x5562475ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.012+0000 7fe4d5958f40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5562475c1130 0x55624759fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.012+0000 7fe4d5958f40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5562475adf90 0x55624752f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.012+0000 7fe4d5958f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5562475af1e0 con 0x556247531a10 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.012+0000 7fe4d5958f40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5562475bef00 con 0x5562475adf90 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.012+0000 7fe4d5958f40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x5562475be8b0 con 0x5562475c1130 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d344e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x5562475ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d344e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x5562475ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36830/0 (socket says 172.21.15.42:36830) 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d344e640 1 -- 172.21.15.42:0/1240535837 learned_addr learned my addr 172.21.15.42:0/1240535837 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d2c4d640 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5562475c1130 0x55624759fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d3c4f640 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5562475adf90 0x55624752f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d344e640 1 -- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5562475c1130 msgr2=0x55624759fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d344e640 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x5562475c1130 0x55624759fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d344e640 1 -- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5562475adf90 msgr2=0x55624752f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d344e640 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5562475adf90 0x55624752f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d344e640 1 -- 172.21.15.42:0/1240535837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562475190f0 con 0x556247531a10 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d344e640 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x5562475ae4c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4001fe0 tx=0x7fe4c4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d0c49640 1 -- 172.21.15.42:0/1240535837 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4022030 con 0x556247531a10 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d0c49640 1 -- 172.21.15.42:0/1240535837 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c4006020 con 0x556247531a10 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d0c49640 1 -- 172.21.15.42:0/1240535837 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4017030 con 0x556247531a10 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d5958f40 1 -- 172.21.15.42:0/1240535837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562475c1760 con 0x556247531a10 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.013+0000 7fe4d5958f40 1 -- 172.21.15.42:0/1240535837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556247514c00 con 0x556247531a10 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.015+0000 7fe4d0c49640 1 -- 172.21.15.42:0/1240535837 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe4c4025070 con 0x556247531a10 2024-09-16T01:55:38.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.015+0000 7fe4d0c49640 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe4b406acc0 0x7fe4b406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.015+0000 7fe4d0c49640 1 -- 172.21.15.42:0/1240535837 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe4c408ac20 con 0x556247531a10 2024-09-16T01:55:38.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.015+0000 7fe4d2c4d640 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe4b406acc0 0x7fe4b406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.015+0000 7fe4d5958f40 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x5562475c0550 0x5562475bc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.015+0000 7fe4d5958f40 1 -- 172.21.15.42:0/1240535837 --> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x5562475bc870 con 0x5562475c0550 2024-09-16T01:55:38.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d3c4f640 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x5562475c0550 0x5562475bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d2c4d640 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe4b406acc0 0x7fe4b406d180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc057000 tx=0x7fe4bc05e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d3c4f640 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x5562475c0550 0x5562475bc330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d3c4f640 1 -- 172.21.15.42:0/1240535837 <== osd.5 v2:172.21.15.107:6816/188494589 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fe4cc0099e0 con 0x5562475c0550 2024-09-16T01:55:38.021 INFO:teuthology.orchestra.run.smithi042.stdout:mytag 2024-09-16T01:55:38.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d5958f40 1 -- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x5562475c0550 msgr2=0x5562475bc330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d5958f40 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x5562475c0550 0x5562475bc330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d5958f40 1 -- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe4b406acc0 msgr2=0x7fe4b406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d5958f40 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe4b406acc0 0x7fe4b406d180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc057000 tx=0x7fe4bc05e040 comp rx=0 tx=0).stop 2024-09-16T01:55:38.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d5958f40 1 -- 172.21.15.42:0/1240535837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 msgr2=0x5562475ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d5958f40 1 --2- 172.21.15.42:0/1240535837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556247531a10 0x5562475ae4c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4001fe0 tx=0x7fe4c4000f40 comp rx=0 tx=0).stop 2024-09-16T01:55:38.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d3c4f640 1 -- 172.21.15.42:0/1240535837 reap_dead start 2024-09-16T01:55:38.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d5958f40 1 -- 172.21.15.42:0/1240535837 shutdown_connections 2024-09-16T01:55:38.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d5958f40 1 -- 172.21.15.42:0/1240535837 >> 172.21.15.42:0/1240535837 conn(0x5562474e99e0 msgr2=0x5562474e9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:38.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.016+0000 7fe4d5958f40 1 -- 172.21.15.42:0/1240535837 shutdown_connections 2024-09-16T01:55:38.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.017+0000 7fe4d5958f40 1 -- 172.21.15.42:0/1240535837 wait complete. 2024-09-16T01:55:38.024 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-09-16T01:55:38.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.068+0000 7f8f9d0e3f40 1 Processor -- start 2024-09-16T01:55:38.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.068+0000 7f8f9d0e3f40 1 -- start start 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.068+0000 7f8f9d0e3f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56e77180 0x559b56f4c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.068+0000 7f8f9d0e3f40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b56ea5050 0x559b56f446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.068+0000 7f8f9d0e3f40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b56f2f080 0x559b56fde6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.068+0000 7f8f9d0e3f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b56e73ae0 con 0x559b56e77180 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.068+0000 7f8f9d0e3f40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559b56dc6510 con 0x559b56f2f080 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.068+0000 7f8f9d0e3f40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x559b56e73dc0 con 0x559b56ea5050 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.068+0000 7f8f9abd9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56e77180 0x559b56f4c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f9abd9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56e77180 0x559b56f4c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36838/0 (socket says 172.21.15.42:36838) 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f9a3d8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b56ea5050 0x559b56f446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f9abd9640 1 -- 172.21.15.42:0/999677168 learned_addr learned my addr 172.21.15.42:0/999677168 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:38.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f9b3da640 1 --2- 172.21.15.42:0/999677168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b56f2f080 0x559b56fde6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f9abd9640 1 -- 172.21.15.42:0/999677168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b56ea5050 msgr2=0x559b56f446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f9abd9640 1 --2- 172.21.15.42:0/999677168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b56ea5050 0x559b56f446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f9abd9640 1 -- 172.21.15.42:0/999677168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b56f2f080 msgr2=0x559b56fde6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f9abd9640 1 --2- 172.21.15.42:0/999677168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b56f2f080 0x559b56fde6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f9abd9640 1 -- 172.21.15.42:0/999677168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b56ebb750 con 0x559b56e77180 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f9abd9640 1 --2- 172.21.15.42:0/999677168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56e77180 0x559b56f4c6f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009780 tx=0x7f8f8c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2308520d6417f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f993d6640 1 -- 172.21.15.42:0/999677168 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c008870 con 0x559b56e77180 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f993d6640 1 -- 172.21.15.42:0/999677168 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8c018070 con 0x559b56e77180 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.069+0000 7f8f993d6640 1 -- 172.21.15.42:0/999677168 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c008c30 con 0x559b56e77180 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/999677168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56e77180 msgr2=0x559b56f4c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 --2- 172.21.15.42:0/999677168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56e77180 0x559b56f4c6f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009780 tx=0x7f8f8c005a00 comp rx=0 tx=0).stop 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/999677168 shutdown_connections 2024-09-16T01:55:38.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 --2- 172.21.15.42:0/999677168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b56f2f080 0x559b56fde6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 --2- 172.21.15.42:0/999677168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b56ea5050 0x559b56f446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 --2- 172.21.15.42:0/999677168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56e77180 0x559b56f4c6f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/999677168 >> 172.21.15.42:0/999677168 conn(0x559b56e749e0 msgr2=0x559b56ebe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/999677168 shutdown_connections 2024-09-16T01:55:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/999677168 wait complete. 2024-09-16T01:55:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 Processor -- start 2024-09-16T01:55:38.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.070+0000 7f8f9d0e3f40 1 -- start start 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9d0e3f40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b56e77180 0x559b56f4c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9d0e3f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56ea5050 0x559b56f2bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9d0e3f40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b56f2f080 0x559b56f2c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9d0e3f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559b56e76eb0 con 0x559b56ea5050 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9d0e3f40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559b56e75380 con 0x559b56e77180 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9d0e3f40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x559b56f4f040 con 0x559b56f2f080 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9a3d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56ea5050 0x559b56f2bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9a3d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56ea5050 0x559b56f2bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36850/0 (socket says 172.21.15.42:36850) 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9a3d8640 1 -- 172.21.15.42:0/3998728457 learned_addr learned my addr 172.21.15.42:0/3998728457 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9b3da640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b56f2f080 0x559b56f2c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.071+0000 7f8f9abd9640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b56e77180 0x559b56f4c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f9a3d8640 1 -- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b56f2f080 msgr2=0x559b56f2c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f9a3d8640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b56f2f080 0x559b56f2c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f9a3d8640 1 -- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b56e77180 msgr2=0x559b56f4c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f9a3d8640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559b56e77180 0x559b56f4c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f9a3d8640 1 -- 172.21.15.42:0/3998728457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b56fe3a10 con 0x559b56ea5050 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f9b3da640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x559b56f2f080 0x559b56f2c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f9a3d8640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56ea5050 0x559b56f2bef0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f90046050 tx=0x7f8f90002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f83fff640 1 -- 172.21.15.42:0/3998728457 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90055070 con 0x559b56ea5050 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f83fff640 1 -- 172.21.15.42:0/3998728457 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f900518b0 con 0x559b56ea5050 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/3998728457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b56fe3c80 con 0x559b56ea5050 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f83fff640 1 -- 172.21.15.42:0/3998728457 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90051ca0 con 0x559b56ea5050 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.072+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/3998728457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b56fe4240 con 0x559b56ea5050 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.073+0000 7f8f83fff640 1 -- 172.21.15.42:0/3998728457 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8f90058070 con 0x559b56ea5050 2024-09-16T01:55:38.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.074+0000 7f8f83fff640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8f8806ac90 0x7f8f8806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.074+0000 7f8f83fff640 1 -- 172.21.15.42:0/3998728457 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f8f900cde40 con 0x559b56ea5050 2024-09-16T01:55:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.074+0000 7f8f9d0e3f40 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x559b56f4acd0 0x559b56fe4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.074+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/3998728457 --> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x559b56fe5490 con 0x559b56f4acd0 2024-09-16T01:55:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.074+0000 7f8f9abd9640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8f8806ac90 0x7f8f8806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.074+0000 7f8f9b3da640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x559b56f4acd0 0x559b56fe4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9abd9640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8f8806ac90 0x7f8f8806d150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c015040 tx=0x7f8f8c012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9b3da640 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x559b56f4acd0 0x559b56fe4f50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9b3da640 1 -- 172.21.15.42:0/3998728457 <== osd.7 v2:172.21.15.107:6800/1756026323 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f8f94002700 con 0x559b56f4acd0 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x559b56f4acd0 msgr2=0x559b56fe4f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9d0e3f40 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x559b56f4acd0 0x559b56fe4f50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8f8806ac90 msgr2=0x7f8f8806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9d0e3f40 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8f8806ac90 0x7f8f8806d150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c015040 tx=0x7f8f8c012000 comp rx=0 tx=0).stop 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/3998728457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56ea5050 msgr2=0x559b56f2bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9d0e3f40 1 --2- 172.21.15.42:0/3998728457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559b56ea5050 0x559b56f2bef0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f90046050 tx=0x7f8f90002fb0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9b3da640 1 -- 172.21.15.42:0/3998728457 reap_dead start 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/3998728457 shutdown_connections 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/3998728457 >> 172.21.15.42:0/3998728457 conn(0x559b56e749e0 msgr2=0x559b56ebe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/3998728457 shutdown_connections 2024-09-16T01:55:38.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.075+0000 7f8f9d0e3f40 1 -- 172.21.15.42:0/3998728457 wait complete. 2024-09-16T01:55:38.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:55:38.083 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:55:38.083 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:55:38.130 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:55:38.172 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:55:38.172 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:55:38.172 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:55:38.172 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:38.189 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=159 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:55:38.189 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:55:38.189 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:55:38.189 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:38.231 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:55:38.231 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:55:38.231 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:55:38.232 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:38.248 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=159 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:55:38.248 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:55:38.248 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:55:38.248 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:38.290 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:55:38.290 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:38.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.392+0000 7f88109bd640 1 Processor -- start 2024-09-16T01:55:38.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.392+0000 7f88109bd640 1 -- start start 2024-09-16T01:55:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.393+0000 7f88109bd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f880c15e740 0x7f880c0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.393+0000 7f88109bd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f880c09b690 0x7f880c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.393+0000 7f88109bd640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f880c0d0780 con 0x7f880c06d4c0 2024-09-16T01:55:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.393+0000 7f88109bd640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f880c15eb20 con 0x7f880c09b690 2024-09-16T01:55:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.393+0000 7f88109bd640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f880c06d260 con 0x7f880c15e740 2024-09-16T01:55:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.393+0000 7f8809d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f880c09b690 0x7f880c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.393+0000 7f880ad9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f880c06d4c0 0x7f880c06d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:48998/0 (socket says 172.21.15.42:48998) 2024-09-16T01:55:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.393+0000 7f8809d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f880c09b690 0x7f880c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36854/0 (socket says 172.21.15.42:36854) 2024-09-16T01:55:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.393+0000 7f880ad9d640 1 -- 172.21.15.42:0/61321782 learned_addr learned my addr 172.21.15.42:0/61321782 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.394+0000 7f8809d9b640 1 -- 172.21.15.42:0/61321782 >> v2:172.21.15.107:3300/0 conn(0x7f880c15e740 msgr2=0x7f880c0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:38.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.394+0000 7f8809d9b640 1 --2- 172.21.15.42:0/61321782 >> v2:172.21.15.107:3300/0 conn(0x7f880c15e740 0x7f880c0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.394+0000 7f8809d9b640 1 -- 172.21.15.42:0/61321782 >> v1:172.21.15.42:6789/0 conn(0x7f880c06d4c0 legacy=0x7f880c06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.394+0000 7f8809d9b640 1 -- 172.21.15.42:0/61321782 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c0d0a60 con 0x7f880c09b690 2024-09-16T01:55:38.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.394+0000 7f8809d9b640 1 --2- 172.21.15.42:0/61321782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c09b690 0x7f880c06cd20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f880c074070 tx=0x7f880002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558768f103d906fe server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.394+0000 7f880959a640 1 -- 172.21.15.42:0/61321782 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800037070 con 0x7f880c09b690 2024-09-16T01:55:38.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.395+0000 7f880959a640 1 -- 172.21.15.42:0/61321782 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8800032440 con 0x7f880c09b690 2024-09-16T01:55:38.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.395+0000 7f880959a640 1 -- 172.21.15.42:0/61321782 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800032810 con 0x7f880c09b690 2024-09-16T01:55:38.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.395+0000 7f88109bd640 1 -- 172.21.15.42:0/61321782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c09b690 msgr2=0x7f880c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.395+0000 7f88109bd640 1 --2- 172.21.15.42:0/61321782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c09b690 0x7f880c06cd20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f880c074070 tx=0x7f880002a230 comp rx=0 tx=0).stop 2024-09-16T01:55:38.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.395+0000 7f88109bd640 1 -- 172.21.15.42:0/61321782 shutdown_connections 2024-09-16T01:55:38.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.395+0000 7f88109bd640 1 --2- 172.21.15.42:0/61321782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c09b690 0x7f880c06cd20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.395+0000 7f88109bd640 1 --2- 172.21.15.42:0/61321782 >> v2:172.21.15.107:3300/0 conn(0x7f880c15e740 0x7f880c0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.395+0000 7f88109bd640 1 -- 172.21.15.42:0/61321782 >> 172.21.15.42:0/61321782 conn(0x7f880c0d23a0 msgr2=0x7f880c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:38.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.395+0000 7f88109bd640 1 -- 172.21.15.42:0/61321782 shutdown_connections 2024-09-16T01:55:38.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.395+0000 7f88109bd640 1 -- 172.21.15.42:0/61321782 wait complete. 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.396+0000 7f88109bd640 1 Processor -- start 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.397+0000 7f88109bd640 1 -- start start 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.397+0000 7f88109bd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f880c06d4c0 0x7f880c0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.397+0000 7f88109bd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f880c09b690 0x7f880c0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.397+0000 7f88109bd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c15e740 0x7f880c071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.397+0000 7f88109bd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f880c09bac0 con 0x7f880c15e740 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.397+0000 7f88109bd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f880c0d1020 con 0x7f880c09b690 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.397+0000 7f88109bd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f880c06dfe0 con 0x7f880c06d4c0 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.397+0000 7f880ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c15e740 0x7f880c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.397+0000 7f880ad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c15e740 0x7f880c071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36864/0 (socket says 172.21.15.42:36864) 2024-09-16T01:55:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.397+0000 7f880ad9d640 1 -- 172.21.15.42:0/2817609489 learned_addr learned my addr 172.21.15.42:0/2817609489 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f8809d9b640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f880c09b690 0x7f880c0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f880a59c640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f880c06d4c0 0x7f880c0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f880ad9d640 1 -- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f880c06d4c0 msgr2=0x7f880c0b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f880ad9d640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f880c06d4c0 0x7f880c0b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f880ad9d640 1 -- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f880c09b690 msgr2=0x7f880c0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f880ad9d640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f880c09b690 0x7f880c0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f880ad9d640 1 -- 172.21.15.42:0/2817609489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c15ba30 con 0x7f880c15e740 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f880a59c640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f880c06d4c0 0x7f880c0b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f880ad9d640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c15e740 0x7f880c071420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f880400c3a0 tx=0x7f880400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f87faffd640 1 -- 172.21.15.42:0/2817609489 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8804017070 con 0x7f880c15e740 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f87faffd640 1 -- 172.21.15.42:0/2817609489 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8804005ce0 con 0x7f880c15e740 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f88109bd640 1 -- 172.21.15.42:0/2817609489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880c0c95a0 con 0x7f880c15e740 2024-09-16T01:55:38.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f87faffd640 1 -- 172.21.15.42:0/2817609489 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040072d0 con 0x7f880c15e740 2024-09-16T01:55:38.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.398+0000 7f88109bd640 1 -- 172.21.15.42:0/2817609489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f880c0c9b60 con 0x7f880c15e740 2024-09-16T01:55:38.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.399+0000 7f88109bd640 1 -- 172.21.15.42:0/2817609489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f880c06cd20 con 0x7f880c15e740 2024-09-16T01:55:38.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.400+0000 7f87faffd640 1 -- 172.21.15.42:0/2817609489 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f880401a070 con 0x7f880c15e740 2024-09-16T01:55:38.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.400+0000 7f87faffd640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87ec06c2b0 0x7f87ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.400+0000 7f87faffd640 1 -- 172.21.15.42:0/2817609489 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f880408a740 con 0x7f880c15e740 2024-09-16T01:55:38.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.400+0000 7f880a59c640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87ec06c2b0 0x7f87ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.401+0000 7f880a59c640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87ec06c2b0 0x7f87ec06e770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f87fc007eb0 tx=0x7f87fc0073c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.404+0000 7f87faffd640 1 -- 172.21.15.42:0/2817609489 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8804058760 con 0x7f880c15e740 2024-09-16T01:55:38.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.620+0000 7f88109bd640 1 -- 172.21.15.42:0/2817609489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f880c0d1cb0 con 0x7f880c15e740 2024-09-16T01:55:38.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.621+0000 7f87faffd640 1 -- 172.21.15.42:0/2817609489 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f880405ca60 con 0x7f880c15e740 2024-09-16T01:55:38.622 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:38.622 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"btime":"2024-09-16T01:55:17:061679+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/920871952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":920871952},{"type":"v1","addr":"172.21.15.42:6835","nonce":920871952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2239532612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2239532612},{"type":"v1","addr":"172.21.15.42:6833","nonce":2239532612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/663599658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":663599658},{"type":"v1","addr":"172.21.15.107:6836","nonce":663599658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:14.411116+0000","modified":"2024-09-16T01:55:16.402868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34562":{"gid":34562,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3744211154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3744211154},{"type":"v1","addr":"172.21.15.107:6837","nonce":3744211154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34562,"qdb_cluster":[34562]},"id":2}]} 2024-09-16T01:55:38.623 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-09-16T01:55:38.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 -- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87ec06c2b0 msgr2=0x7f87ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87ec06c2b0 0x7f87ec06e770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f87fc007eb0 tx=0x7f87fc0073c0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 -- 172.21.15.42:0/2817609489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c15e740 msgr2=0x7f880c071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c15e740 0x7f880c071420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f880400c3a0 tx=0x7f880400c860 comp rx=0 tx=0).stop 2024-09-16T01:55:38.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 -- 172.21.15.42:0/2817609489 shutdown_connections 2024-09-16T01:55:38.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f87ec06c2b0 0x7f87ec06e770 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f880c15e740 0x7f880c071420 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f880c09b690 0x7f880c0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 --2- 172.21.15.42:0/2817609489 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f880c06d4c0 0x7f880c0b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 -- 172.21.15.42:0/2817609489 >> 172.21.15.42:0/2817609489 conn(0x7f880c0d23a0 msgr2=0x7f880c0b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:38.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 -- 172.21.15.42:0/2817609489 shutdown_connections 2024-09-16T01:55:38.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.623+0000 7f88109bd640 1 -- 172.21.15.42:0/2817609489 wait complete. 2024-09-16T01:55:38.635 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:38.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.736+0000 7f50ab4f1640 1 Processor -- start 2024-09-16T01:55:38.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.736+0000 7f50ab4f1640 1 -- start start 2024-09-16T01:55:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.737+0000 7f50ab4f1640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f50a40b69d0 0x7f50a4162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.737+0000 7f50ab4f1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a40af280 0x7f50a40afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.737+0000 7f50ab4f1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a415eb60 con 0x7f50a40affb0 2024-09-16T01:55:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.737+0000 7f50ab4f1640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f50a40b6db0 con 0x7f50a40b69d0 2024-09-16T01:55:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.737+0000 7f50ab4f1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f50a415ee40 con 0x7f50a40af280 2024-09-16T01:55:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.737+0000 7f50a928d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f50a40b69d0 0x7f50a4162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.737+0000 7f50a928d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f50a40b69d0 0x7f50a4162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36868/0 (socket says 172.21.15.42:36868) 2024-09-16T01:55:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.737+0000 7f50a928d640 1 -- 172.21.15.42:0/2083071106 learned_addr learned my addr 172.21.15.42:0/2083071106 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.738+0000 7f50a928d640 1 -- 172.21.15.42:0/2083071106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a40af280 msgr2=0x7f50a40afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.738+0000 7f50a8a8c640 1 --2- 172.21.15.42:0/2083071106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a40af280 0x7f50a40afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.738+0000 7f50a928d640 1 --2- 172.21.15.42:0/2083071106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a40af280 0x7f50a40afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.738+0000 7f50a928d640 1 -- 172.21.15.42:0/2083071106 >> v1:172.21.15.107:6789/0 conn(0x7f50a40affb0 legacy=0x7f50a4154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.738+0000 7f50a928d640 1 -- 172.21.15.42:0/2083071106 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a415f120 con 0x7f50a40b69d0 2024-09-16T01:55:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.738+0000 7f50a928d640 1 --2- 172.21.15.42:0/2083071106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40b69d0 0x7f50a4162a50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f509c0098a0 tx=0x7f509c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e489d29c16a071a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50a3fff640 1 -- 172.21.15.42:0/2083071106 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c037070 con 0x7f50a40b69d0 2024-09-16T01:55:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50a3fff640 1 -- 172.21.15.42:0/2083071106 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509c02ae20 con 0x7f50a40b69d0 2024-09-16T01:55:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50a3fff640 1 -- 172.21.15.42:0/2083071106 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c032660 con 0x7f50a40b69d0 2024-09-16T01:55:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50ab4f1640 1 -- 172.21.15.42:0/2083071106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40b69d0 msgr2=0x7f50a4162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50ab4f1640 1 --2- 172.21.15.42:0/2083071106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40b69d0 0x7f50a4162a50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f509c0098a0 tx=0x7f509c02a110 comp rx=0 tx=0).stop 2024-09-16T01:55:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50ab4f1640 1 -- 172.21.15.42:0/2083071106 shutdown_connections 2024-09-16T01:55:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50ab4f1640 1 --2- 172.21.15.42:0/2083071106 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a40af280 0x7f50a40afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50ab4f1640 1 --2- 172.21.15.42:0/2083071106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40b69d0 0x7f50a4162a50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50ab4f1640 1 -- 172.21.15.42:0/2083071106 >> 172.21.15.42:0/2083071106 conn(0x7f50a406bc10 msgr2=0x7f50a406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50ab4f1640 1 -- 172.21.15.42:0/2083071106 shutdown_connections 2024-09-16T01:55:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.739+0000 7f50ab4f1640 1 -- 172.21.15.42:0/2083071106 wait complete. 2024-09-16T01:55:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.740+0000 7f50ab4f1640 1 Processor -- start 2024-09-16T01:55:38.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.740+0000 7f50ab4f1640 1 -- start start 2024-09-16T01:55:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50ab4f1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a40af280 0x7f50a4160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50ab4f1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40affb0 0x7f50a4152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50ab4f1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a40b69d0 0x7f50a4159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50ab4f1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50a4155410 con 0x7f50a40affb0 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50ab4f1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f50a40af6e0 con 0x7f50a40af280 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50ab4f1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f50a4155590 con 0x7f50a40b69d0 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50a8a8c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40affb0 0x7f50a4152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50a8a8c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40affb0 0x7f50a4152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36870/0 (socket says 172.21.15.42:36870) 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50a8a8c640 1 -- 172.21.15.42:0/1488385631 learned_addr learned my addr 172.21.15.42:0/1488385631 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50a928d640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a40af280 0x7f50a4160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.741+0000 7f50a9a8e640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a40b69d0 0x7f50a4159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50a8a8c640 1 -- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a40b69d0 msgr2=0x7f50a4159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50a8a8c640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a40b69d0 0x7f50a4159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50a8a8c640 1 -- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a40af280 msgr2=0x7f50a4160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50a8a8c640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a40af280 0x7f50a4160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50a8a8c640 1 -- 172.21.15.42:0/1488385631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a41608e0 con 0x7f50a40affb0 2024-09-16T01:55:38.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50a928d640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a40af280 0x7f50a4160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50a8a8c640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40affb0 0x7f50a4152970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f509800c7f0 tx=0x7f509800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50a1ffb640 1 -- 172.21.15.42:0/1488385631 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098015070 con 0x7f50a40affb0 2024-09-16T01:55:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50a1ffb640 1 -- 172.21.15.42:0/1488385631 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5098004240 con 0x7f50a40affb0 2024-09-16T01:55:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50ab4f1640 1 -- 172.21.15.42:0/1488385631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a415d500 con 0x7f50a40affb0 2024-09-16T01:55:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50a1ffb640 1 -- 172.21.15.42:0/1488385631 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098007620 con 0x7f50a40affb0 2024-09-16T01:55:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.742+0000 7f50ab4f1640 1 -- 172.21.15.42:0/1488385631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a415dfa0 con 0x7f50a40affb0 2024-09-16T01:55:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.743+0000 7f50ab4f1640 1 -- 172.21.15.42:0/1488385631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a40d09a0 con 0x7f50a40affb0 2024-09-16T01:55:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.744+0000 7f50a1ffb640 1 -- 172.21.15.42:0/1488385631 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f50980079d0 con 0x7f50a40affb0 2024-09-16T01:55:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.744+0000 7f50a1ffb640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f509006c2b0 0x7f509006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:38.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.744+0000 7f50a1ffb640 1 -- 172.21.15.42:0/1488385631 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f509808b630 con 0x7f50a40affb0 2024-09-16T01:55:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.744+0000 7f50a928d640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f509006c2b0 0x7f509006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:38.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.745+0000 7f50a928d640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f509006c2b0 0x7f509006e770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f509c034000 tx=0x7f509c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:38.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.748+0000 7f50a1ffb640 1 -- 172.21.15.42:0/1488385631 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5098059ca0 con 0x7f50a40affb0 2024-09-16T01:55:38.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.957+0000 7f50ab4f1640 1 -- 172.21.15.42:0/1488385631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50a406e8e0 con 0x7f50a40affb0 2024-09-16T01:55:38.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.958+0000 7f50a1ffb640 1 -- 172.21.15.42:0/1488385631 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f50980595a0 con 0x7f50a40affb0 2024-09-16T01:55:38.961 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:38.961 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"btime":"2024-09-16T01:55:17:061679+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/920871952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":920871952},{"type":"v1","addr":"172.21.15.42:6835","nonce":920871952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2239532612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2239532612},{"type":"v1","addr":"172.21.15.42:6833","nonce":2239532612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/663599658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":663599658},{"type":"v1","addr":"172.21.15.107:6836","nonce":663599658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:14.411116+0000","modified":"2024-09-16T01:55:16.402868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34562":{"gid":34562,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3744211154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3744211154},{"type":"v1","addr":"172.21.15.107:6837","nonce":3744211154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34562,"qdb_cluster":[34562]},"id":2}]} 2024-09-16T01:55:38.962 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-09-16T01:55:38.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 -- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f509006c2b0 msgr2=0x7f509006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f509006c2b0 0x7f509006e770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f509c034000 tx=0x7f509c02e000 comp rx=0 tx=0).stop 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 -- 172.21.15.42:0/1488385631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40affb0 msgr2=0x7f50a4152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40affb0 0x7f50a4152970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f509800c7f0 tx=0x7f509800ccb0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 -- 172.21.15.42:0/1488385631 shutdown_connections 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f509006c2b0 0x7f509006e770 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f50a40b69d0 0x7f50a4159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50a40affb0 0x7f50a4152970 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 --2- 172.21.15.42:0/1488385631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50a40af280 0x7f50a4160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 -- 172.21.15.42:0/1488385631 >> 172.21.15.42:0/1488385631 conn(0x7f50a406bc10 msgr2=0x7f50a41544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 -- 172.21.15.42:0/1488385631 shutdown_connections 2024-09-16T01:55:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:38.960+0000 7f50ab4f1640 1 -- 172.21.15.42:0/1488385631 wait complete. 2024-09-16T01:55:38.972 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:55:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.075+0000 7f775912a640 1 Processor -- start 2024-09-16T01:55:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.075+0000 7f775912a640 1 -- start start 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f775912a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7754161c80 0x7f775406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f775912a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77540b6680 0x7f77540cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f775912a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775406e870 con 0x7f7754162060 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f775912a640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f775406d9f0 con 0x7f7754161c80 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f775912a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f775406dcd0 con 0x7f77540b6680 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f7752d9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7754161c80 0x7f775406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f7752d9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7754161c80 0x7f775406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36884/0 (socket says 172.21.15.42:36884) 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f7752d9d640 1 -- 172.21.15.42:0/1245899297 learned_addr learned my addr 172.21.15.42:0/1245899297 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f775359e640 1 --2- 172.21.15.42:0/1245899297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77540b6680 0x7f77540cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f7752d9d640 1 -- 172.21.15.42:0/1245899297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77540b6680 msgr2=0x7f77540cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f7752d9d640 1 --2- 172.21.15.42:0/1245899297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77540b6680 0x7f77540cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f7752d9d640 1 -- 172.21.15.42:0/1245899297 >> v1:172.21.15.107:6789/0 conn(0x7f7754162060 legacy=0x7f77540b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.076+0000 7f7752d9d640 1 -- 172.21.15.42:0/1245899297 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775406dfb0 con 0x7f7754161c80 2024-09-16T01:55:39.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.077+0000 7f7752d9d640 1 --2- 172.21.15.42:0/1245899297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 0x7f775406e330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7744009870 tx=0x7f774402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244d66f31a0ec3c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:39.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.077+0000 7f7751d9b640 1 -- 172.21.15.42:0/1245899297 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744037070 con 0x7f7754161c80 2024-09-16T01:55:39.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.077+0000 7f7751d9b640 1 -- 172.21.15.42:0/1245899297 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744032440 con 0x7f7754161c80 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.077+0000 7f7751d9b640 1 -- 172.21.15.42:0/1245899297 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744032810 con 0x7f7754161c80 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.078+0000 7f775912a640 1 -- 172.21.15.42:0/1245899297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 msgr2=0x7f775406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.078+0000 7f775912a640 1 --2- 172.21.15.42:0/1245899297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 0x7f775406e330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7744009870 tx=0x7f774402a270 comp rx=0 tx=0).stop 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.078+0000 7f775912a640 1 -- 172.21.15.42:0/1245899297 shutdown_connections 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.078+0000 7f775912a640 1 --2- 172.21.15.42:0/1245899297 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77540b6680 0x7f77540cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.078+0000 7f775912a640 1 --2- 172.21.15.42:0/1245899297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 0x7f775406e330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.078+0000 7f775912a640 1 -- 172.21.15.42:0/1245899297 >> 172.21.15.42:0/1245899297 conn(0x7f77540d44f0 msgr2=0x7f77540d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.078+0000 7f775912a640 1 -- 172.21.15.42:0/1245899297 shutdown_connections 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.078+0000 7f775912a640 1 -- 172.21.15.42:0/1245899297 wait complete. 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.079+0000 7f775912a640 1 Processor -- start 2024-09-16T01:55:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.079+0000 7f775912a640 1 -- start start 2024-09-16T01:55:39.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775912a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77540b6680 0x7f77541566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775912a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 0x7f77541605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775912a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7754162060 0x7f77540b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775912a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77540b6cb0 con 0x7f7754161c80 2024-09-16T01:55:39.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775912a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f77540b6b30 con 0x7f7754162060 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775912a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f77540cf720 con 0x7f77540b6680 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 0x7f77541605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 0x7f77541605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36886/0 (socket says 172.21.15.42:36886) 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775259c640 1 -- 172.21.15.42:0/2622162907 learned_addr learned my addr 172.21.15.42:0/2622162907 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f7752d9d640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77540b6680 0x7f77541566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775359e640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7754162060 0x7f77540b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775259c640 1 -- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77540b6680 msgr2=0x7f77541566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775259c640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77540b6680 0x7f77541566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775259c640 1 -- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7754162060 msgr2=0x7f77540b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775259c640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7754162060 0x7f77540b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.080+0000 7f775259c640 1 -- 172.21.15.42:0/2622162907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7754156c30 con 0x7f7754161c80 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.081+0000 7f775259c640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 0x7f77541605d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f774800c440 tx=0x7f774800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.081+0000 7f773b7fe640 1 -- 172.21.15.42:0/2622162907 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77480052d0 con 0x7f7754161c80 2024-09-16T01:55:39.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.081+0000 7f773b7fe640 1 -- 172.21.15.42:0/2622162907 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7748005470 con 0x7f7754161c80 2024-09-16T01:55:39.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.081+0000 7f775912a640 1 -- 172.21.15.42:0/2622162907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77540cc390 con 0x7f7754161c80 2024-09-16T01:55:39.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.081+0000 7f773b7fe640 1 -- 172.21.15.42:0/2622162907 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748007260 con 0x7f7754161c80 2024-09-16T01:55:39.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.081+0000 7f775912a640 1 -- 172.21.15.42:0/2622162907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77540cc950 con 0x7f7754161c80 2024-09-16T01:55:39.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.082+0000 7f775912a640 1 -- 172.21.15.42:0/2622162907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77540d4290 con 0x7f7754161c80 2024-09-16T01:55:39.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.082+0000 7f773b7fe640 1 -- 172.21.15.42:0/2622162907 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7748007400 con 0x7f7754161c80 2024-09-16T01:55:39.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.083+0000 7f773b7fe640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f774006c2b0 0x7f774006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.083+0000 7f773b7fe640 1 -- 172.21.15.42:0/2622162907 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f774808aab0 con 0x7f7754161c80 2024-09-16T01:55:39.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.083+0000 7f7752d9d640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f774006c2b0 0x7f774006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.083+0000 7f7752d9d640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f774006c2b0 0x7f774006e770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7744034000 tx=0x7f774402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:39.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.087+0000 7f773b7fe640 1 -- 172.21.15.42:0/2622162907 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f775406e870 con 0x7f7754161c80 2024-09-16T01:55:39.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.263+0000 7f775912a640 1 -- 172.21.15.42:0/2622162907 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7754161430 con 0x7f7754161c80 2024-09-16T01:55:39.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.265+0000 7f773b7fe640 1 -- 172.21.15.42:0/2622162907 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16990 (secure 0 0 0) 0x7f7748058910 con 0x7f7754161c80 2024-09-16T01:55:39.266 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:39.266 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":38,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:16.056518+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:55:12.311183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-16T01:55:13.394907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:55:39.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.266+0000 7f775912a640 1 -- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f774006c2b0 msgr2=0x7f774006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.266+0000 7f775912a640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f774006c2b0 0x7f774006e770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7744034000 tx=0x7f774402e000 comp rx=0 tx=0).stop 2024-09-16T01:55:39.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.266+0000 7f775912a640 1 -- 172.21.15.42:0/2622162907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 msgr2=0x7f77541605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.266+0000 7f775912a640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 0x7f77541605d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f774800c440 tx=0x7f774800c900 comp rx=0 tx=0).stop 2024-09-16T01:55:39.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.267+0000 7f775912a640 1 -- 172.21.15.42:0/2622162907 shutdown_connections 2024-09-16T01:55:39.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.267+0000 7f775912a640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f774006c2b0 0x7f774006e770 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.267+0000 7f775912a640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7754162060 0x7f77540b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.267+0000 7f775912a640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7754161c80 0x7f77541605d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.267+0000 7f775912a640 1 --2- 172.21.15.42:0/2622162907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77540b6680 0x7f77541566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.267+0000 7f775912a640 1 -- 172.21.15.42:0/2622162907 >> 172.21.15.42:0/2622162907 conn(0x7f77540d44f0 msgr2=0x7f7754162490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:39.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.267+0000 7f775912a640 1 -- 172.21.15.42:0/2622162907 shutdown_connections 2024-09-16T01:55:39.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.267+0000 7f775912a640 1 -- 172.21.15.42:0/2622162907 wait complete. 2024-09-16T01:55:39.280 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:55:39.280 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:39.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.381+0000 7f2690fb7640 1 Processor -- start 2024-09-16T01:55:39.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.381+0000 7f2690fb7640 1 -- start start 2024-09-16T01:55:39.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.382+0000 7f2690fb7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f268c162060 0x7f268c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.382+0000 7f2690fb7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f268c0b64b0 0x7f268c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.382+0000 7f2690fb7640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268c06d9f0 con 0x7f268c161c80 2024-09-16T01:55:39.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.382+0000 7f2690fb7640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f268c06dcd0 con 0x7f268c162060 2024-09-16T01:55:39.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.382+0000 7f2690fb7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f268c06dfb0 con 0x7f268c0b64b0 2024-09-16T01:55:39.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.382+0000 7f268a59c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f268c161c80 0x7f268c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49008/0 (socket says 172.21.15.42:49008) 2024-09-16T01:55:39.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.382+0000 7f2689d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f268c162060 0x7f268c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.382+0000 7f268a59c640 1 -- 172.21.15.42:0/1788301453 learned_addr learned my addr 172.21.15.42:0/1788301453 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:39.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.383+0000 7f2689d9b640 1 -- 172.21.15.42:0/1788301453 >> v2:172.21.15.107:3300/0 conn(0x7f268c0b64b0 msgr2=0x7f268c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:39.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.383+0000 7f2689d9b640 1 --2- 172.21.15.42:0/1788301453 >> v2:172.21.15.107:3300/0 conn(0x7f268c0b64b0 0x7f268c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.383+0000 7f2689d9b640 1 -- 172.21.15.42:0/1788301453 >> v1:172.21.15.42:6789/0 conn(0x7f268c161c80 legacy=0x7f268c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.383+0000 7f268959a640 1 -- 172.21.15.42:0/1788301453 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470204036 0 0) 0x7f268c06d9f0 con 0x7f268c161c80 2024-09-16T01:55:39.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.383+0000 7f2689d9b640 1 -- 172.21.15.42:0/1788301453 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c0d01f0 con 0x7f268c162060 2024-09-16T01:55:39.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.383+0000 7f2689d9b640 1 --2- 172.21.15.42:0/1788301453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c162060 0x7f268c0b5f70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f268c08d750 tx=0x7f267402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1667234b40e02ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:39.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f268959a640 1 -- 172.21.15.42:0/1788301453 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674037070 con 0x7f268c162060 2024-09-16T01:55:39.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f268959a640 1 -- 172.21.15.42:0/1788301453 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2674032440 con 0x7f268c162060 2024-09-16T01:55:39.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f268959a640 1 -- 172.21.15.42:0/1788301453 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674032810 con 0x7f268c162060 2024-09-16T01:55:39.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f2690fb7640 1 -- 172.21.15.42:0/1788301453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c162060 msgr2=0x7f268c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f2690fb7640 1 --2- 172.21.15.42:0/1788301453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c162060 0x7f268c0b5f70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f268c08d750 tx=0x7f267402a1a0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f2690fb7640 1 -- 172.21.15.42:0/1788301453 shutdown_connections 2024-09-16T01:55:39.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f2690fb7640 1 --2- 172.21.15.42:0/1788301453 >> v2:172.21.15.107:3300/0 conn(0x7f268c0b64b0 0x7f268c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f2690fb7640 1 --2- 172.21.15.42:0/1788301453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c162060 0x7f268c0b5f70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f2690fb7640 1 -- 172.21.15.42:0/1788301453 >> 172.21.15.42:0/1788301453 conn(0x7f268c0d44f0 msgr2=0x7f268c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:39.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f2690fb7640 1 -- 172.21.15.42:0/1788301453 shutdown_connections 2024-09-16T01:55:39.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.384+0000 7f2690fb7640 1 -- 172.21.15.42:0/1788301453 wait complete. 2024-09-16T01:55:39.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.385+0000 7f2690fb7640 1 Processor -- start 2024-09-16T01:55:39.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f2690fb7640 1 -- start start 2024-09-16T01:55:39.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f2690fb7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268c0b64b0 0x7f268c158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f2690fb7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c161c80 0x7f268c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f2690fb7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f268c162060 0x7f268c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f2690fb7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0cf1e0 con 0x7f268c161c80 2024-09-16T01:55:39.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f2690fb7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0d2aa0 con 0x7f268c0b64b0 2024-09-16T01:55:39.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f2690fb7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f268c0cf360 con 0x7f268c162060 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f2689d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c161c80 0x7f268c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f2689d9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c161c80 0x7f268c15a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36908/0 (socket says 172.21.15.42:36908) 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f2689d9b640 1 -- 172.21.15.42:0/519328636 learned_addr learned my addr 172.21.15.42:0/519328636 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f268a59c640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268c0b64b0 0x7f268c158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.386+0000 7f268ad9d640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f268c162060 0x7f268c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2689d9b640 1 -- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f268c162060 msgr2=0x7f268c0b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2689d9b640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f268c162060 0x7f268c0b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2689d9b640 1 -- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268c0b64b0 msgr2=0x7f268c158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2689d9b640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268c0b64b0 0x7f268c158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2689d9b640 1 -- 172.21.15.42:0/519328636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c0b9520 con 0x7f268c161c80 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f268a59c640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268c0b64b0 0x7f268c158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2689d9b640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c161c80 0x7f268c15a520 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2674000c00 tx=0x7f26740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:39.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2682ffd640 1 -- 172.21.15.42:0/519328636 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674037040 con 0x7f268c161c80 2024-09-16T01:55:39.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2682ffd640 1 -- 172.21.15.42:0/519328636 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2674042070 con 0x7f268c161c80 2024-09-16T01:55:39.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2690fb7640 1 -- 172.21.15.42:0/519328636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268c0c8ae0 con 0x7f268c161c80 2024-09-16T01:55:39.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2682ffd640 1 -- 172.21.15.42:0/519328636 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674030bd0 con 0x7f268c161c80 2024-09-16T01:55:39.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.387+0000 7f2690fb7640 1 -- 172.21.15.42:0/519328636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268c1590a0 con 0x7f268c161c80 2024-09-16T01:55:39.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.388+0000 7f2690fb7640 1 -- 172.21.15.42:0/519328636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f268c0b5f70 con 0x7f268c161c80 2024-09-16T01:55:39.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.389+0000 7f2682ffd640 1 -- 172.21.15.42:0/519328636 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2674047460 con 0x7f268c161c80 2024-09-16T01:55:39.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.389+0000 7f2682ffd640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f266c06c2e0 0x7f266c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.389+0000 7f2682ffd640 1 -- 172.21.15.42:0/519328636 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f26740ac100 con 0x7f268c161c80 2024-09-16T01:55:39.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.390+0000 7f268a59c640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f266c06c2e0 0x7f266c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.390+0000 7f268a59c640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f266c06c2e0 0x7f266c06e7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2684000f60 tx=0x7f2684007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:39.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.394+0000 7f2682ffd640 1 -- 172.21.15.42:0/519328636 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2674032e20 con 0x7f268c161c80 2024-09-16T01:55:39.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.605+0000 7f2690fb7640 1 -- 172.21.15.42:0/519328636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f268c074cc0 con 0x7f268c161c80 2024-09-16T01:55:39.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.605+0000 7f2682ffd640 1 -- 172.21.15.42:0/519328636 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f267407a770 con 0x7f268c161c80 2024-09-16T01:55:39.607 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:39.607 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"btime":"2024-09-16T01:55:17:061679+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/920871952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":920871952},{"type":"v1","addr":"172.21.15.42:6835","nonce":920871952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2239532612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2239532612},{"type":"v1","addr":"172.21.15.42:6833","nonce":2239532612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/663599658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":663599658},{"type":"v1","addr":"172.21.15.107:6836","nonce":663599658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:14.411116+0000","modified":"2024-09-16T01:55:16.402868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34562":{"gid":34562,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3744211154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3744211154},{"type":"v1","addr":"172.21.15.107:6837","nonce":3744211154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34562,"qdb_cluster":[34562]},"id":2}]} 2024-09-16T01:55:39.607 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-09-16T01:55:39.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 -- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f266c06c2e0 msgr2=0x7f266c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f266c06c2e0 0x7f266c06e7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2684000f60 tx=0x7f2684007c10 comp rx=0 tx=0).stop 2024-09-16T01:55:39.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 -- 172.21.15.42:0/519328636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c161c80 msgr2=0x7f268c15a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c161c80 0x7f268c15a520 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2674000c00 tx=0x7f26740046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 -- 172.21.15.42:0/519328636 shutdown_connections 2024-09-16T01:55:39.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f266c06c2e0 0x7f266c06e7a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f268c162060 0x7f268c0b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f268c161c80 0x7f268c15a520 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 --2- 172.21.15.42:0/519328636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f268c0b64b0 0x7f268c158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 -- 172.21.15.42:0/519328636 >> 172.21.15.42:0/519328636 conn(0x7f268c0d44f0 msgr2=0x7f268c0b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:39.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 -- 172.21.15.42:0/519328636 shutdown_connections 2024-09-16T01:55:39.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.607+0000 7f2690fb7640 1 -- 172.21.15.42:0/519328636 wait complete. 2024-09-16T01:55:39.620 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:39.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.720+0000 7f64374a6640 1 Processor -- start 2024-09-16T01:55:39.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.720+0000 7f64374a6640 1 -- start start 2024-09-16T01:55:39.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f64374a6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6430072700 0x7f643015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f64374a6640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6430146140 con 0x7f6430072320 2024-09-16T01:55:39.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f64374a6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64300cd740 con 0x7f6430072de0 2024-09-16T01:55:39.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f64374a6640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f64300cda20 con 0x7f6430072700 2024-09-16T01:55:39.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f6435242640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6430072320 0x7f64300cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49016/0 (socket says 172.21.15.42:49016) 2024-09-16T01:55:39.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f6435242640 1 -- 172.21.15.42:0/2816281667 learned_addr learned my addr 172.21.15.42:0/2816281667 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:39.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f6435a43640 1 --2- 172.21.15.42:0/2816281667 >> v2:172.21.15.42:3300/0 conn(0x7f6430072700 0x7f643015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f6427fff640 1 -- 172.21.15.42:0/2816281667 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672266701 0 0) 0x7f6430146140 con 0x7f6430072320 2024-09-16T01:55:39.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f6427fff640 1 -- 172.21.15.42:0/2816281667 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f641c003520 con 0x7f6430072320 2024-09-16T01:55:39.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f6435a43640 1 -- 172.21.15.42:0/2816281667 >> v1:172.21.15.107:6789/0 conn(0x7f6430072de0 legacy=0x7f643015d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f6435a43640 1 -- 172.21.15.42:0/2816281667 >> v1:172.21.15.42:6789/0 conn(0x7f6430072320 legacy=0x7f64300cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.721+0000 7f6435a43640 1 -- 172.21.15.42:0/2816281667 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64300cdd00 con 0x7f6430072700 2024-09-16T01:55:39.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.722+0000 7f6435a43640 1 --2- 172.21.15.42:0/2816281667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072700 0x7f643015d8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6428009d90 tx=0x7f642802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454a0734e9174058 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:39.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.722+0000 7f6427fff640 1 -- 172.21.15.42:0/2816281667 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428007740 con 0x7f6430072700 2024-09-16T01:55:39.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.722+0000 7f6427fff640 1 -- 172.21.15.42:0/2816281667 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280078e0 con 0x7f6430072700 2024-09-16T01:55:39.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.722+0000 7f6427fff640 1 -- 172.21.15.42:0/2816281667 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428007c90 con 0x7f6430072700 2024-09-16T01:55:39.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.723+0000 7f64374a6640 1 -- 172.21.15.42:0/2816281667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072700 msgr2=0x7f643015d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.723+0000 7f64374a6640 1 --2- 172.21.15.42:0/2816281667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072700 0x7f643015d8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6428009d90 tx=0x7f642802a660 comp rx=0 tx=0).stop 2024-09-16T01:55:39.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.723+0000 7f64374a6640 1 -- 172.21.15.42:0/2816281667 shutdown_connections 2024-09-16T01:55:39.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.723+0000 7f64374a6640 1 --2- 172.21.15.42:0/2816281667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072700 0x7f643015d8f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.723+0000 7f64374a6640 1 -- 172.21.15.42:0/2816281667 >> 172.21.15.42:0/2816281667 conn(0x7f6430067d70 msgr2=0x7f643006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:39.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.723+0000 7f64374a6640 1 -- 172.21.15.42:0/2816281667 shutdown_connections 2024-09-16T01:55:39.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.723+0000 7f64374a6640 1 -- 172.21.15.42:0/2816281667 wait complete. 2024-09-16T01:55:39.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.724+0000 7f64374a6640 1 Processor -- start 2024-09-16T01:55:39.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.724+0000 7f64374a6640 1 -- start start 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f64374a6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072320 0x7f64301e76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f64374a6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6430072700 0x7f64300cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f64374a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6430072de0 0x7f64300cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f64374a6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f643015dfb0 con 0x7f6430072320 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f64374a6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f643015de30 con 0x7f6430072de0 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f64374a6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f643015e130 con 0x7f6430072700 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6435242640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072320 0x7f64301e76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6435242640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072320 0x7f64301e76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36930/0 (socket says 172.21.15.42:36930) 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6435242640 1 -- 172.21.15.42:0/3928707639 learned_addr learned my addr 172.21.15.42:0/3928707639 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6434a41640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6430072700 0x7f64300cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6435a43640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6430072de0 0x7f64300cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6435242640 1 -- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6430072700 msgr2=0x7f64300cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6435242640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6430072700 0x7f64300cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6435242640 1 -- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6430072de0 msgr2=0x7f64300cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6435242640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6430072de0 0x7f64300cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6435242640 1 -- 172.21.15.42:0/3928707639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643012ff00 con 0x7f6430072320 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.725+0000 7f6435242640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072320 0x7f64301e76c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f642c00c500 tx=0x7f642c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.726+0000 7f6425ffb640 1 -- 172.21.15.42:0/3928707639 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c017070 con 0x7f6430072320 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.726+0000 7f6425ffb640 1 -- 172.21.15.42:0/3928707639 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642c005ce0 con 0x7f6430072320 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.726+0000 7f6425ffb640 1 -- 172.21.15.42:0/3928707639 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c007330 con 0x7f6430072320 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.726+0000 7f64374a6640 1 -- 172.21.15.42:0/3928707639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64301301e0 con 0x7f6430072320 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.726+0000 7f64374a6640 1 -- 172.21.15.42:0/3928707639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64301307a0 con 0x7f6430072320 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.727+0000 7f64374a6640 1 -- 172.21.15.42:0/3928707639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64300cce60 con 0x7f6430072320 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.727+0000 7f6425ffb640 1 -- 172.21.15.42:0/3928707639 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f642c01a070 con 0x7f6430072320 2024-09-16T01:55:39.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.728+0000 7f6425ffb640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f641406c2b0 0x7f641406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:39.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.728+0000 7f6425ffb640 1 -- 172.21.15.42:0/3928707639 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f642c08a9d0 con 0x7f6430072320 2024-09-16T01:55:39.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.728+0000 7f6434a41640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f641406c2b0 0x7f641406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:39.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.728+0000 7f6434a41640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f641406c2b0 0x7f641406e770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f64200016e0 tx=0x7f6420009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.732+0000 7f6425ffb640 1 -- 172.21.15.42:0/3928707639 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f642c058a10 con 0x7f6430072320 2024-09-16T01:55:39.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.942+0000 7f64374a6640 1 -- 172.21.15.42:0/3928707639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f643006bf90 con 0x7f6430072320 2024-09-16T01:55:39.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.942+0000 7f6425ffb640 1 -- 172.21.15.42:0/3928707639 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f642c05cd10 con 0x7f6430072320 2024-09-16T01:55:39.944 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:39.944 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"btime":"2024-09-16T01:55:17:061679+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/920871952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":920871952},{"type":"v1","addr":"172.21.15.42:6835","nonce":920871952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2239532612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2239532612},{"type":"v1","addr":"172.21.15.42:6833","nonce":2239532612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":34559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/663599658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":663599658},{"type":"v1","addr":"172.21.15.107:6836","nonce":663599658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:14.411116+0000","modified":"2024-09-16T01:55:16.402868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34562":{"gid":34562,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.107:6837/3744211154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":3744211154},{"type":"v1","addr":"172.21.15.107:6837","nonce":3744211154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34562,"qdb_cluster":[34562]},"id":2}]} 2024-09-16T01:55:39.944 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-09-16T01:55:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 -- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f641406c2b0 msgr2=0x7f641406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f641406c2b0 0x7f641406e770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f64200016e0 tx=0x7f6420009040 comp rx=0 tx=0).stop 2024-09-16T01:55:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 -- 172.21.15.42:0/3928707639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072320 msgr2=0x7f64301e76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072320 0x7f64301e76c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f642c00c500 tx=0x7f642c00c9c0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 -- 172.21.15.42:0/3928707639 shutdown_connections 2024-09-16T01:55:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f641406c2b0 0x7f641406e770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6430072de0 0x7f64300cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6430072700 0x7f64300cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 --2- 172.21.15.42:0/3928707639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6430072320 0x7f64301e76c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 -- 172.21.15.42:0/3928707639 >> 172.21.15.42:0/3928707639 conn(0x7f6430067d70 msgr2=0x7f643015d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 -- 172.21.15.42:0/3928707639 shutdown_connections 2024-09-16T01:55:39.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:39.944+0000 7f64374a6640 1 -- 172.21.15.42:0/3928707639 wait complete. 2024-09-16T01:55:39.957 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:55:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.058+0000 7f5592f31640 1 Processor -- start 2024-09-16T01:55:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.059+0000 7f5592f31640 1 -- start start 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.059+0000 7f5592f31640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f558c09b140 0x7f558c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.059+0000 7f5592f31640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f558c09ba30 con 0x7f558c15fc30 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.059+0000 7f5592f31640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f558c09bcf0 con 0x7f558c0b17d0 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.059+0000 7f5592f31640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f558c0b1590 con 0x7f558c09b140 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.059+0000 7f5590ccd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f558c15fc30 0x7f558c09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49024/0 (socket says 172.21.15.42:49024) 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.059+0000 7f5590ccd640 1 -- 172.21.15.42:0/3239401344 learned_addr learned my addr 172.21.15.42:0/3239401344 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558bfff640 1 --2- 172.21.15.42:0/3239401344 >> v2:172.21.15.107:3300/0 conn(0x7f558c09b140 0x7f558c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802437769 0 0) 0x7f558c09ba30 con 0x7f558c15fc30 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5574003520 con 0x7f558c15fc30 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1069611867 0 0) 0x7f5574003520 con 0x7f558c15fc30 2024-09-16T01:55:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 >> v2:172.21.15.107:3300/0 conn(0x7f558c09b140 msgr2=0x7f558c071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 --2- 172.21.15.42:0/3239401344 >> v2:172.21.15.107:3300/0 conn(0x7f558c09b140 0x7f558c071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 >> v1:172.21.15.107:6789/0 conn(0x7f558c0b17d0 legacy=0x7f558c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558c160d00 con 0x7f558c15fc30 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f55840019f0 con 0x7f558c15fc30 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 >> v1:172.21.15.42:6789/0 conn(0x7f558c15fc30 legacy=0x7f558c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55740039b0 0x7f5574003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5574004800 0x7f5574004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f557400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f558c0b1590 con 0x7f55740051c0 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f557400c160 con 0x7f5574004800 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f557400c360 con 0x7f55740039b0 2024-09-16T01:55:40.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f55914ce640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f557400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f5590ccd640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55740039b0 0x7f5574003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.060+0000 7f558bfff640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5574004800 0x7f5574004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.061+0000 7f55914ce640 1 -- 172.21.15.42:0/3239401344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55740039b0 msgr2=0x7f5574003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.061+0000 7f55914ce640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f55740039b0 0x7f5574003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.061+0000 7f55914ce640 1 -- 172.21.15.42:0/3239401344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5574004800 msgr2=0x7f5574004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.061+0000 7f55914ce640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5574004800 0x7f5574004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.061+0000 7f55914ce640 1 -- 172.21.15.42:0/3239401344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5574003520 con 0x7f55740051c0 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.061+0000 7f55914ce640 1 -- 172.21.15.42:0/3239401344 reap_dead start 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.061+0000 7f55914ce640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f557400b9c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f557c001750 tx=0x7f5574005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2932e620f47a1619 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.061+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c001370 con 0x7f55740051c0 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.061+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557c005310 con 0x7f55740051c0 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.061+0000 7f558b7fe640 1 -- 172.21.15.42:0/3239401344 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c02abe0 con 0x7f55740051c0 2024-09-16T01:55:40.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.062+0000 7f5592f31640 1 -- 172.21.15.42:0/3239401344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 msgr2=0x7f557400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.062+0000 7f5592f31640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f557400b9c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f557c001750 tx=0x7f5574005830 comp rx=0 tx=0).stop 2024-09-16T01:55:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.062+0000 7f5592f31640 1 -- 172.21.15.42:0/3239401344 shutdown_connections 2024-09-16T01:55:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.062+0000 7f5592f31640 1 --2- 172.21.15.42:0/3239401344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f557400b9c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.062+0000 7f5592f31640 1 -- 172.21.15.42:0/3239401344 >> 172.21.15.42:0/3239401344 conn(0x7f558c0d23a0 msgr2=0x7f558c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.062+0000 7f5592f31640 1 -- 172.21.15.42:0/3239401344 shutdown_connections 2024-09-16T01:55:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.062+0000 7f5592f31640 1 -- 172.21.15.42:0/3239401344 wait complete. 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.063+0000 7f5592f31640 1 Processor -- start 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.063+0000 7f5592f31640 1 -- start start 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f5592f31640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f558c0c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f5592f31640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558c1f63e0 0x7f558c152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f5592f31640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f558c0d0260 0x7f558c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f5592f31640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f558c0721d0 con 0x7f55740051c0 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f5592f31640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f558c072050 con 0x7f558c0d0260 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f5592f31640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f558c160ab0 con 0x7f558c1f63e0 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f5590ccd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f558c0c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f5590ccd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f558c0c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36944/0 (socket says 172.21.15.42:36944) 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f5590ccd640 1 -- 172.21.15.42:0/1494842848 learned_addr learned my addr 172.21.15.42:0/1494842848 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f558bfff640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558c1f63e0 0x7f558c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.064+0000 7f55914ce640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f558c0d0260 0x7f558c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f5590ccd640 1 -- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558c1f63e0 msgr2=0x7f558c152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f5590ccd640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558c1f63e0 0x7f558c152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f5590ccd640 1 -- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f558c0d0260 msgr2=0x7f558c15ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f5590ccd640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f558c0d0260 0x7f558c15ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f5590ccd640 1 -- 172.21.15.42:0/1494842848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558c0ce6f0 con 0x7f55740051c0 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f5590ccd640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f558c0c7380 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f55840079d0 tx=0x7f558400a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f55897fa640 1 -- 172.21.15.42:0/1494842848 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584007ac0 con 0x7f55740051c0 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f55897fa640 1 -- 172.21.15.42:0/1494842848 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5584018070 con 0x7f55740051c0 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f55897fa640 1 -- 172.21.15.42:0/1494842848 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584013610 con 0x7f55740051c0 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f5592f31640 1 -- 172.21.15.42:0/1494842848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558c0d0b60 con 0x7f55740051c0 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.065+0000 7f5592f31640 1 -- 172.21.15.42:0/1494842848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f558c0d1120 con 0x7f55740051c0 2024-09-16T01:55:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.066+0000 7f5592f31640 1 -- 172.21.15.42:0/1494842848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f558c0d2780 con 0x7f55740051c0 2024-09-16T01:55:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.067+0000 7f55897fa640 1 -- 172.21.15.42:0/1494842848 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f55840137b0 con 0x7f55740051c0 2024-09-16T01:55:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.067+0000 7f55897fa640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f557806c450 0x7f557806e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.067+0000 7f55897fa640 1 -- 172.21.15.42:0/1494842848 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f558408bcf0 con 0x7f55740051c0 2024-09-16T01:55:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.067+0000 7f558bfff640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f557806c450 0x7f557806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.068+0000 7f558bfff640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f557806c450 0x7f557806e910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f558c0c90e0 tx=0x7f5580009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.071+0000 7f55897fa640 1 -- 172.21.15.42:0/1494842848 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f558c0d2780 con 0x7f55740051c0 2024-09-16T01:55:40.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.247+0000 7f5592f31640 1 -- 172.21.15.42:0/1494842848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f558c0ce8c0 con 0x7f55740051c0 2024-09-16T01:55:40.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.249+0000 7f55897fa640 1 -- 172.21.15.42:0/1494842848 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16990 (secure 0 0 0) 0x7f5584090070 con 0x7f55740051c0 2024-09-16T01:55:40.250 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:40.251 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":38,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:16.056518+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:55:12.311183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-16T01:55:13.394907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:55:40.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.250+0000 7f5592f31640 1 -- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f557806c450 msgr2=0x7f557806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.250+0000 7f5592f31640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f557806c450 0x7f557806e910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f558c0c90e0 tx=0x7f5580009190 comp rx=0 tx=0).stop 2024-09-16T01:55:40.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.250+0000 7f5592f31640 1 -- 172.21.15.42:0/1494842848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 msgr2=0x7f558c0c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.250+0000 7f5592f31640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f558c0c7380 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f55840079d0 tx=0x7f558400a730 comp rx=0 tx=0).stop 2024-09-16T01:55:40.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.251+0000 7f5592f31640 1 -- 172.21.15.42:0/1494842848 shutdown_connections 2024-09-16T01:55:40.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.251+0000 7f5592f31640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f557806c450 0x7f557806e910 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.251+0000 7f5592f31640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f558c0d0260 0x7f558c15ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.251+0000 7f5592f31640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f558c1f63e0 0x7f558c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.251+0000 7f5592f31640 1 --2- 172.21.15.42:0/1494842848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55740051c0 0x7f558c0c7380 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.251+0000 7f5592f31640 1 -- 172.21.15.42:0/1494842848 >> 172.21.15.42:0/1494842848 conn(0x7f558c0d23a0 msgr2=0x7f558c0af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:40.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.251+0000 7f5592f31640 1 -- 172.21.15.42:0/1494842848 shutdown_connections 2024-09-16T01:55:40.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.251+0000 7f5592f31640 1 -- 172.21.15.42:0/1494842848 wait complete. 2024-09-16T01:55:40.264 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:55:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.366+0000 7fe55361e640 1 Processor -- start 2024-09-16T01:55:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.366+0000 7fe55361e640 1 -- start start 2024-09-16T01:55:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe55361e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe54c072de0 0x7fe54c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe55361e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072700 0x7fe54c15d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe55361e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe54c146140 con 0x7fe54c072320 2024-09-16T01:55:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe55361e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe54c0cd740 con 0x7fe54c072de0 2024-09-16T01:55:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe55361e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe54c0cda20 con 0x7fe54c072700 2024-09-16T01:55:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe550bb9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe54c072de0 0x7fe54c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe5513ba640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe54c072320 0x7fe54c0cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49034/0 (socket says 172.21.15.42:49034) 2024-09-16T01:55:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe550bb9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe54c072de0 0x7fe54c15d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36946/0 (socket says 172.21.15.42:36946) 2024-09-16T01:55:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe5513ba640 1 -- 172.21.15.42:0/4006022151 learned_addr learned my addr 172.21.15.42:0/4006022151 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe551bbb640 1 --2- 172.21.15.42:0/4006022151 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072700 0x7fe54c15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe550bb9640 1 -- 172.21.15.42:0/4006022151 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072700 msgr2=0x7fe54c15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe550bb9640 1 --2- 172.21.15.42:0/4006022151 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072700 0x7fe54c15d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe550bb9640 1 -- 172.21.15.42:0/4006022151 >> v1:172.21.15.42:6789/0 conn(0x7fe54c072320 legacy=0x7fe54c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe543fff640 1 -- 172.21.15.42:0/4006022151 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2684617299 0 0) 0x7fe54c146140 con 0x7fe54c072320 2024-09-16T01:55:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe550bb9640 1 -- 172.21.15.42:0/4006022151 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c0cdd00 con 0x7fe54c072de0 2024-09-16T01:55:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.367+0000 7fe551bbb640 1 --2- 172.21.15.42:0/4006022151 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072700 0x7fe54c15d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.368+0000 7fe550bb9640 1 --2- 172.21.15.42:0/4006022151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072de0 0x7fe54c15d1e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0097a0 tx=0x7fe53c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6e42fab02889a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.368+0000 7fe543fff640 1 -- 172.21.15.42:0/4006022151 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c037070 con 0x7fe54c072de0 2024-09-16T01:55:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.368+0000 7fe543fff640 1 -- 172.21.15.42:0/4006022151 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53c02ae50 con 0x7fe54c072de0 2024-09-16T01:55:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.368+0000 7fe543fff640 1 -- 172.21.15.42:0/4006022151 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c032660 con 0x7fe54c072de0 2024-09-16T01:55:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.369+0000 7fe55361e640 1 -- 172.21.15.42:0/4006022151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072de0 msgr2=0x7fe54c15d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.369+0000 7fe55361e640 1 --2- 172.21.15.42:0/4006022151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072de0 0x7fe54c15d1e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0097a0 tx=0x7fe53c02a100 comp rx=0 tx=0).stop 2024-09-16T01:55:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.369+0000 7fe55361e640 1 -- 172.21.15.42:0/4006022151 shutdown_connections 2024-09-16T01:55:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.369+0000 7fe55361e640 1 --2- 172.21.15.42:0/4006022151 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072700 0x7fe54c15d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.369+0000 7fe55361e640 1 --2- 172.21.15.42:0/4006022151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072de0 0x7fe54c15d1e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.369+0000 7fe55361e640 1 -- 172.21.15.42:0/4006022151 >> 172.21.15.42:0/4006022151 conn(0x7fe54c067d70 msgr2=0x7fe54c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.369+0000 7fe55361e640 1 -- 172.21.15.42:0/4006022151 shutdown_connections 2024-09-16T01:55:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.369+0000 7fe55361e640 1 -- 172.21.15.42:0/4006022151 wait complete. 2024-09-16T01:55:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.370+0000 7fe55361e640 1 Processor -- start 2024-09-16T01:55:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.370+0000 7fe55361e640 1 -- start start 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe55361e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe54c072320 0x7fe54c0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe55361e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072700 0x7fe54c15b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe55361e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072de0 0x7fe54c1f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe55361e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c15dde0 con 0x7fe54c072700 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe55361e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c15dc60 con 0x7fe54c072320 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe55361e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe54c15df60 con 0x7fe54c072de0 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe550bb9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072700 0x7fe54c15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe550bb9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072700 0x7fe54c15b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36962/0 (socket says 172.21.15.42:36962) 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe550bb9640 1 -- 172.21.15.42:0/1321957455 learned_addr learned my addr 172.21.15.42:0/1321957455 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe551bbb640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072de0 0x7fe54c1f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe5513ba640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe54c072320 0x7fe54c0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe550bb9640 1 -- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072de0 msgr2=0x7fe54c1f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe550bb9640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072de0 0x7fe54c1f53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe550bb9640 1 -- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe54c072320 msgr2=0x7fe54c0cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe550bb9640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe54c072320 0x7fe54c0cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe550bb9640 1 -- 172.21.15.42:0/1321957455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c0cc4e0 con 0x7fe54c072700 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.371+0000 7fe550bb9640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072700 0x7fe54c15b820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe53c035040 tx=0x7fe53c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.372+0000 7fe541ffb640 1 -- 172.21.15.42:0/1321957455 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c041070 con 0x7fe54c072700 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.372+0000 7fe541ffb640 1 -- 172.21.15.42:0/1321957455 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53c03c670 con 0x7fe54c072700 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.372+0000 7fe55361e640 1 -- 172.21.15.42:0/1321957455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54c0c93f0 con 0x7fe54c072700 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.372+0000 7fe541ffb640 1 -- 172.21.15.42:0/1321957455 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c037040 con 0x7fe54c072700 2024-09-16T01:55:40.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.372+0000 7fe55361e640 1 -- 172.21.15.42:0/1321957455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54c0c99b0 con 0x7fe54c072700 2024-09-16T01:55:40.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.373+0000 7fe55361e640 1 -- 172.21.15.42:0/1321957455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe54c15e370 con 0x7fe54c072700 2024-09-16T01:55:40.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.373+0000 7fe541ffb640 1 -- 172.21.15.42:0/1321957455 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe53c03a070 con 0x7fe54c072700 2024-09-16T01:55:40.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.374+0000 7fe541ffb640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe53006c2b0 0x7fe53006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.374+0000 7fe541ffb640 1 -- 172.21.15.42:0/1321957455 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe53c0ab970 con 0x7fe54c072700 2024-09-16T01:55:40.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.374+0000 7fe5513ba640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe53006c2b0 0x7fe53006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.375+0000 7fe5513ba640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe53006c2b0 0x7fe53006e770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe548007fd0 tx=0x7fe548009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:40.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.378+0000 7fe541ffb640 1 -- 172.21.15.42:0/1321957455 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe54c0cc4e0 con 0x7fe54c072700 2024-09-16T01:55:40.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.589+0000 7fe55361e640 1 -- 172.21.15.42:0/1321957455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe54c1e3710 con 0x7fe54c072700 2024-09-16T01:55:40.591 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-16T01:55:40.590+0000 7fafb4c25640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:55:40.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.591+0000 7fe541ffb640 1 -- 172.21.15.42:0/1321957455 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7fe53c079f50 con 0x7fe54c072700 2024-09-16T01:55:40.593 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:55:40.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 -- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe53006c2b0 msgr2=0x7fe53006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe53006c2b0 0x7fe53006e770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe548007fd0 tx=0x7fe548009040 comp rx=0 tx=0).stop 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 -- 172.21.15.42:0/1321957455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072700 msgr2=0x7fe54c15b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072700 0x7fe54c15b820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe53c035040 tx=0x7fe53c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 -- 172.21.15.42:0/1321957455 shutdown_connections 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe53006c2b0 0x7fe53006e770 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe54c072de0 0x7fe54c1f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c072700 0x7fe54c15b820 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 --2- 172.21.15.42:0/1321957455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe54c072320 0x7fe54c0cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 -- 172.21.15.42:0/1321957455 >> 172.21.15.42:0/1321957455 conn(0x7fe54c067d70 msgr2=0x7fe54c0c5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 -- 172.21.15.42:0/1321957455 shutdown_connections 2024-09-16T01:55:40.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.594+0000 7fe55361e640 1 -- 172.21.15.42:0/1321957455 wait complete. 2024-09-16T01:55:40.600 INFO:tasks.ceph.mds.b.smithi107.stderr: -6533> 2024-09-16T01:55:20.037+0000 7fa4306de640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:55:40.610 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:55:40.634 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-09-16T01:55:40.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.713+0000 7fde4daa5640 1 Processor -- start 2024-09-16T01:55:40.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.713+0000 7fde4daa5640 1 -- start start 2024-09-16T01:55:40.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde4daa5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480d5100 0x7fde480cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde4daa5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fde481621b0 0x7fde48162640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde4daa5640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde480d3a60 con 0x7fde4815e640 2024-09-16T01:55:40.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde4daa5640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fde480cec40 con 0x7fde481621b0 2024-09-16T01:55:40.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde4daa5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde480cef20 con 0x7fde480d5100 2024-09-16T01:55:40.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde47fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fde481621b0 0x7fde48162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde47fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fde481621b0 0x7fde48162640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36976/0 (socket says 172.21.15.42:36976) 2024-09-16T01:55:40.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde477fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fde4815e640 0x7fde480d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49046/0 (socket says 172.21.15.42:49046) 2024-09-16T01:55:40.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde47fff640 1 -- 172.21.15.42:0/3899773301 learned_addr learned my addr 172.21.15.42:0/3899773301 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde47fff640 1 -- 172.21.15.42:0/3899773301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480d5100 msgr2=0x7fde480cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde46ffd640 1 --2- 172.21.15.42:0/3899773301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480d5100 0x7fde480cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde467fc640 1 -- 172.21.15.42:0/3899773301 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002247697 0 0) 0x7fde480d3a60 con 0x7fde4815e640 2024-09-16T01:55:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde47fff640 1 --2- 172.21.15.42:0/3899773301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480d5100 0x7fde480cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde47fff640 1 -- 172.21.15.42:0/3899773301 >> v1:172.21.15.42:6789/0 conn(0x7fde4815e640 legacy=0x7fde480d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde47fff640 1 -- 172.21.15.42:0/3899773301 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde480cf200 con 0x7fde481621b0 2024-09-16T01:55:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.714+0000 7fde46ffd640 1 --2- 172.21.15.42:0/3899773301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480d5100 0x7fde480cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.715+0000 7fde47fff640 1 --2- 172.21.15.42:0/3899773301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde481621b0 0x7fde48162640 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fde40009e50 tx=0x7fde4002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ffeace912559a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.715+0000 7fde467fc640 1 -- 172.21.15.42:0/3899773301 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40036070 con 0x7fde481621b0 2024-09-16T01:55:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.715+0000 7fde467fc640 1 -- 172.21.15.42:0/3899773301 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde40031600 con 0x7fde481621b0 2024-09-16T01:55:40.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.715+0000 7fde467fc640 1 -- 172.21.15.42:0/3899773301 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde400319d0 con 0x7fde481621b0 2024-09-16T01:55:40.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.716+0000 7fde4daa5640 1 -- 172.21.15.42:0/3899773301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde481621b0 msgr2=0x7fde48162640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.716+0000 7fde4daa5640 1 --2- 172.21.15.42:0/3899773301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde481621b0 0x7fde48162640 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fde40009e50 tx=0x7fde4002a7a0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.716+0000 7fde4daa5640 1 -- 172.21.15.42:0/3899773301 shutdown_connections 2024-09-16T01:55:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.716+0000 7fde4daa5640 1 --2- 172.21.15.42:0/3899773301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde481621b0 0x7fde48162640 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.716+0000 7fde4daa5640 1 --2- 172.21.15.42:0/3899773301 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde480d5100 0x7fde480cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.716+0000 7fde4daa5640 1 -- 172.21.15.42:0/3899773301 >> 172.21.15.42:0/3899773301 conn(0x7fde4808bfc0 msgr2=0x7fde480d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.716+0000 7fde4daa5640 1 -- 172.21.15.42:0/3899773301 shutdown_connections 2024-09-16T01:55:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.716+0000 7fde4daa5640 1 -- 172.21.15.42:0/3899773301 wait complete. 2024-09-16T01:55:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.717+0000 7fde4daa5640 1 Processor -- start 2024-09-16T01:55:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.717+0000 7fde4daa5640 1 -- start start 2024-09-16T01:55:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde4daa5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde480d5100 0x7fde48150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde4daa5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde4815e640 0x7fde480b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde4daa5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde481621b0 0x7fde48160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde4daa5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde480cff40 con 0x7fde480d5100 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde4daa5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fde4815ea20 con 0x7fde481621b0 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde4daa5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fde480d00c0 con 0x7fde4815e640 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde477fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde480d5100 0x7fde48150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde477fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde480d5100 0x7fde48150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36988/0 (socket says 172.21.15.42:36988) 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde477fe640 1 -- 172.21.15.42:0/2267874517 learned_addr learned my addr 172.21.15.42:0/2267874517 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde47fff640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde481621b0 0x7fde48160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde46ffd640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde4815e640 0x7fde480b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde477fe640 1 -- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde4815e640 msgr2=0x7fde480b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde477fe640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde4815e640 0x7fde480b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde477fe640 1 -- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde481621b0 msgr2=0x7fde48160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde477fe640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde481621b0 0x7fde48160aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.718+0000 7fde477fe640 1 -- 172.21.15.42:0/2267874517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde480b3f90 con 0x7fde480d5100 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.719+0000 7fde477fe640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde480d5100 0x7fde48150940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c430 tx=0x7fde3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.719+0000 7fde2ffff640 1 -- 172.21.15.42:0/2267874517 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde380074e0 con 0x7fde480d5100 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.719+0000 7fde2ffff640 1 -- 172.21.15.42:0/2267874517 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde380047e0 con 0x7fde480d5100 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.719+0000 7fde4daa5640 1 -- 172.21.15.42:0/2267874517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4815f9e0 con 0x7fde480d5100 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.719+0000 7fde2ffff640 1 -- 172.21.15.42:0/2267874517 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38004bd0 con 0x7fde480d5100 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.719+0000 7fde4daa5640 1 -- 172.21.15.42:0/2267874517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4815ffa0 con 0x7fde480d5100 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.720+0000 7fde4daa5640 1 -- 172.21.15.42:0/2267874517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde480cfa00 con 0x7fde480d5100 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.720+0000 7fde2ffff640 1 -- 172.21.15.42:0/2267874517 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fde38011070 con 0x7fde480d5100 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.721+0000 7fde2ffff640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fde3406c2b0 0x7fde3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.721+0000 7fde2ffff640 1 -- 172.21.15.42:0/2267874517 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6187+0+0 (secure 0 0 0) 0x7fde3808b100 con 0x7fde480d5100 2024-09-16T01:55:40.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.721+0000 7fde46ffd640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fde3406c2b0 0x7fde3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:40.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.722+0000 7fde46ffd640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fde3406c2b0 0x7fde3406e770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fde481e93c0 tx=0x7fde3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:40.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.725+0000 7fde2ffff640 1 -- 172.21.15.42:0/2267874517 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde38059030 con 0x7fde480d5100 2024-09-16T01:55:40.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:40.939+0000 7fde4daa5640 1 -- 172.21.15.42:0/2267874517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fde4808c4d0 con 0x7fde480d5100 2024-09-16T01:55:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.593+0000 7fde2ffff640 1 -- 172.21.15.42:0/2267874517 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7fde3805d330 con 0x7fde480d5100 2024-09-16T01:55:41.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.595+0000 7fde4daa5640 1 -- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fde3406c2b0 msgr2=0x7fde3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:41.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.595+0000 7fde4daa5640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fde3406c2b0 0x7fde3406e770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fde481e93c0 tx=0x7fde3c008040 comp rx=0 tx=0).stop 2024-09-16T01:55:41.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.595+0000 7fde4daa5640 1 -- 172.21.15.42:0/2267874517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde480d5100 msgr2=0x7fde48150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:41.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.595+0000 7fde4daa5640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde480d5100 0x7fde48150940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c430 tx=0x7fde3800c8f0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.595+0000 7fde4daa5640 1 -- 172.21.15.42:0/2267874517 shutdown_connections 2024-09-16T01:55:41.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.595+0000 7fde4daa5640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fde3406c2b0 0x7fde3406e770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.595+0000 7fde4daa5640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fde481621b0 0x7fde48160aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.595+0000 7fde4daa5640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fde4815e640 0x7fde480b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.595+0000 7fde4daa5640 1 --2- 172.21.15.42:0/2267874517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde480d5100 0x7fde48150940 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.595+0000 7fde4daa5640 1 -- 172.21.15.42:0/2267874517 >> 172.21.15.42:0/2267874517 conn(0x7fde4808bfc0 msgr2=0x7fde480d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:41.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.596+0000 7fde4daa5640 1 -- 172.21.15.42:0/2267874517 shutdown_connections 2024-09-16T01:55:41.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.596+0000 7fde4daa5640 1 -- 172.21.15.42:0/2267874517 wait complete. 2024-09-16T01:55:41.610 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:55:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.721+0000 7f6a61e7b640 1 Processor -- start 2024-09-16T01:55:41.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.721+0000 7f6a61e7b640 1 -- start start 2024-09-16T01:55:41.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.722+0000 7f6a61e7b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6a5c162980 0x7f6a5c0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.722+0000 7f6a61e7b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a5c0d2600 con 0x7f6a5c0b5f80 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.722+0000 7f6a61e7b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a5c0b3c10 con 0x7f6a5c0d4c10 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.722+0000 7f6a61e7b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6a5c0d5420 con 0x7f6a5c162980 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.722+0000 7f6a5b7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6a5c0b5f80 0x7f6a5c0b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49052/0 (socket says 172.21.15.42:49052) 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.722+0000 7f6a5b7fe640 1 -- 172.21.15.42:0/2143715714 learned_addr learned my addr 172.21.15.42:0/2143715714 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.722+0000 7f6a5bfff640 1 --2- 172.21.15.42:0/2143715714 >> v2:172.21.15.107:3300/0 conn(0x7f6a5c162980 0x7f6a5c0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744330775 0 0) 0x7f6a4c001110 con 0x7f6a5c0b5f80 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a44003520 con 0x7f6a5c0b5f80 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3734804423 0 0) 0x7f6a44003520 con 0x7f6a5c0b5f80 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 >> v2:172.21.15.107:3300/0 conn(0x7f6a5c162980 msgr2=0x7f6a5c0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:41.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 --2- 172.21.15.42:0/2143715714 >> v2:172.21.15.107:3300/0 conn(0x7f6a5c162980 0x7f6a5c0ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 >> v1:172.21.15.107:6789/0 conn(0x7f6a5c0d4c10 legacy=0x7f6a5c0d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c0d2880 con 0x7f6a5c0b5f80 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f6a4c001840 con 0x7f6a5c0b5f80 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 >> v1:172.21.15.42:6789/0 conn(0x7f6a5c0b5f80 legacy=0x7f6a5c0b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a440039b0 0x7f6a44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a44004800 0x7f6a44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a440051c0 0x7f6a4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c0d5420 con 0x7f6a440051c0 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4400c060 con 0x7f6a440039b0 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4400c260 con 0x7f6a44004800 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5bfff640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a440051c0 0x7f6a4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:41.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5b7fe640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a440039b0 0x7f6a44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5affd640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a44004800 0x7f6a44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5bfff640 1 -- 172.21.15.42:0/2143715714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a44004800 msgr2=0x7f6a44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5bfff640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a44004800 0x7f6a44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5bfff640 1 -- 172.21.15.42:0/2143715714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a440039b0 msgr2=0x7f6a44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5bfff640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a440039b0 0x7f6a44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.723+0000 7f6a5bfff640 1 -- 172.21.15.42:0/2143715714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a44003520 con 0x7f6a440051c0 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.724+0000 7f6a5bfff640 1 -- 172.21.15.42:0/2143715714 reap_dead start 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.724+0000 7f6a5bfff640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a440051c0 0x7f6a4400b9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009fc0 tx=0x7f6a44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4986200a632bf48d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.724+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54035020 con 0x7f6a440051c0 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.724+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a54003b90 con 0x7f6a440051c0 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.724+0000 7f6a5a7fc640 1 -- 172.21.15.42:0/2143715714 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54009c10 con 0x7f6a440051c0 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.725+0000 7f6a61e7b640 1 -- 172.21.15.42:0/2143715714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a440051c0 msgr2=0x7f6a4400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.725+0000 7f6a61e7b640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a440051c0 0x7f6a4400b9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009fc0 tx=0x7f6a44005830 comp rx=0 tx=0).stop 2024-09-16T01:55:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.725+0000 7f6a61e7b640 1 -- 172.21.15.42:0/2143715714 shutdown_connections 2024-09-16T01:55:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.725+0000 7f6a61e7b640 1 --2- 172.21.15.42:0/2143715714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a440051c0 0x7f6a4400b9c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.725+0000 7f6a61e7b640 1 -- 172.21.15.42:0/2143715714 >> 172.21.15.42:0/2143715714 conn(0x7f6a5c08bfc0 msgr2=0x7f6a5c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.725+0000 7f6a61e7b640 1 -- 172.21.15.42:0/2143715714 shutdown_connections 2024-09-16T01:55:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.725+0000 7f6a61e7b640 1 -- 172.21.15.42:0/2143715714 wait complete. 2024-09-16T01:55:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.726+0000 7f6a61e7b640 1 Processor -- start 2024-09-16T01:55:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.726+0000 7f6a61e7b640 1 -- start start 2024-09-16T01:55:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a61e7b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440051c0 0x7f6a5c1f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a61e7b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a5c0b7d40 0x7f6a5c156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a61e7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a5c0b1920 0x7f6a5c0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a61e7b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c0d5140 con 0x7f6a5c0b1920 2024-09-16T01:55:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a61e7b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c0d2e90 con 0x7f6a5c0b7d40 2024-09-16T01:55:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a61e7b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5c0d2b20 con 0x7f6a440051c0 2024-09-16T01:55:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a5bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a5c0b1920 0x7f6a5c0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a5bfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a5c0b1920 0x7f6a5c0b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37006/0 (socket says 172.21.15.42:37006) 2024-09-16T01:55:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a5bfff640 1 -- 172.21.15.42:0/3231339565 learned_addr learned my addr 172.21.15.42:0/3231339565 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a5affd640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a5c0b7d40 0x7f6a5c156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a5b7fe640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440051c0 0x7f6a5c1f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a5bfff640 1 -- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440051c0 msgr2=0x7f6a5c1f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a5bfff640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440051c0 0x7f6a5c1f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a5bfff640 1 -- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a5c0b7d40 msgr2=0x7f6a5c156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a5bfff640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a5c0b7d40 0x7f6a5c156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.727+0000 7f6a5bfff640 1 -- 172.21.15.42:0/3231339565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c157230 con 0x7f6a5c0b1920 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.728+0000 7f6a5bfff640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a5c0b1920 0x7f6a5c0b1da0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6a5402af10 tx=0x7f6a54009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.728+0000 7f6a43fff640 1 -- 172.21.15.42:0/3231339565 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5403f030 con 0x7f6a5c0b1920 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.728+0000 7f6a43fff640 1 -- 172.21.15.42:0/3231339565 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a54003990 con 0x7f6a5c0b1920 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.728+0000 7f6a61e7b640 1 -- 172.21.15.42:0/3231339565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5c0b8af0 con 0x7f6a5c0b1920 2024-09-16T01:55:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.728+0000 7f6a43fff640 1 -- 172.21.15.42:0/3231339565 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54035070 con 0x7f6a5c0b1920 2024-09-16T01:55:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.728+0000 7f6a61e7b640 1 -- 172.21.15.42:0/3231339565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a5c1f4d50 con 0x7f6a5c0b1920 2024-09-16T01:55:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.729+0000 7f6a61e7b640 1 -- 172.21.15.42:0/3231339565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a5c0b6360 con 0x7f6a5c0b1920 2024-09-16T01:55:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.729+0000 7f6a43fff640 1 -- 172.21.15.42:0/3231339565 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6a54042030 con 0x7f6a5c0b1920 2024-09-16T01:55:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.730+0000 7f6a43fff640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6a4806c2b0 0x7f6a4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.730+0000 7f6a43fff640 1 -- 172.21.15.42:0/3231339565 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6187+0+0 (secure 0 0 0) 0x7f6a540ac200 con 0x7f6a5c0b1920 2024-09-16T01:55:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.730+0000 7f6a5b7fe640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6a4806c2b0 0x7f6a4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.730+0000 7f6a5b7fe640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6a4806c2b0 0x7f6a4806e770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c001050 tx=0x7f6a4c000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.734+0000 7f6a43fff640 1 -- 172.21.15.42:0/3231339565 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a5407a130 con 0x7f6a5c0b1920 2024-09-16T01:55:41.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:41.909+0000 7f6a61e7b640 1 -- 172.21.15.42:0/3231339565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6a5c0b4a50 con 0x7f6a5c0b1920 2024-09-16T01:55:42.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.597+0000 7f6a43fff640 1 -- 172.21.15.42:0/3231339565 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) ==== 181+0+0 (secure 0 0 0) 0x7f6a5407e430 con 0x7f6a5c0b1920 2024-09-16T01:55:42.599 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.600+0000 7f6a61e7b640 1 -- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6a4806c2b0 msgr2=0x7f6a4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.600+0000 7f6a61e7b640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6a4806c2b0 0x7f6a4806e770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c001050 tx=0x7f6a4c000f80 comp rx=0 tx=0).stop 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.601+0000 7f6a61e7b640 1 -- 172.21.15.42:0/3231339565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a5c0b1920 msgr2=0x7f6a5c0b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.601+0000 7f6a61e7b640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a5c0b1920 0x7f6a5c0b1da0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6a5402af10 tx=0x7f6a54009750 comp rx=0 tx=0).stop 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.601+0000 7f6a61e7b640 1 -- 172.21.15.42:0/3231339565 shutdown_connections 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.601+0000 7f6a61e7b640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6a4806c2b0 0x7f6a4806e770 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.601+0000 7f6a61e7b640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a5c0b1920 0x7f6a5c0b1da0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.601+0000 7f6a61e7b640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a5c0b7d40 0x7f6a5c156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.601+0000 7f6a61e7b640 1 --2- 172.21.15.42:0/3231339565 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6a440051c0 0x7f6a5c1f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.601+0000 7f6a61e7b640 1 -- 172.21.15.42:0/3231339565 >> 172.21.15.42:0/3231339565 conn(0x7f6a5c08bfc0 msgr2=0x7f6a5c15fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.601+0000 7f6a61e7b640 1 -- 172.21.15.42:0/3231339565 shutdown_connections 2024-09-16T01:55:42.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.601+0000 7f6a61e7b640 1 -- 172.21.15.42:0/3231339565 wait complete. 2024-09-16T01:55:42.617 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:55:42.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.729+0000 7f8cdf1c0640 1 Processor -- start 2024-09-16T01:55:42.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.729+0000 7f8cdf1c0640 1 -- start start 2024-09-16T01:55:42.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.730+0000 7f8cdf1c0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd80d15f0 0x7f8cd80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:42.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.730+0000 7f8cdf1c0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8cd80cf160 0x7f8cd806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.730+0000 7f8cdf1c0640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd80cf980 con 0x7f8cd8161a20 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.730+0000 7f8cdf1c0640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd8161e00 con 0x7f8cd80cf160 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.730+0000 7f8cdf1c0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd806d050 con 0x7f8cd80d15f0 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.730+0000 7f8cdd75d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8cd80cf160 0x7f8cd806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.730+0000 7f8cdcf5c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8cd8161a20 0x7f8cd80d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49054/0 (socket says 172.21.15.42:49054) 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.730+0000 7f8cdd75d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8cd80cf160 0x7f8cd806d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37018/0 (socket says 172.21.15.42:37018) 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.730+0000 7f8cdcf5c640 1 -- 172.21.15.42:0/348423660 learned_addr learned my addr 172.21.15.42:0/348423660 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.731+0000 7f8cdd75d640 1 -- 172.21.15.42:0/348423660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd80d15f0 msgr2=0x7f8cd80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.731+0000 7f8cd7fff640 1 --2- 172.21.15.42:0/348423660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd80d15f0 0x7f8cd80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.731+0000 7f8cd77fe640 1 -- 172.21.15.42:0/348423660 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 641362027 0 0) 0x7f8cd80cf980 con 0x7f8cd8161a20 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.731+0000 7f8cdd75d640 1 --2- 172.21.15.42:0/348423660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd80d15f0 0x7f8cd80cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:42.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.731+0000 7f8cdd75d640 1 -- 172.21.15.42:0/348423660 >> v1:172.21.15.42:6789/0 conn(0x7f8cd8161a20 legacy=0x7f8cd80d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:42.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.731+0000 7f8cdd75d640 1 -- 172.21.15.42:0/348423660 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd80cfc20 con 0x7f8cd80cf160 2024-09-16T01:55:42.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.731+0000 7f8cd7fff640 1 --2- 172.21.15.42:0/348423660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd80d15f0 0x7f8cd80cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:42.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.731+0000 7f8cdd75d640 1 --2- 172.21.15.42:0/348423660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 0x7f8cd806d810 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009d90 tx=0x7f8cd002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc42a886878458ad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:42.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cd77fe640 1 -- 172.21.15.42:0/348423660 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0007740 con 0x7f8cd80cf160 2024-09-16T01:55:42.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cd77fe640 1 -- 172.21.15.42:0/348423660 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd00078e0 con 0x7f8cd80cf160 2024-09-16T01:55:42.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cd77fe640 1 -- 172.21.15.42:0/348423660 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0007cb0 con 0x7f8cd80cf160 2024-09-16T01:55:42.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/348423660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 msgr2=0x7f8cd806d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:42.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cdf1c0640 1 --2- 172.21.15.42:0/348423660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 0x7f8cd806d810 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009d90 tx=0x7f8cd002a660 comp rx=0 tx=0).stop 2024-09-16T01:55:42.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/348423660 shutdown_connections 2024-09-16T01:55:42.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cdf1c0640 1 --2- 172.21.15.42:0/348423660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 0x7f8cd806d810 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:42.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cdf1c0640 1 --2- 172.21.15.42:0/348423660 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd80d15f0 0x7f8cd80cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:42.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/348423660 >> 172.21.15.42:0/348423660 conn(0x7f8cd809d850 msgr2=0x7f8cd808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:42.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/348423660 shutdown_connections 2024-09-16T01:55:42.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.732+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/348423660 wait complete. 2024-09-16T01:55:42.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.733+0000 7f8cdf1c0640 1 Processor -- start 2024-09-16T01:55:42.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.733+0000 7f8cdf1c0640 1 -- start start 2024-09-16T01:55:42.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.734+0000 7f8cdf1c0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 0x7f8cd80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:42.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.734+0000 7f8cdf1c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd80d15f0 0x7f8cd8158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:42.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.734+0000 7f8cdf1c0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd8161a20 0x7f8cd814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:42.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.734+0000 7f8cdf1c0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd80b1040 con 0x7f8cd80cf160 2024-09-16T01:55:42.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.734+0000 7f8cdf1c0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd806d2f0 con 0x7f8cd80d15f0 2024-09-16T01:55:42.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.734+0000 7f8cdf1c0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd80cf5f0 con 0x7f8cd8161a20 2024-09-16T01:55:42.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.734+0000 7f8cdcf5c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 0x7f8cd80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:42.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.734+0000 7f8cdcf5c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 0x7f8cd80cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37034/0 (socket says 172.21.15.42:37034) 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.734+0000 7f8cdcf5c640 1 -- 172.21.15.42:0/2928012494 learned_addr learned my addr 172.21.15.42:0/2928012494 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cdd75d640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd8161a20 0x7f8cd814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cd7fff640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd80d15f0 0x7f8cd8158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cdcf5c640 1 -- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd8161a20 msgr2=0x7f8cd814b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cdcf5c640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd8161a20 0x7f8cd814b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cdcf5c640 1 -- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd80d15f0 msgr2=0x7f8cd8158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cdcf5c640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd80d15f0 0x7f8cd8158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cdcf5c640 1 -- 172.21.15.42:0/2928012494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd80c9a60 con 0x7f8cd80cf160 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cdcf5c640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 0x7f8cd80cb5a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800c430 tx=0x7f8cc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cd57fa640 1 -- 172.21.15.42:0/2928012494 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80074e0 con 0x7f8cd80cf160 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cd57fa640 1 -- 172.21.15.42:0/2928012494 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc80047e0 con 0x7f8cd80cf160 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/2928012494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd80cbbf0 con 0x7f8cd80cf160 2024-09-16T01:55:42.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cd57fa640 1 -- 172.21.15.42:0/2928012494 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8004bd0 con 0x7f8cd80cf160 2024-09-16T01:55:42.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.735+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/2928012494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd80ca000 con 0x7f8cd80cf160 2024-09-16T01:55:42.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.736+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/2928012494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd80cec20 con 0x7f8cd80cf160 2024-09-16T01:55:42.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.737+0000 7f8cd57fa640 1 -- 172.21.15.42:0/2928012494 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8cc8011070 con 0x7f8cd80cf160 2024-09-16T01:55:42.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.737+0000 7f8cd57fa640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8cc406c2b0 0x7f8cc406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:42.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.737+0000 7f8cd57fa640 1 -- 172.21.15.42:0/2928012494 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5749+0+0 (secure 0 0 0) 0x7f8cc808b100 con 0x7f8cd80cf160 2024-09-16T01:55:42.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.737+0000 7f8cd7fff640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8cc406c2b0 0x7f8cc406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:42.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.738+0000 7f8cd7fff640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8cc406c2b0 0x7f8cc406e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8cd806eca0 tx=0x7f8ccc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:42.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.741+0000 7f8cd57fa640 1 -- 172.21.15.42:0/2928012494 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8cc8059840 con 0x7f8cd80cf160 2024-09-16T01:55:42.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:42.921+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/2928012494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8cd80b2ef0 con 0x7f8cd80cf160 2024-09-16T01:55:43.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.598+0000 7f8cd57fa640 1 -- 172.21.15.42:0/2928012494 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) ==== 169+0+0 (secure 0 0 0) 0x7f8cc8059140 con 0x7f8cd80cf160 2024-09-16T01:55:43.601 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-16T01:55:43.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.602+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8cc406c2b0 msgr2=0x7f8cc406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.602+0000 7f8cdf1c0640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8cc406c2b0 0x7f8cc406e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8cd806eca0 tx=0x7f8ccc008040 comp rx=0 tx=0).stop 2024-09-16T01:55:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.602+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/2928012494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 msgr2=0x7f8cd80cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.602+0000 7f8cdf1c0640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 0x7f8cd80cb5a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800c430 tx=0x7f8cc800c8f0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.603+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/2928012494 shutdown_connections 2024-09-16T01:55:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.603+0000 7f8cdf1c0640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8cc406c2b0 0x7f8cc406e770 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.603+0000 7f8cdf1c0640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd8161a20 0x7f8cd814b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.603+0000 7f8cdf1c0640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd80d15f0 0x7f8cd8158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.603+0000 7f8cdf1c0640 1 --2- 172.21.15.42:0/2928012494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cd80cf160 0x7f8cd80cb5a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.603+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/2928012494 >> 172.21.15.42:0/2928012494 conn(0x7f8cd809d850 msgr2=0x7f8cd80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:43.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.603+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/2928012494 shutdown_connections 2024-09-16T01:55:43.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.603+0000 7f8cdf1c0640 1 -- 172.21.15.42:0/2928012494 wait complete. 2024-09-16T01:55:43.619 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:55:43.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.726+0000 7f53c9f0a640 1 Processor -- start 2024-09-16T01:55:43.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.726+0000 7f53c9f0a640 1 -- start start 2024-09-16T01:55:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.727+0000 7f53c9f0a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f53c415f910 0x7f53c409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.727+0000 7f53c9f0a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f53c406c320 0x7f53c40b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.727+0000 7f53c9f0a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c40b60c0 con 0x7f53c40b3670 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.727+0000 7f53c9f0a640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f53c40b0d40 con 0x7f53c406c320 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.727+0000 7f53c9f0a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f53c415fcf0 con 0x7f53c415f910 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.727+0000 7f53c3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f53c406c320 0x7f53c40b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.727+0000 7f53c3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f53c406c320 0x7f53c40b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37048/0 (socket says 172.21.15.42:37048) 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.727+0000 7f53c3fff640 1 -- 172.21.15.42:0/2042847060 learned_addr learned my addr 172.21.15.42:0/2042847060 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.728+0000 7f53c3fff640 1 -- 172.21.15.42:0/2042847060 >> v2:172.21.15.107:3300/0 conn(0x7f53c415f910 msgr2=0x7f53c409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.728+0000 7f53c37fe640 1 --2- 172.21.15.42:0/2042847060 >> v2:172.21.15.107:3300/0 conn(0x7f53c415f910 0x7f53c409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.728+0000 7f53c3fff640 1 --2- 172.21.15.42:0/2042847060 >> v2:172.21.15.107:3300/0 conn(0x7f53c415f910 0x7f53c409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.728+0000 7f53c3fff640 1 -- 172.21.15.42:0/2042847060 >> v1:172.21.15.107:6789/0 conn(0x7f53c40b3670 legacy=0x7f53c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.728+0000 7f53c3fff640 1 -- 172.21.15.42:0/2042847060 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c40b63a0 con 0x7f53c406c320 2024-09-16T01:55:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.728+0000 7f53c3fff640 1 --2- 172.21.15.42:0/2042847060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c406c320 0x7f53c40b4260 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f53c4072960 tx=0x7f53bc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79898357fff7c459 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.728+0000 7f53c27fc640 1 -- 172.21.15.42:0/2042847060 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc036070 con 0x7f53c406c320 2024-09-16T01:55:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.728+0000 7f53c27fc640 1 -- 172.21.15.42:0/2042847060 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc031600 con 0x7f53c406c320 2024-09-16T01:55:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.729+0000 7f53c27fc640 1 -- 172.21.15.42:0/2042847060 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0319d0 con 0x7f53c406c320 2024-09-16T01:55:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.729+0000 7f53c9f0a640 1 -- 172.21.15.42:0/2042847060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c406c320 msgr2=0x7f53c40b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.729+0000 7f53c9f0a640 1 --2- 172.21.15.42:0/2042847060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c406c320 0x7f53c40b4260 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f53c4072960 tx=0x7f53bc02a660 comp rx=0 tx=0).stop 2024-09-16T01:55:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.729+0000 7f53c9f0a640 1 -- 172.21.15.42:0/2042847060 shutdown_connections 2024-09-16T01:55:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.729+0000 7f53c9f0a640 1 --2- 172.21.15.42:0/2042847060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c406c320 0x7f53c40b4260 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.729+0000 7f53c9f0a640 1 --2- 172.21.15.42:0/2042847060 >> v2:172.21.15.107:3300/0 conn(0x7f53c415f910 0x7f53c409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.729+0000 7f53c9f0a640 1 -- 172.21.15.42:0/2042847060 >> 172.21.15.42:0/2042847060 conn(0x7f53c4073490 msgr2=0x7f53c40b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.729+0000 7f53c9f0a640 1 -- 172.21.15.42:0/2042847060 shutdown_connections 2024-09-16T01:55:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.729+0000 7f53c9f0a640 1 -- 172.21.15.42:0/2042847060 wait complete. 2024-09-16T01:55:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.730+0000 7f53c9f0a640 1 Processor -- start 2024-09-16T01:55:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.730+0000 7f53c9f0a640 1 -- start start 2024-09-16T01:55:43.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.731+0000 7f53c9f0a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c406c320 0x7f53c4152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:43.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.731+0000 7f53c9f0a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c40b3670 0x7f53c4157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:43.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.731+0000 7f53c9f0a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53c415f910 0x7f53c4144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.731+0000 7f53c9f0a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40b0510 con 0x7f53c40b3670 2024-09-16T01:55:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.731+0000 7f53c9f0a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40b0820 con 0x7f53c406c320 2024-09-16T01:55:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.731+0000 7f53c9f0a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f53c40b3a90 con 0x7f53c415f910 2024-09-16T01:55:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.731+0000 7f53c2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c40b3670 0x7f53c4157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.731+0000 7f53c2ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c40b3670 0x7f53c4157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37058/0 (socket says 172.21.15.42:37058) 2024-09-16T01:55:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.731+0000 7f53c2ffd640 1 -- 172.21.15.42:0/1406210590 learned_addr learned my addr 172.21.15.42:0/1406210590 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.731+0000 7f53c37fe640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c406c320 0x7f53c4152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53c3fff640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53c415f910 0x7f53c4144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53c2ffd640 1 -- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53c415f910 msgr2=0x7f53c4144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53c2ffd640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53c415f910 0x7f53c4144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53c2ffd640 1 -- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c406c320 msgr2=0x7f53c4152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53c2ffd640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c406c320 0x7f53c4152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53c2ffd640 1 -- 172.21.15.42:0/1406210590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c4153180 con 0x7f53c40b3670 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53c37fe640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c406c320 0x7f53c4152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53c2ffd640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c40b3670 0x7f53c4157bc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f53b800c430 tx=0x7f53b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53abfff640 1 -- 172.21.15.42:0/1406210590 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8017070 con 0x7f53c40b3670 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53abfff640 1 -- 172.21.15.42:0/1406210590 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b80035f0 con 0x7f53c40b3670 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53abfff640 1 -- 172.21.15.42:0/1406210590 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b80039e0 con 0x7f53c40b3670 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53c9f0a640 1 -- 172.21.15.42:0/1406210590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c4145000 con 0x7f53c40b3670 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.732+0000 7f53c9f0a640 1 -- 172.21.15.42:0/1406210590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c4154b70 con 0x7f53c40b3670 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.733+0000 7f53c9f0a640 1 -- 172.21.15.42:0/1406210590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c409aa30 con 0x7f53c40b3670 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.733+0000 7f53abfff640 1 -- 172.21.15.42:0/1406210590 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f53b8003b80 con 0x7f53c40b3670 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.734+0000 7f53abfff640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f53b006c2b0 0x7f53b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.734+0000 7f53abfff640 1 -- 172.21.15.42:0/1406210590 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f53b808a690 con 0x7f53c40b3670 2024-09-16T01:55:43.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.734+0000 7f53c37fe640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f53b006c2b0 0x7f53b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:43.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.735+0000 7f53c37fe640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f53b006c2b0 0x7f53b006e770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f53b4006fd0 tx=0x7f53b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.738+0000 7f53abfff640 1 -- 172.21.15.42:0/1406210590 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53b8058f70 con 0x7f53c40b3670 2024-09-16T01:55:43.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.918+0000 7f53c9f0a640 1 -- 172.21.15.42:0/1406210590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f53c415b560 con 0x7f53c40b3670 2024-09-16T01:55:43.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.921+0000 7f53abfff640 1 -- 172.21.15.42:0/1406210590 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f53b8058870 con 0x7f53c40b3670 2024-09-16T01:55:43.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.923+0000 7f53c9f0a640 1 -- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f53b006c2b0 msgr2=0x7f53b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:43.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.923+0000 7f53c9f0a640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f53b006c2b0 0x7f53b006e770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f53b4006fd0 tx=0x7f53b4008040 comp rx=0 tx=0).stop 2024-09-16T01:55:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.923+0000 7f53c9f0a640 1 -- 172.21.15.42:0/1406210590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c40b3670 msgr2=0x7f53c4157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.923+0000 7f53c9f0a640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c40b3670 0x7f53c4157bc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f53b800c430 tx=0x7f53b800c8f0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.924+0000 7f53c9f0a640 1 -- 172.21.15.42:0/1406210590 shutdown_connections 2024-09-16T01:55:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.924+0000 7f53c9f0a640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f53b006c2b0 0x7f53b006e770 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.924+0000 7f53c9f0a640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f53c415f910 0x7f53c4144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.924+0000 7f53c9f0a640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c40b3670 0x7f53c4157bc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.924+0000 7f53c9f0a640 1 --2- 172.21.15.42:0/1406210590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53c406c320 0x7f53c4152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.924+0000 7f53c9f0a640 1 -- 172.21.15.42:0/1406210590 >> 172.21.15.42:0/1406210590 conn(0x7f53c4073490 msgr2=0x7f53c406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:43.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.924+0000 7f53c9f0a640 1 -- 172.21.15.42:0/1406210590 shutdown_connections 2024-09-16T01:55:43.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:43.924+0000 7f53c9f0a640 1 -- 172.21.15.42:0/1406210590 wait complete. 2024-09-16T01:55:43.936 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-09-16T01:55:44.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.037+0000 7f141aca6640 1 Processor -- start 2024-09-16T01:55:44.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.038+0000 7f141aca6640 1 -- start start 2024-09-16T01:55:44.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.038+0000 7f141aca6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1414162060 0x7f14140b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.038+0000 7f141aca6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f14140b64b0 0x7f14140b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.038+0000 7f141aca6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141406d9f0 con 0x7f1414161c80 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.038+0000 7f141aca6640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f141406dcd0 con 0x7f14140b64b0 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.038+0000 7f141aca6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f141406dfb0 con 0x7f1414162060 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.039+0000 7f1419243640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f14140b64b0 0x7f14140b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.039+0000 7f1419243640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f14140b64b0 0x7f14140b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37074/0 (socket says 172.21.15.42:37074) 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.039+0000 7f1419243640 1 -- 172.21.15.42:0/1390981346 learned_addr learned my addr 172.21.15.42:0/1390981346 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.039+0000 7f1413fff640 1 --2- 172.21.15.42:0/1390981346 >> v2:172.21.15.107:3300/0 conn(0x7f1414162060 0x7f14140b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.039+0000 7f1419243640 1 -- 172.21.15.42:0/1390981346 >> v2:172.21.15.107:3300/0 conn(0x7f1414162060 msgr2=0x7f14140b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.039+0000 7f1419243640 1 --2- 172.21.15.42:0/1390981346 >> v2:172.21.15.107:3300/0 conn(0x7f1414162060 0x7f14140b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.039+0000 7f1419243640 1 -- 172.21.15.42:0/1390981346 >> v1:172.21.15.107:6789/0 conn(0x7f1414161c80 legacy=0x7f141406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.039+0000 7f1419243640 1 -- 172.21.15.42:0/1390981346 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14140d01f0 con 0x7f14140b64b0 2024-09-16T01:55:44.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.039+0000 7f1413fff640 1 --2- 172.21.15.42:0/1390981346 >> v2:172.21.15.107:3300/0 conn(0x7f1414162060 0x7f14140b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f1419243640 1 --2- 172.21.15.42:0/1390981346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14140b64b0 0x7f14140b6960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f141408e830 tx=0x7f140c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181b734703ed01e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f14137fe640 1 -- 172.21.15.42:0/1390981346 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c037070 con 0x7f14140b64b0 2024-09-16T01:55:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f14137fe640 1 -- 172.21.15.42:0/1390981346 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140c032440 con 0x7f14140b64b0 2024-09-16T01:55:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f14137fe640 1 -- 172.21.15.42:0/1390981346 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c032810 con 0x7f14140b64b0 2024-09-16T01:55:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f141aca6640 1 -- 172.21.15.42:0/1390981346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14140b64b0 msgr2=0x7f14140b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f141aca6640 1 --2- 172.21.15.42:0/1390981346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14140b64b0 0x7f14140b6960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f141408e830 tx=0x7f140c02a270 comp rx=0 tx=0).stop 2024-09-16T01:55:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f141aca6640 1 -- 172.21.15.42:0/1390981346 shutdown_connections 2024-09-16T01:55:44.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f141aca6640 1 --2- 172.21.15.42:0/1390981346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14140b64b0 0x7f14140b6960 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f141aca6640 1 --2- 172.21.15.42:0/1390981346 >> v2:172.21.15.107:3300/0 conn(0x7f1414162060 0x7f14140b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f141aca6640 1 -- 172.21.15.42:0/1390981346 >> 172.21.15.42:0/1390981346 conn(0x7f14140d44f0 msgr2=0x7f14140d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.040+0000 7f141aca6640 1 -- 172.21.15.42:0/1390981346 shutdown_connections 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.041+0000 7f141aca6640 1 -- 172.21.15.42:0/1390981346 wait complete. 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.042+0000 7f141aca6640 1 Processor -- start 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.042+0000 7f141aca6640 1 -- start start 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.042+0000 7f141aca6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140b64b0 0x7f1414159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.042+0000 7f141aca6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1414161c80 0x7f14140b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f141aca6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1414162060 0x7f14140b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f141aca6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f14140cf1e0 con 0x7f1414161c80 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f141aca6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f14140d2aa0 con 0x7f1414162060 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f141aca6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14140cf360 con 0x7f14140b64b0 2024-09-16T01:55:44.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1413fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1414161c80 0x7f14140b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1413fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1414161c80 0x7f14140b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37078/0 (socket says 172.21.15.42:37078) 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1413fff640 1 -- 172.21.15.42:0/3886742280 learned_addr learned my addr 172.21.15.42:0/3886742280 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1419243640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1414162060 0x7f14140b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1418a42640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140b64b0 0x7f1414159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1413fff640 1 -- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140b64b0 msgr2=0x7f1414159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1413fff640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140b64b0 0x7f1414159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1413fff640 1 -- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1414162060 msgr2=0x7f14140b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1413fff640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1414162060 0x7f14140b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1413fff640 1 -- 172.21.15.42:0/3886742280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14140cb810 con 0x7f1414161c80 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1418a42640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140b64b0 0x7f1414159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:44.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f1413fff640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1414161c80 0x7f14140b21e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00d800 tx=0x7f13fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f14117fa640 1 -- 172.21.15.42:0/3886742280 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc004030 con 0x7f1414161c80 2024-09-16T01:55:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f14117fa640 1 -- 172.21.15.42:0/3886742280 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc0041d0 con 0x7f1414161c80 2024-09-16T01:55:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f141aca6640 1 -- 172.21.15.42:0/3886742280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14140cbaf0 con 0x7f1414161c80 2024-09-16T01:55:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f14117fa640 1 -- 172.21.15.42:0/3886742280 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0096a0 con 0x7f1414161c80 2024-09-16T01:55:44.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.043+0000 7f141aca6640 1 -- 172.21.15.42:0/3886742280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14140cc0b0 con 0x7f1414161c80 2024-09-16T01:55:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.044+0000 7f141aca6640 1 -- 172.21.15.42:0/3886742280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14140b5f70 con 0x7f1414161c80 2024-09-16T01:55:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.045+0000 7f14117fa640 1 -- 172.21.15.42:0/3886742280 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f13fc009840 con 0x7f1414161c80 2024-09-16T01:55:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.045+0000 7f14117fa640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f13f406c2b0 0x7f13f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.045+0000 7f14117fa640 1 -- 172.21.15.42:0/3886742280 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f13fc08b490 con 0x7f1414161c80 2024-09-16T01:55:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.046+0000 7f1418a42640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f13f406c2b0 0x7f13f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.046+0000 7f1418a42640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f13f406c2b0 0x7f13f406e770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1404001e00 tx=0x7f1404009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:44.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.050+0000 7f14117fa640 1 -- 172.21.15.42:0/3886742280 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13fc059d60 con 0x7f1414161c80 2024-09-16T01:55:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.294+0000 7f141aca6640 1 -- 172.21.15.42:0/3886742280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f14140ce680 con 0x7f1414161c80 2024-09-16T01:55:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.605+0000 7f14117fa640 1 -- 172.21.15.42:0/3886742280 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v93) ==== 142+0+0 (secure 0 0 0) 0x7f13fc059660 con 0x7f1414161c80 2024-09-16T01:55:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.607+0000 7f141aca6640 1 -- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f13f406c2b0 msgr2=0x7f13f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.607+0000 7f141aca6640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f13f406c2b0 0x7f13f406e770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1404001e00 tx=0x7f1404009040 comp rx=0 tx=0).stop 2024-09-16T01:55:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.607+0000 7f141aca6640 1 -- 172.21.15.42:0/3886742280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1414161c80 msgr2=0x7f14140b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.607+0000 7f141aca6640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1414161c80 0x7f14140b21e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00d800 tx=0x7f13fc00dcc0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.608+0000 7f141aca6640 1 -- 172.21.15.42:0/3886742280 shutdown_connections 2024-09-16T01:55:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.608+0000 7f141aca6640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f13f406c2b0 0x7f13f406e770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.608+0000 7f141aca6640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1414162060 0x7f14140b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.608+0000 7f141aca6640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1414161c80 0x7f14140b21e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.608+0000 7f141aca6640 1 --2- 172.21.15.42:0/3886742280 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f14140b64b0 0x7f1414159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.608+0000 7f141aca6640 1 -- 172.21.15.42:0/3886742280 >> 172.21.15.42:0/3886742280 conn(0x7f14140d44f0 msgr2=0x7f14140d3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.608+0000 7f141aca6640 1 -- 172.21.15.42:0/3886742280 shutdown_connections 2024-09-16T01:55:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.608+0000 7f141aca6640 1 -- 172.21.15.42:0/3886742280 wait complete. 2024-09-16T01:55:44.620 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-09-16T01:55:44.621 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-09-16T01:55:44.621 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-16T01:55:44.621 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:55:44.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.723+0000 7f51ae5c6640 1 Processor -- start 2024-09-16T01:55:44.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.723+0000 7f51ae5c6640 1 -- start start 2024-09-16T01:55:44.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.724+0000 7f51ae5c6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f51a815b300 0x7f51a80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.724+0000 7f51ae5c6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a806f8d0 0x7f51a815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.724+0000 7f51ae5c6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51a80cdbe0 con 0x7f51a80cd3f0 2024-09-16T01:55:44.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.724+0000 7f51ae5c6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f51a80728a0 con 0x7f51a815b300 2024-09-16T01:55:44.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.724+0000 7f51ae5c6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f51a80cd900 con 0x7f51a806f8d0 2024-09-16T01:55:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.724+0000 7f51acb63640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a806f8d0 0x7f51a815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.724+0000 7f51a7fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f51a815b300 0x7f51a80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.724+0000 7f51a77fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f51a80cd3f0 0x7f51a806f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:46242/0 (socket says 172.21.15.42:46242) 2024-09-16T01:55:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.724+0000 7f51a77fe640 1 -- 172.21.15.42:0/3127849033 learned_addr learned my addr 172.21.15.42:0/3127849033 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.725+0000 7f51a6ffd640 1 -- 172.21.15.42:0/3127849033 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802139899 0 0) 0x7f51a80cdbe0 con 0x7f51a80cd3f0 2024-09-16T01:55:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.725+0000 7f51a6ffd640 1 -- 172.21.15.42:0/3127849033 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5190005730 con 0x7f51a80cd3f0 2024-09-16T01:55:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.725+0000 7f51acb63640 1 -- 172.21.15.42:0/3127849033 >> v2:172.21.15.107:3300/0 conn(0x7f51a815b300 msgr2=0x7f51a80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.725+0000 7f51acb63640 1 --2- 172.21.15.42:0/3127849033 >> v2:172.21.15.107:3300/0 conn(0x7f51a815b300 0x7f51a80cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.725+0000 7f51acb63640 1 -- 172.21.15.42:0/3127849033 >> v1:172.21.15.107:6789/0 conn(0x7f51a80cd3f0 legacy=0x7f51a806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.725+0000 7f51acb63640 1 -- 172.21.15.42:0/3127849033 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a8072250 con 0x7f51a806f8d0 2024-09-16T01:55:44.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.725+0000 7f51a7fff640 1 --2- 172.21.15.42:0/3127849033 >> v2:172.21.15.107:3300/0 conn(0x7f51a815b300 0x7f51a80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:44.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51acb63640 1 --2- 172.21.15.42:0/3127849033 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a806f8d0 0x7f51a815b6e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009d90 tx=0x7f51a002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0679210ddb15bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:44.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51a6ffd640 1 -- 172.21.15.42:0/3127849033 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0007740 con 0x7f51a806f8d0 2024-09-16T01:55:44.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51a6ffd640 1 -- 172.21.15.42:0/3127849033 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a00078e0 con 0x7f51a806f8d0 2024-09-16T01:55:44.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51a6ffd640 1 -- 172.21.15.42:0/3127849033 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0007c90 con 0x7f51a806f8d0 2024-09-16T01:55:44.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51ae5c6640 1 -- 172.21.15.42:0/3127849033 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a806f8d0 msgr2=0x7f51a815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51ae5c6640 1 --2- 172.21.15.42:0/3127849033 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a806f8d0 0x7f51a815b6e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009d90 tx=0x7f51a002a660 comp rx=0 tx=0).stop 2024-09-16T01:55:44.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51ae5c6640 1 -- 172.21.15.42:0/3127849033 shutdown_connections 2024-09-16T01:55:44.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51ae5c6640 1 --2- 172.21.15.42:0/3127849033 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a806f8d0 0x7f51a815b6e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51ae5c6640 1 --2- 172.21.15.42:0/3127849033 >> v2:172.21.15.107:3300/0 conn(0x7f51a815b300 0x7f51a80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51ae5c6640 1 -- 172.21.15.42:0/3127849033 >> 172.21.15.42:0/3127849033 conn(0x7f51a8067d70 msgr2=0x7f51a806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51ae5c6640 1 -- 172.21.15.42:0/3127849033 shutdown_connections 2024-09-16T01:55:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.726+0000 7f51ae5c6640 1 -- 172.21.15.42:0/3127849033 wait complete. 2024-09-16T01:55:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.727+0000 7f51ae5c6640 1 Processor -- start 2024-09-16T01:55:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.728+0000 7f51ae5c6640 1 -- start start 2024-09-16T01:55:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.728+0000 7f51ae5c6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51a806f8d0 0x7f51a8156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.728+0000 7f51ae5c6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51a80cd3f0 0x7f51a814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.728+0000 7f51ae5c6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a815b300 0x7f51a815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.728+0000 7f51ae5c6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f51a80d0160 con 0x7f51a80cd3f0 2024-09-16T01:55:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.728+0000 7f51ae5c6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f51a80cffe0 con 0x7f51a806f8d0 2024-09-16T01:55:44.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.728+0000 7f51ae5c6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f51a8072d30 con 0x7f51a815b300 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.728+0000 7f51a77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51a80cd3f0 0x7f51a814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51a80cd3f0 0x7f51a814dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37084/0 (socket says 172.21.15.42:37084) 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a77fe640 1 -- 172.21.15.42:0/719335795 learned_addr learned my addr 172.21.15.42:0/719335795 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a7fff640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51a806f8d0 0x7f51a8156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51acb63640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a815b300 0x7f51a815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a77fe640 1 -- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a815b300 msgr2=0x7f51a815b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a77fe640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a815b300 0x7f51a815b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a77fe640 1 -- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51a806f8d0 msgr2=0x7f51a8156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a77fe640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51a806f8d0 0x7f51a8156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a77fe640 1 -- 172.21.15.42:0/719335795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a814e160 con 0x7f51a80cd3f0 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a77fe640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51a80cd3f0 0x7f51a814dc20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c430 tx=0x7f519c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a4ff9640 1 -- 172.21.15.42:0/719335795 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c017070 con 0x7f51a80cd3f0 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a4ff9640 1 -- 172.21.15.42:0/719335795 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c005ce0 con 0x7f51a80cd3f0 2024-09-16T01:55:44.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51ae5c6640 1 -- 172.21.15.42:0/719335795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a8157260 con 0x7f51a80cd3f0 2024-09-16T01:55:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51a4ff9640 1 -- 172.21.15.42:0/719335795 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c0072f0 con 0x7f51a80cd3f0 2024-09-16T01:55:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.729+0000 7f51ae5c6640 1 -- 172.21.15.42:0/719335795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a814e6d0 con 0x7f51a80cd3f0 2024-09-16T01:55:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.730+0000 7f51ae5c6640 1 -- 172.21.15.42:0/719335795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a80af720 con 0x7f51a80cd3f0 2024-09-16T01:55:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.731+0000 7f51a4ff9640 1 -- 172.21.15.42:0/719335795 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f519c01a070 con 0x7f51a80cd3f0 2024-09-16T01:55:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.731+0000 7f51a4ff9640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f519406c2b0 0x7f519406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.732+0000 7f51a4ff9640 1 -- 172.21.15.42:0/719335795 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f519c08a610 con 0x7f51a80cd3f0 2024-09-16T01:55:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.732+0000 7f51a7fff640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f519406c2b0 0x7f519406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:44.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.732+0000 7f51a7fff640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f519406c2b0 0x7f519406e770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5198009560 tx=0x7f5198009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:44.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.736+0000 7f51a4ff9640 1 -- 172.21.15.42:0/719335795 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51a80af720 con 0x7f51a80cd3f0 2024-09-16T01:55:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.914+0000 7f51ae5c6640 1 -- 172.21.15.42:0/719335795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51a80b49d0 con 0x7f51a80cd3f0 2024-09-16T01:55:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.915+0000 7f51a4ff9640 1 -- 172.21.15.42:0/719335795 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+13295 (secure 0 0 0) 0x7f519c058930 con 0x7f51a80cd3f0 2024-09-16T01:55:44.918 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:44.918 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":41,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:43.598072+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6837/3744211154":"2024-09-17T01:55:40.591121+0000","172.21.15.107:6835/3744211154":"2024-09-17T01:55:40.591121+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:55:44.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.916+0000 7f51ae5c6640 1 -- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f519406c2b0 msgr2=0x7f519406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.916+0000 7f51ae5c6640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f519406c2b0 0x7f519406e770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5198009560 tx=0x7f5198009190 comp rx=0 tx=0).stop 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.916+0000 7f51ae5c6640 1 -- 172.21.15.42:0/719335795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51a80cd3f0 msgr2=0x7f51a814dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.916+0000 7f51ae5c6640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51a80cd3f0 0x7f51a814dc20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c430 tx=0x7f519c00c8f0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.917+0000 7f51ae5c6640 1 -- 172.21.15.42:0/719335795 shutdown_connections 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.917+0000 7f51ae5c6640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f519406c2b0 0x7f519406e770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.917+0000 7f51ae5c6640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f51a815b300 0x7f51a815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.917+0000 7f51ae5c6640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51a80cd3f0 0x7f51a814dc20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.917+0000 7f51ae5c6640 1 --2- 172.21.15.42:0/719335795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f51a806f8d0 0x7f51a8156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.917+0000 7f51ae5c6640 1 -- 172.21.15.42:0/719335795 >> 172.21.15.42:0/719335795 conn(0x7f51a8067d70 msgr2=0x7f51a80af940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.917+0000 7f51ae5c6640 1 -- 172.21.15.42:0/719335795 shutdown_connections 2024-09-16T01:55:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:44.917+0000 7f51ae5c6640 1 -- 172.21.15.42:0/719335795 wait complete. 2024-09-16T01:55:44.930 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:54:08.299569+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:55:44.930 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:55:45.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.034+0000 7ff69048d640 1 Processor -- start 2024-09-16T01:55:45.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.034+0000 7ff69048d640 1 -- start start 2024-09-16T01:55:45.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.035+0000 7ff69048d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff68815b410 0x7ff688072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.035+0000 7ff69048d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6880cec90 con 0x7ff6880ce6e0 2024-09-16T01:55:45.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.035+0000 7ff69048d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6880cef70 con 0x7ff68815b7f0 2024-09-16T01:55:45.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.035+0000 7ff69048d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff6880cf250 con 0x7ff68815b410 2024-09-16T01:55:45.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.035+0000 7ff68ea2a640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff6880ce6e0 0x7ff6880b3260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49070/0 (socket says 172.21.15.42:49070) 2024-09-16T01:55:45.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.035+0000 7ff68ea2a640 1 -- 172.21.15.42:0/2593609381 learned_addr learned my addr 172.21.15.42:0/2593609381 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:45.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.035+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946763692 0 0) 0x7ff6880cec90 con 0x7ff6880ce6e0 2024-09-16T01:55:45.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.035+0000 7ff68e229640 1 --2- 172.21.15.42:0/2593609381 >> v2:172.21.15.107:3300/0 conn(0x7ff68815b410 0x7ff688072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff674003520 con 0x7ff6880ce6e0 2024-09-16T01:55:45.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2923467805 0 0) 0x7ff674003520 con 0x7ff6880ce6e0 2024-09-16T01:55:45.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 >> v2:172.21.15.107:3300/0 conn(0x7ff68815b410 msgr2=0x7ff688072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:45.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 --2- 172.21.15.42:0/2593609381 >> v2:172.21.15.107:3300/0 conn(0x7ff68815b410 0x7ff688072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 >> v1:172.21.15.107:6789/0 conn(0x7ff68815b7f0 legacy=0x7ff6880cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6880cf530 con 0x7ff6880ce6e0 2024-09-16T01:55:45.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7ff6800019f0 con 0x7ff6880ce6e0 2024-09-16T01:55:45.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 >> v1:172.21.15.42:6789/0 conn(0x7ff6880ce6e0 legacy=0x7ff6880b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6740039b0 0x7ff674003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff674004800 0x7ff674004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6740051c0 0x7ff67400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff6880cf250 con 0x7ff6740051c0 2024-09-16T01:55:45.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff67400c160 con 0x7ff674004800 2024-09-16T01:55:45.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff67400c360 con 0x7ff6740039b0 2024-09-16T01:55:45.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68ea2a640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6740051c0 0x7ff67400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68da28640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff674004800 0x7ff674004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68e229640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6740039b0 0x7ff674003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68ea2a640 1 -- 172.21.15.42:0/2593609381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6740039b0 msgr2=0x7ff674003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:45.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68ea2a640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6740039b0 0x7ff674003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68ea2a640 1 -- 172.21.15.42:0/2593609381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff674004800 msgr2=0x7ff674004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:45.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68ea2a640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff674004800 0x7ff674004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68ea2a640 1 -- 172.21.15.42:0/2593609381 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff674003520 con 0x7ff6740051c0 2024-09-16T01:55:45.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.036+0000 7ff68e229640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6740039b0 0x7ff674003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:45.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.037+0000 7ff68ea2a640 1 -- 172.21.15.42:0/2593609381 reap_dead start 2024-09-16T01:55:45.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.037+0000 7ff68ea2a640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6740051c0 0x7ff67400b9c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff68000a840 tx=0x7ff674005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dded6c40a51b721 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:45.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.037+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68000a460 con 0x7ff6740051c0 2024-09-16T01:55:45.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.037+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68002f070 con 0x7ff6740051c0 2024-09-16T01:55:45.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.037+0000 7ff68d227640 1 -- 172.21.15.42:0/2593609381 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68002bcd0 con 0x7ff6740051c0 2024-09-16T01:55:45.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.038+0000 7ff69048d640 1 -- 172.21.15.42:0/2593609381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6740051c0 msgr2=0x7ff67400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.038+0000 7ff69048d640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6740051c0 0x7ff67400b9c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff68000a840 tx=0x7ff674005830 comp rx=0 tx=0).stop 2024-09-16T01:55:45.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.038+0000 7ff69048d640 1 -- 172.21.15.42:0/2593609381 shutdown_connections 2024-09-16T01:55:45.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.038+0000 7ff69048d640 1 --2- 172.21.15.42:0/2593609381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6740051c0 0x7ff67400b9c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.038+0000 7ff69048d640 1 -- 172.21.15.42:0/2593609381 >> 172.21.15.42:0/2593609381 conn(0x7ff68806bdf0 msgr2=0x7ff68806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:45.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.038+0000 7ff69048d640 1 -- 172.21.15.42:0/2593609381 shutdown_connections 2024-09-16T01:55:45.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.038+0000 7ff69048d640 1 -- 172.21.15.42:0/2593609381 wait complete. 2024-09-16T01:55:45.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.039+0000 7ff69048d640 1 Processor -- start 2024-09-16T01:55:45.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.039+0000 7ff69048d640 1 -- start start 2024-09-16T01:55:45.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff69048d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6740051c0 0x7ff68814f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff69048d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6880b16c0 0x7ff6880b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff69048d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6880b4410 0x7ff6880b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff69048d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff6880ce150 con 0x7ff6880b16c0 2024-09-16T01:55:45.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff69048d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff6880cdfd0 con 0x7ff6880b4410 2024-09-16T01:55:45.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff69048d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff6880ce2d0 con 0x7ff6740051c0 2024-09-16T01:55:45.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff68da28640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6880b16c0 0x7ff6880b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff68da28640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6880b16c0 0x7ff6880b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37096/0 (socket says 172.21.15.42:37096) 2024-09-16T01:55:45.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff68da28640 1 -- 172.21.15.42:0/805092771 learned_addr learned my addr 172.21.15.42:0/805092771 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:45.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff68e229640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6740051c0 0x7ff68814f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff68ea2a640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6880b4410 0x7ff6880b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff68da28640 1 -- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6740051c0 msgr2=0x7ff68814f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff68da28640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6740051c0 0x7ff68814f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff68da28640 1 -- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6880b4410 msgr2=0x7ff6880b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff68da28640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6880b4410 0x7ff6880b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.040+0000 7ff68da28640 1 -- 172.21.15.42:0/805092771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6880b2210 con 0x7ff6880b16c0 2024-09-16T01:55:45.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.041+0000 7ff68da28640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6880b16c0 0x7ff6880b1b20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff67800f620 tx=0x7ff67800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:45.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.041+0000 7ff67effd640 1 -- 172.21.15.42:0/805092771 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6780052e0 con 0x7ff6880b16c0 2024-09-16T01:55:45.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.041+0000 7ff67effd640 1 -- 172.21.15.42:0/805092771 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678018070 con 0x7ff6880b16c0 2024-09-16T01:55:45.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.041+0000 7ff67effd640 1 -- 172.21.15.42:0/805092771 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678003830 con 0x7ff6880b16c0 2024-09-16T01:55:45.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.041+0000 7ff69048d640 1 -- 172.21.15.42:0/805092771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6880b24f0 con 0x7ff6880b16c0 2024-09-16T01:55:45.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.041+0000 7ff69048d640 1 -- 172.21.15.42:0/805092771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff68814fa10 con 0x7ff6880b16c0 2024-09-16T01:55:45.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.042+0000 7ff69048d640 1 -- 172.21.15.42:0/805092771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6880b4dd0 con 0x7ff6880b16c0 2024-09-16T01:55:45.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.042+0000 7ff67effd640 1 -- 172.21.15.42:0/805092771 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff6780039d0 con 0x7ff6880b16c0 2024-09-16T01:55:45.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.043+0000 7ff67effd640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66c06c2b0 0x7ff66c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.043+0000 7ff67effd640 1 -- 172.21.15.42:0/805092771 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7ff67808af30 con 0x7ff6880b16c0 2024-09-16T01:55:45.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.043+0000 7ff68e229640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66c06c2b0 0x7ff66c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.043+0000 7ff68e229640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66c06c2b0 0x7ff66c06e770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff684006f80 tx=0x7ff684008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:45.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.047+0000 7ff67effd640 1 -- 172.21.15.42:0/805092771 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6780591c0 con 0x7ff6880b16c0 2024-09-16T01:55:45.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.226+0000 7ff69048d640 1 -- 172.21.15.42:0/805092771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff688072050 con 0x7ff6880b16c0 2024-09-16T01:55:45.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.227+0000 7ff67effd640 1 -- 172.21.15.42:0/805092771 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) ==== 93+0+10 (secure 0 0 0) 0x7ff67805d4c0 con 0x7ff6880b16c0 2024-09-16T01:55:45.228 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-16T01:55:45.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 -- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66c06c2b0 msgr2=0x7ff66c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66c06c2b0 0x7ff66c06e770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff684006f80 tx=0x7ff684008040 comp rx=0 tx=0).stop 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 -- 172.21.15.42:0/805092771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6880b16c0 msgr2=0x7ff6880b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6880b16c0 0x7ff6880b1b20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff67800f620 tx=0x7ff67800fae0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 -- 172.21.15.42:0/805092771 shutdown_connections 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66c06c2b0 0x7ff66c06e770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6880b4410 0x7ff6880b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6880b16c0 0x7ff6880b1b20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 --2- 172.21.15.42:0/805092771 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff6740051c0 0x7ff68814f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 -- 172.21.15.42:0/805092771 >> 172.21.15.42:0/805092771 conn(0x7ff68806bdf0 msgr2=0x7ff68806c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 -- 172.21.15.42:0/805092771 shutdown_connections 2024-09-16T01:55:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.229+0000 7ff69048d640 1 -- 172.21.15.42:0/805092771 wait complete. 2024-09-16T01:55:45.241 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-09-16T01:55:45.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.342+0000 7f49fc5cf640 1 Processor -- start 2024-09-16T01:55:45.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.342+0000 7f49fc5cf640 1 -- start start 2024-09-16T01:55:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.343+0000 7f49fc5cf640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f49f415c520 0x7f49f409b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.343+0000 7f49fc5cf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f49f40b1620 0x7f49f40b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.343+0000 7f49fc5cf640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49f40d0980 0x7f49f40d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.343+0000 7f49fc5cf640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f49f40d1310 con 0x7f49f415c520 2024-09-16T01:55:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.343+0000 7f49fc5cf640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f49f40cec00 con 0x7f49f40b1620 2024-09-16T01:55:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.343+0000 7f49fc5cf640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f49f409bd90 con 0x7f49f40d0980 2024-09-16T01:55:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.343+0000 7f49fa36b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f49f415c520 0x7f49f409b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.343+0000 7f49fa36b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f49f415c520 0x7f49f409b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37100/0 (socket says 172.21.15.42:37100) 2024-09-16T01:55:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.343+0000 7f49fa36b640 1 -- 172.21.15.42:0/1334646115 learned_addr learned my addr 172.21.15.42:0/1334646115 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.344+0000 7f49f9b6a640 1 --2- 172.21.15.42:0/1334646115 >> v2:172.21.15.107:3300/0 conn(0x7f49f40b1620 0x7f49f40b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.344+0000 7f49fa36b640 1 -- 172.21.15.42:0/1334646115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49f40d0980 msgr2=0x7f49f40d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.344+0000 7f49fa36b640 1 --2- 172.21.15.42:0/1334646115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49f40d0980 0x7f49f40d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.344+0000 7f49fa36b640 1 -- 172.21.15.42:0/1334646115 >> v2:172.21.15.107:3300/0 conn(0x7f49f40b1620 msgr2=0x7f49f40b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.344+0000 7f49fa36b640 1 --2- 172.21.15.42:0/1334646115 >> v2:172.21.15.107:3300/0 conn(0x7f49f40b1620 0x7f49f40b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.344+0000 7f49fa36b640 1 -- 172.21.15.42:0/1334646115 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f40d0010 con 0x7f49f415c520 2024-09-16T01:55:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.344+0000 7f49f9b6a640 1 --2- 172.21.15.42:0/1334646115 >> v2:172.21.15.107:3300/0 conn(0x7f49f40b1620 0x7f49f40b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:55:45.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.344+0000 7f49fa36b640 1 --2- 172.21.15.42:0/1334646115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 0x7f49f409b720 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f49f40733c0 tx=0x7f49ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a545dd68886e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:45.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49f9369640 1 -- 172.21.15.42:0/1334646115 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec037070 con 0x7f49f415c520 2024-09-16T01:55:45.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49f9369640 1 -- 172.21.15.42:0/1334646115 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ec032440 con 0x7f49f415c520 2024-09-16T01:55:45.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49f9369640 1 -- 172.21.15.42:0/1334646115 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec032810 con 0x7f49f415c520 2024-09-16T01:55:45.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49fc5cf640 1 -- 172.21.15.42:0/1334646115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 msgr2=0x7f49f409b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49fc5cf640 1 --2- 172.21.15.42:0/1334646115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 0x7f49f409b720 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f49f40733c0 tx=0x7f49ec02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49fc5cf640 1 -- 172.21.15.42:0/1334646115 shutdown_connections 2024-09-16T01:55:45.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49fc5cf640 1 --2- 172.21.15.42:0/1334646115 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49f40d0980 0x7f49f40d0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49fc5cf640 1 --2- 172.21.15.42:0/1334646115 >> v2:172.21.15.107:3300/0 conn(0x7f49f40b1620 0x7f49f40b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49fc5cf640 1 --2- 172.21.15.42:0/1334646115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 0x7f49f409b720 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49fc5cf640 1 -- 172.21.15.42:0/1334646115 >> 172.21.15.42:0/1334646115 conn(0x7f49f40d23a0 msgr2=0x7f49f40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:45.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49fc5cf640 1 -- 172.21.15.42:0/1334646115 shutdown_connections 2024-09-16T01:55:45.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.345+0000 7f49fc5cf640 1 -- 172.21.15.42:0/1334646115 wait complete. 2024-09-16T01:55:45.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.346+0000 7f49fc5cf640 1 Processor -- start 2024-09-16T01:55:45.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.347+0000 7f49fc5cf640 1 -- start start 2024-09-16T01:55:45.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.347+0000 7f49fc5cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f40b1620 0x7f49f40b6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.347+0000 7f49fc5cf640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49f40d0980 0x7f49f40c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.347+0000 7f49fc5cf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 0x7f49f4158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.347+0000 7f49fc5cf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f49f40d05d0 con 0x7f49f415c520 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.347+0000 7f49fc5cf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f49f40cd050 con 0x7f49f40b1620 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.347+0000 7f49fc5cf640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f49f415c900 con 0x7f49f40d0980 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.347+0000 7f49fab6c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 0x7f49f4158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.347+0000 7f49fab6c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 0x7f49f4158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37112/0 (socket says 172.21.15.42:37112) 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.347+0000 7f49fab6c640 1 -- 172.21.15.42:0/3117474351 learned_addr learned my addr 172.21.15.42:0/3117474351 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49fa36b640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f40b1620 0x7f49f40b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49f9b6a640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49f40d0980 0x7f49f40c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49fab6c640 1 -- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49f40d0980 msgr2=0x7f49f40c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49fab6c640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49f40d0980 0x7f49f40c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49fab6c640 1 -- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f40b1620 msgr2=0x7f49f40b6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49fab6c640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f40b1620 0x7f49f40b6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49fab6c640 1 -- 172.21.15.42:0/3117474351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f41594c0 con 0x7f49f415c520 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49f9b6a640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49f40d0980 0x7f49f40c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49fab6c640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 0x7f49f4158980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f49e400b970 tx=0x7f49e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49f2ffd640 1 -- 172.21.15.42:0/3117474351 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4019070 con 0x7f49f415c520 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49f2ffd640 1 -- 172.21.15.42:0/3117474351 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e400cb60 con 0x7f49f415c520 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49fc5cf640 1 -- 172.21.15.42:0/3117474351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f40b6c60 con 0x7f49f415c520 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49f2ffd640 1 -- 172.21.15.42:0/3117474351 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4014440 con 0x7f49f415c520 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.348+0000 7f49fc5cf640 1 -- 172.21.15.42:0/3117474351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f40b7220 con 0x7f49f415c520 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.349+0000 7f49fc5cf640 1 -- 172.21.15.42:0/3117474351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f40d0dd0 con 0x7f49f415c520 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.350+0000 7f49f2ffd640 1 -- 172.21.15.42:0/3117474351 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f49e401c070 con 0x7f49f415c520 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.350+0000 7f49f2ffd640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f49e006c2b0 0x7f49e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.350+0000 7f49f2ffd640 1 -- 172.21.15.42:0/3117474351 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f49e408aeb0 con 0x7f49f415c520 2024-09-16T01:55:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.350+0000 7f49fa36b640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f49e006c2b0 0x7f49e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.351+0000 7f49fa36b640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f49e006c2b0 0x7f49e006e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f49ec034000 tx=0x7f49ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:45.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.354+0000 7f49f2ffd640 1 -- 172.21.15.42:0/3117474351 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49e40591d0 con 0x7f49f415c520 2024-09-16T01:55:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.595+0000 7f49fc5cf640 1 -- 172.21.15.42:0/3117474351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f49f40b3490 con 0x7f49f415c520 2024-09-16T01:55:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.607+0000 7f49f2ffd640 1 -- 172.21.15.42:0/3117474351 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v94) ==== 152+0+0 (secure 0 0 0) 0x7f49e405d4d0 con 0x7f49f415c520 2024-09-16T01:55:45.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 -- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f49e006c2b0 msgr2=0x7f49e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f49e006c2b0 0x7f49e006e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f49ec034000 tx=0x7f49ec02e000 comp rx=0 tx=0).stop 2024-09-16T01:55:45.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 -- 172.21.15.42:0/3117474351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 msgr2=0x7f49f4158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 0x7f49f4158980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f49e400b970 tx=0x7f49e400be30 comp rx=0 tx=0).stop 2024-09-16T01:55:45.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 -- 172.21.15.42:0/3117474351 shutdown_connections 2024-09-16T01:55:45.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f49e006c2b0 0x7f49e006e770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f415c520 0x7f49f4158980 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f49f40d0980 0x7f49f40c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 --2- 172.21.15.42:0/3117474351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49f40b1620 0x7f49f40b6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 -- 172.21.15.42:0/3117474351 >> 172.21.15.42:0/3117474351 conn(0x7f49f40d23a0 msgr2=0x7f49f40d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:45.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 -- 172.21.15.42:0/3117474351 shutdown_connections 2024-09-16T01:55:45.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.609+0000 7f49fc5cf640 1 -- 172.21.15.42:0/3117474351 wait complete. 2024-09-16T01:55:45.621 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:55:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.725+0000 7f58ee0e6640 1 Processor -- start 2024-09-16T01:55:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.725+0000 7f58ee0e6640 1 -- start start 2024-09-16T01:55:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58ee0e6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80d15f0 0x7f58e80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58ee0e6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f58e80cf160 0x7f58e806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58ee0e6640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e80cf980 con 0x7f58e8161a20 2024-09-16T01:55:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58ee0e6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f58e8161e00 con 0x7f58e80cf160 2024-09-16T01:55:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58ee0e6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f58e806d050 con 0x7f58e80d15f0 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e77fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f58e8161a20 0x7f58e80d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49072/0 (socket says 172.21.15.42:49072) 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e77fe640 1 -- 172.21.15.42:0/1515342168 learned_addr learned my addr 172.21.15.42:0/1515342168 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732639214 0 0) 0x7f58e80cf980 con 0x7f58e8161a20 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e7fff640 1 --2- 172.21.15.42:0/1515342168 >> v2:172.21.15.107:3300/0 conn(0x7f58e80cf160 0x7f58e806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d0003520 con 0x7f58e8161a20 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e6ffd640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80d15f0 0x7f58e80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4166585240 0 0) 0x7f58d0003520 con 0x7f58e8161a20 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80d15f0 msgr2=0x7f58e80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80d15f0 0x7f58e80cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 >> v2:172.21.15.107:3300/0 conn(0x7f58e80cf160 msgr2=0x7f58e806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 --2- 172.21.15.42:0/1515342168 >> v2:172.21.15.107:3300/0 conn(0x7f58e80cf160 0x7f58e806d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e80cfc20 con 0x7f58e8161a20 2024-09-16T01:55:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f58d8001670 con 0x7f58e8161a20 2024-09-16T01:55:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 >> v1:172.21.15.42:6789/0 conn(0x7f58e8161a20 legacy=0x7f58e80d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d00039b0 0x7f58d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80d15f0 0x7f58d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.726+0000 7f58e67fc640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d0004d40 0x7f58d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f58e8161e00 con 0x7f58d00039b0 2024-09-16T01:55:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f58e806d050 con 0x7f58d0004d40 2024-09-16T01:55:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f58d000b9c0 con 0x7f58e80d15f0 2024-09-16T01:55:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e77fe640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d00039b0 0x7f58d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e6ffd640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80d15f0 0x7f58d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e7fff640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d0004d40 0x7f58d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e77fe640 1 -- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80d15f0 msgr2=0x7f58d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e77fe640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80d15f0 0x7f58d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e77fe640 1 -- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d0004d40 msgr2=0x7f58d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e77fe640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d0004d40 0x7f58d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e77fe640 1 -- 172.21.15.42:0/1515342168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d0003520 con 0x7f58d00039b0 2024-09-16T01:55:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.727+0000 7f58e7fff640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d0004d40 0x7f58d00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:45.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58e77fe640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d00039b0 0x7f58d0003dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58d8001050 tx=0x7f58d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c40a6969ff18669 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8007d70 con 0x7f58d00039b0 2024-09-16T01:55:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d8005af0 con 0x7f58d00039b0 2024-09-16T01:55:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58e67fc640 1 -- 172.21.15.42:0/1515342168 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8007070 con 0x7f58d00039b0 2024-09-16T01:55:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1515342168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d00039b0 msgr2=0x7f58d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58ee0e6640 1 --2- 172.21.15.42:0/1515342168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58d00039b0 0x7f58d0003dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58d8001050 tx=0x7f58d0005830 comp rx=0 tx=0).stop 2024-09-16T01:55:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58e7fff640 1 -- 172.21.15.42:0/1515342168 reap_dead start 2024-09-16T01:55:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1515342168 shutdown_connections 2024-09-16T01:55:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1515342168 >> 172.21.15.42:0/1515342168 conn(0x7f58e809d850 msgr2=0x7f58e808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1515342168 shutdown_connections 2024-09-16T01:55:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.728+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1515342168 wait complete. 2024-09-16T01:55:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.730+0000 7f58ee0e6640 1 Processor -- start 2024-09-16T01:55:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.730+0000 7f58ee0e6640 1 -- start start 2024-09-16T01:55:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58ee0e6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00039b0 0x7f58e8158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58ee0e6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58e809fbb0 0x7f58e80ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58ee0e6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80cad10 0x7f58e809ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58ee0e6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f58e80b1040 con 0x7f58e809fbb0 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58ee0e6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f58e806d2f0 con 0x7f58d00039b0 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58ee0e6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f58e80cf5f0 con 0x7f58e80cad10 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58e809fbb0 0x7f58e80ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58e809fbb0 0x7f58e80ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37130/0 (socket says 172.21.15.42:37130) 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e6ffd640 1 -- 172.21.15.42:0/1544228881 learned_addr learned my addr 172.21.15.42:0/1544228881 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e77fe640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00039b0 0x7f58e8158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e7fff640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80cad10 0x7f58e809ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e6ffd640 1 -- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80cad10 msgr2=0x7f58e809ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e6ffd640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80cad10 0x7f58e809ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e6ffd640 1 -- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00039b0 msgr2=0x7f58e8158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e6ffd640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00039b0 0x7f58e8158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e6ffd640 1 -- 172.21.15.42:0/1544228881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e809eb80 con 0x7f58e809fbb0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58e6ffd640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58e809fbb0 0x7f58e80ca7d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0119a0 tx=0x7f58dc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58cffff640 1 -- 172.21.15.42:0/1544228881 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00faf0 con 0x7f58e809fbb0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58cffff640 1 -- 172.21.15.42:0/1544228881 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58dc00fc90 con 0x7f58e809fbb0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1544228881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e8158f60 con 0x7f58e809fbb0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58cffff640 1 -- 172.21.15.42:0/1544228881 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc014440 con 0x7f58e809fbb0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.731+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1544228881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e809f100 con 0x7f58e809fbb0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.732+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1544228881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e80cec20 con 0x7f58e809fbb0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.733+0000 7f58cffff640 1 -- 172.21.15.42:0/1544228881 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f58dc012040 con 0x7f58e809fbb0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.733+0000 7f58cffff640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58d406c2b0 0x7f58d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.733+0000 7f58cffff640 1 -- 172.21.15.42:0/1544228881 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f58dc08b8b0 con 0x7f58e809fbb0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.734+0000 7f58e77fe640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58d406c2b0 0x7f58d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.734+0000 7f58e77fe640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58d406c2b0 0x7f58d406e770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f58d8033000 tx=0x7f58d8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.738+0000 7f58cffff640 1 -- 172.21.15.42:0/1544228881 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58dc019030 con 0x7f58e809fbb0 2024-09-16T01:55:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.917+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1544228881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f58e809f7c0 con 0x7f58e809fbb0 2024-09-16T01:55:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.920+0000 7f58cffff640 1 -- 172.21.15.42:0/1544228881 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f58dc05a220 con 0x7f58e809fbb0 2024-09-16T01:55:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58d406c2b0 msgr2=0x7f58d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58d406c2b0 0x7f58d406e770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f58d8033000 tx=0x7f58d8009030 comp rx=0 tx=0).stop 2024-09-16T01:55:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1544228881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58e809fbb0 msgr2=0x7f58e80ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58e809fbb0 0x7f58e80ca7d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0119a0 tx=0x7f58dc011e60 comp rx=0 tx=0).stop 2024-09-16T01:55:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1544228881 shutdown_connections 2024-09-16T01:55:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f58d406c2b0 0x7f58d406e770 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f58e80cad10 0x7f58e809ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58e809fbb0 0x7f58e80ca7d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 --2- 172.21.15.42:0/1544228881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d00039b0 0x7f58e8158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1544228881 >> 172.21.15.42:0/1544228881 conn(0x7f58e809d850 msgr2=0x7f58e80d4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1544228881 shutdown_connections 2024-09-16T01:55:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:45.922+0000 7f58ee0e6640 1 -- 172.21.15.42:0/1544228881 wait complete. 2024-09-16T01:55:45.934 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:55:45.935 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:55:45.972 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:55:46.027 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:55:46.027 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:55:46.027 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:46.043 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=159 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:55:46.043 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:55:46.044 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:46.062 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:55:46.062 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:55:46.062 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:46.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=159 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:55:46.100 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:55:46.100 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:55:46.119 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:55:46.119 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:55:46.120 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:46.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.240+0000 7f4e0860e640 1 Processor -- start 2024-09-16T01:55:46.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.240+0000 7f4e0860e640 1 -- start start 2024-09-16T01:55:46.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.241+0000 7f4e0860e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4e000d30f0 0x7f4e000b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:46.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.241+0000 7f4e0860e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 0x7f4e0006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:46.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.241+0000 7f4e0860e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e000d3690 con 0x7f4e0015e5f0 2024-09-16T01:55:46.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.241+0000 7f4e0860e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0006d530 con 0x7f4e000d30f0 2024-09-16T01:55:46.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.241+0000 7f4e0860e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4e000d3970 con 0x7f4e000b64c0 2024-09-16T01:55:46.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.241+0000 7f4e063aa640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4e0015e5f0 0x7f4e000d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49084/0 (socket says 172.21.15.42:49084) 2024-09-16T01:55:46.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.241+0000 7f4e063aa640 1 -- 172.21.15.42:0/140705865 learned_addr learned my addr 172.21.15.42:0/140705865 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:46.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.241+0000 7f4e06bab640 1 --2- 172.21.15.42:0/140705865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 0x7f4e0006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:46.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.241+0000 7f4e05ba9640 1 --2- 172.21.15.42:0/140705865 >> v2:172.21.15.107:3300/0 conn(0x7f4e000d30f0 0x7f4e000b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:46.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.242+0000 7f4e053a8640 1 -- 172.21.15.42:0/140705865 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2865426542 0 0) 0x7f4e000d3690 con 0x7f4e0015e5f0 2024-09-16T01:55:46.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.242+0000 7f4e053a8640 1 -- 172.21.15.42:0/140705865 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dec003520 con 0x7f4e0015e5f0 2024-09-16T01:55:46.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.242+0000 7f4e06bab640 1 -- 172.21.15.42:0/140705865 >> v2:172.21.15.107:3300/0 conn(0x7f4e000d30f0 msgr2=0x7f4e000b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:46.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.242+0000 7f4e06bab640 1 --2- 172.21.15.42:0/140705865 >> v2:172.21.15.107:3300/0 conn(0x7f4e000d30f0 0x7f4e000b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:46.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.242+0000 7f4e06bab640 1 -- 172.21.15.42:0/140705865 >> v1:172.21.15.42:6789/0 conn(0x7f4e0015e5f0 legacy=0x7f4e000d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:46.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.242+0000 7f4e06bab640 1 -- 172.21.15.42:0/140705865 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0006cee0 con 0x7f4e000b64c0 2024-09-16T01:55:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e06bab640 1 --2- 172.21.15.42:0/140705865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 0x7f4e0006d9c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009d90 tx=0x7f4df802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c21654d707e1e2b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e053a8640 1 -- 172.21.15.42:0/140705865 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8007740 con 0x7f4e000b64c0 2024-09-16T01:55:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e053a8640 1 -- 172.21.15.42:0/140705865 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df80078e0 con 0x7f4e000b64c0 2024-09-16T01:55:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e053a8640 1 -- 172.21.15.42:0/140705865 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8007c90 con 0x7f4e000b64c0 2024-09-16T01:55:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e0860e640 1 -- 172.21.15.42:0/140705865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 msgr2=0x7f4e0006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e0860e640 1 --2- 172.21.15.42:0/140705865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 0x7f4e0006d9c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009d90 tx=0x7f4df802a660 comp rx=0 tx=0).stop 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e0860e640 1 -- 172.21.15.42:0/140705865 shutdown_connections 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e0860e640 1 --2- 172.21.15.42:0/140705865 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 0x7f4e0006d9c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e0860e640 1 --2- 172.21.15.42:0/140705865 >> v2:172.21.15.107:3300/0 conn(0x7f4e000d30f0 0x7f4e000b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e0860e640 1 -- 172.21.15.42:0/140705865 >> 172.21.15.42:0/140705865 conn(0x7f4e0008bfc0 msgr2=0x7f4e000d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e0860e640 1 -- 172.21.15.42:0/140705865 shutdown_connections 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.243+0000 7f4e0860e640 1 -- 172.21.15.42:0/140705865 wait complete. 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.245+0000 7f4e0860e640 1 Processor -- start 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.245+0000 7f4e0860e640 1 -- start start 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.245+0000 7f4e0860e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 0x7f4e0009e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.245+0000 7f4e0860e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e000d30f0 0x7f4e001508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.245+0000 7f4e0860e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e0015e5f0 0x7f4e0015f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.245+0000 7f4e0860e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0006df00 con 0x7f4e0015e5f0 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.245+0000 7f4e0860e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0015e9d0 con 0x7f4e000d30f0 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.245+0000 7f4e0860e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0006e080 con 0x7f4e000b64c0 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e06bab640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e0015e5f0 0x7f4e0015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e06bab640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e0015e5f0 0x7f4e0015f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37146/0 (socket says 172.21.15.42:37146) 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e063aa640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 0x7f4e0009e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e06bab640 1 -- 172.21.15.42:0/4036370203 learned_addr learned my addr 172.21.15.42:0/4036370203 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e05ba9640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e000d30f0 0x7f4e001508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e06bab640 1 -- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 msgr2=0x7f4e0009e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e06bab640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 0x7f4e0009e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e06bab640 1 -- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e000d30f0 msgr2=0x7f4e001508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:46.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e06bab640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e000d30f0 0x7f4e001508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:46.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e06bab640 1 -- 172.21.15.42:0/4036370203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0009e870 con 0x7f4e0015e5f0 2024-09-16T01:55:46.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e06bab640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e0015e5f0 0x7f4e0015f330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009d90 tx=0x7f4df8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:46.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4df6ffd640 1 -- 172.21.15.42:0/4036370203 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8009450 con 0x7f4e0015e5f0 2024-09-16T01:55:46.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4df6ffd640 1 -- 172.21.15.42:0/4036370203 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df8004240 con 0x7f4e0015e5f0 2024-09-16T01:55:46.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4df6ffd640 1 -- 172.21.15.42:0/4036370203 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8004630 con 0x7f4e0015e5f0 2024-09-16T01:55:46.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e0860e640 1 -- 172.21.15.42:0/4036370203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0009fcd0 con 0x7f4e0015e5f0 2024-09-16T01:55:46.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.246+0000 7f4e0860e640 1 -- 172.21.15.42:0/4036370203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e000a0250 con 0x7f4e0015e5f0 2024-09-16T01:55:46.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.247+0000 7f4e0860e640 1 -- 172.21.15.42:0/4036370203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e000d3690 con 0x7f4e0015e5f0 2024-09-16T01:55:46.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.248+0000 7f4df6ffd640 1 -- 172.21.15.42:0/4036370203 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4df8039040 con 0x7f4e0015e5f0 2024-09-16T01:55:46.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.248+0000 7f4df6ffd640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4de406c2b0 0x7f4de406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:46.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.249+0000 7f4df6ffd640 1 -- 172.21.15.42:0/4036370203 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f4df80ac2a0 con 0x7f4e0015e5f0 2024-09-16T01:55:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.249+0000 7f4e063aa640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4de406c2b0 0x7f4de406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:46.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.249+0000 7f4e063aa640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4de406c2b0 0x7f4de406e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc005880 tx=0x7f4dfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.253+0000 7f4df6ffd640 1 -- 172.21.15.42:0/4036370203 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e0009e870 con 0x7f4e0015e5f0 2024-09-16T01:55:46.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.467+0000 7f4e0860e640 1 -- 172.21.15.42:0/4036370203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e0006db10 con 0x7f4e0015e5f0 2024-09-16T01:55:46.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.467+0000 7f4df6ffd640 1 -- 172.21.15.42:0/4036370203 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3912 (secure 0 0 0) 0x7f4df8040030 con 0x7f4e0015e5f0 2024-09-16T01:55:46.469 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:46.469 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"btime":"2024-09-16T01:55:41:592740+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/920871952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":920871952},{"type":"v1","addr":"172.21.15.42:6835","nonce":920871952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2239532612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2239532612},{"type":"v1","addr":"172.21.15.42:6833","nonce":2239532612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5074,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1529656613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":1529656613},{"type":"v1","addr":"172.21.15.107:6837","nonce":1529656613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/663599658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":663599658},{"type":"v1","addr":"172.21.15.107:6836","nonce":663599658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-09-16T01:55:46.469 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 17 2024-09-16T01:55:46.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 -- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4de406c2b0 msgr2=0x7f4de406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:46.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4de406c2b0 0x7f4de406e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc005880 tx=0x7f4dfc009040 comp rx=0 tx=0).stop 2024-09-16T01:55:46.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 -- 172.21.15.42:0/4036370203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e0015e5f0 msgr2=0x7f4e0015f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:46.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e0015e5f0 0x7f4e0015f330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009d90 tx=0x7f4df8004a40 comp rx=0 tx=0).stop 2024-09-16T01:55:46.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 -- 172.21.15.42:0/4036370203 shutdown_connections 2024-09-16T01:55:46.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4de406c2b0 0x7f4de406e770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:46.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e0015e5f0 0x7f4e0015f330 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:46.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e000d30f0 0x7f4e001508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:46.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 --2- 172.21.15.42:0/4036370203 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4e000b64c0 0x7f4e0009e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:46.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 -- 172.21.15.42:0/4036370203 >> 172.21.15.42:0/4036370203 conn(0x7f4e0008bfc0 msgr2=0x7f4e000b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:46.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 -- 172.21.15.42:0/4036370203 shutdown_connections 2024-09-16T01:55:46.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:46.469+0000 7f4e0860e640 1 -- 172.21.15.42:0/4036370203 wait complete. 2024-09-16T01:55:46.482 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:55:46.482 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:55:46.482 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:55:46.482 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:55:46.483 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:55:46.483 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:55:46.483 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:55:46.483 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:55:46.483 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:55:46.483 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:55:46.484 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:55:46.484 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:55:46.484 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:55:46.484 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:55:46.484 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:55:46.484 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:55:46.493 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:55:46.493 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:55:46.496 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:55:46.496 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:55:46.497 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:55:46.497 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:55:46.536 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:55:46.536 DEBUG:teuthology.parallel:result is None 2024-09-16T01:55:46.538 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:55:46.539 DEBUG:teuthology.parallel:result is None 2024-09-16T01:55:46.539 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:55:46.540 DEBUG:teuthology.parallel:result is None 2024-09-16T01:55:46.612 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-16T01:55:46.622 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-09-16T01:55:46.623 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-09-16T01:55:46.985 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:55:46.988 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:55:51.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-16T01:55:52.493 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:55:52.493 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:55:52.496 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:55:52.497 DEBUG:teuthology.parallel:result is None 2024-09-16T01:55:52.497 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:55:52.586 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-16T01:55:52.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.612+0000 7fa608dc0640 1 Processor -- start 2024-09-16T01:55:52.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.612+0000 7fa608dc0640 1 -- start start 2024-09-16T01:55:52.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.613+0000 7fa608dc0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa60406c320 0x7fa60415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:52.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.613+0000 7fa608dc0640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6040b3570 con 0x7fa6040ae140 2024-09-16T01:55:52.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.613+0000 7fa608dc0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6040b3850 con 0x7fa604145bc0 2024-09-16T01:55:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.614+0000 7fa608dc0640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa6040b3b30 con 0x7fa60406c320 2024-09-16T01:55:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.614+0000 7fa602d9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa6040ae140 0x7fa6040af950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:41170/0 (socket says 172.21.15.42:41170) 2024-09-16T01:55:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.614+0000 7fa602d9d640 1 -- 172.21.15.42:0/3507305936 learned_addr learned my addr 172.21.15.42:0/3507305936 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.614+0000 7fa601d9b640 1 --2- 172.21.15.42:0/3507305936 >> v2:172.21.15.107:3300/0 conn(0x7fa60406c320 0x7fa60415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.614+0000 7fa60159a640 1 -- 172.21.15.42:0/3507305936 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193106384 0 0) 0x7fa6040b3570 con 0x7fa6040ae140 2024-09-16T01:55:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.614+0000 7fa60159a640 1 -- 172.21.15.42:0/3507305936 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5ec003520 con 0x7fa6040ae140 2024-09-16T01:55:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.614+0000 7fa601d9b640 1 -- 172.21.15.42:0/3507305936 >> v1:172.21.15.107:6789/0 conn(0x7fa604145bc0 legacy=0x7fa60406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.614+0000 7fa601d9b640 1 -- 172.21.15.42:0/3507305936 >> v1:172.21.15.42:6789/0 conn(0x7fa6040ae140 legacy=0x7fa6040af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.614+0000 7fa601d9b640 1 -- 172.21.15.42:0/3507305936 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6040b1610 con 0x7fa60406c320 2024-09-16T01:55:52.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.615+0000 7fa601d9b640 1 --2- 172.21.15.42:0/3507305936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa60406c320 0x7fa60415ca70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80097d0 tx=0x7fa5f802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=803c53fdf06d4edb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:52.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.615+0000 7fa60159a640 1 -- 172.21.15.42:0/3507305936 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8037070 con 0x7fa60406c320 2024-09-16T01:55:52.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.615+0000 7fa60159a640 1 -- 172.21.15.42:0/3507305936 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f8032640 con 0x7fa60406c320 2024-09-16T01:55:52.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.615+0000 7fa60159a640 1 -- 172.21.15.42:0/3507305936 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80329f0 con 0x7fa60406c320 2024-09-16T01:55:52.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.616+0000 7fa608dc0640 1 -- 172.21.15.42:0/3507305936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa60406c320 msgr2=0x7fa60415ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:52.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.616+0000 7fa608dc0640 1 --2- 172.21.15.42:0/3507305936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa60406c320 0x7fa60415ca70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80097d0 tx=0x7fa5f802a300 comp rx=0 tx=0).stop 2024-09-16T01:55:52.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.616+0000 7fa608dc0640 1 -- 172.21.15.42:0/3507305936 shutdown_connections 2024-09-16T01:55:52.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.616+0000 7fa608dc0640 1 --2- 172.21.15.42:0/3507305936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa60406c320 0x7fa60415ca70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:52.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.616+0000 7fa608dc0640 1 -- 172.21.15.42:0/3507305936 >> 172.21.15.42:0/3507305936 conn(0x7fa604073490 msgr2=0x7fa6040b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:52.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.616+0000 7fa608dc0640 1 -- 172.21.15.42:0/3507305936 shutdown_connections 2024-09-16T01:55:52.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.616+0000 7fa608dc0640 1 -- 172.21.15.42:0/3507305936 wait complete. 2024-09-16T01:55:52.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.617+0000 7fa608dc0640 1 Processor -- start 2024-09-16T01:55:52.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.618+0000 7fa608dc0640 1 -- start start 2024-09-16T01:55:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.618+0000 7fa608dc0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60406c320 0x7fa60415be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.618+0000 7fa608dc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6040ae140 0x7fa6040ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.618+0000 7fa608dc0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa604145bc0 0x7fa6040cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.618+0000 7fa608dc0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa604145fa0 con 0x7fa60406c320 2024-09-16T01:55:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.618+0000 7fa608dc0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa60409aa30 con 0x7fa6040ae140 2024-09-16T01:55:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.618+0000 7fa608dc0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa60409c3a0 con 0x7fa604145bc0 2024-09-16T01:55:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.618+0000 7fa60259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60406c320 0x7fa60415be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.618+0000 7fa60259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60406c320 0x7fa60415be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35050/0 (socket says 172.21.15.42:35050) 2024-09-16T01:55:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.618+0000 7fa60259c640 1 -- 172.21.15.42:0/1161824359 learned_addr learned my addr 172.21.15.42:0/1161824359 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa601d9b640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6040ae140 0x7fa6040ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa60259c640 1 -- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa604145bc0 msgr2=0x7fa6040cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa60259c640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa604145bc0 0x7fa6040cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa60259c640 1 -- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6040ae140 msgr2=0x7fa6040ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa60259c640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6040ae140 0x7fa6040ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa60259c640 1 -- 172.21.15.42:0/1161824359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6040b5890 con 0x7fa60406c320 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa60259c640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60406c320 0x7fa60415be80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400c400 tx=0x7fa5f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa5f2ffd640 1 -- 172.21.15.42:0/1161824359 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4017070 con 0x7fa60406c320 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa5f2ffd640 1 -- 172.21.15.42:0/1161824359 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f40052d0 con 0x7fa60406c320 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa608dc0640 1 -- 172.21.15.42:0/1161824359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6040b5b70 con 0x7fa60406c320 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa5f2ffd640 1 -- 172.21.15.42:0/1161824359 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4003830 con 0x7fa60406c320 2024-09-16T01:55:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.619+0000 7fa608dc0640 1 -- 172.21.15.42:0/1161824359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6040b6130 con 0x7fa60406c320 2024-09-16T01:55:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.620+0000 7fa608dc0640 1 -- 172.21.15.42:0/1161824359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60415ca70 con 0x7fa60406c320 2024-09-16T01:55:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.621+0000 7fa5f2ffd640 1 -- 172.21.15.42:0/1161824359 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa5f401a070 con 0x7fa60406c320 2024-09-16T01:55:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.621+0000 7fa5f2ffd640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa5e406c2b0 0x7fa5e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.621+0000 7fa5f2ffd640 1 -- 172.21.15.42:0/1161824359 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fa5f408a630 con 0x7fa60406c320 2024-09-16T01:55:52.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.622+0000 7fa601d9b640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa5e406c2b0 0x7fa5e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:52.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.622+0000 7fa601d9b640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa5e406c2b0 0x7fa5e406e770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8034000 tx=0x7fa5f802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:52.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.626+0000 7fa5f2ffd640 1 -- 172.21.15.42:0/1161824359 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5f4058f10 con 0x7fa60406c320 2024-09-16T01:55:52.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:52.819+0000 7fa608dc0640 1 -- 172.21.15.42:0/1161824359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa60415c7d0 con 0x7fa60406c320 2024-09-16T01:55:53.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.637+0000 7fa5f2ffd640 1 -- 172.21.15.42:0/1161824359 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) ==== 97+0+0 (secure 0 0 0) 0x7fa5f4058810 con 0x7fa60406c320 2024-09-16T01:55:53.638 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-16T01:55:53.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 -- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa5e406c2b0 msgr2=0x7fa5e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa5e406c2b0 0x7fa5e406e770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8034000 tx=0x7fa5f802e000 comp rx=0 tx=0).stop 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 -- 172.21.15.42:0/1161824359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60406c320 msgr2=0x7fa60415be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60406c320 0x7fa60415be80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400c400 tx=0x7fa5f400c8c0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 -- 172.21.15.42:0/1161824359 shutdown_connections 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fa5e406c2b0 0x7fa5e406e770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa604145bc0 0x7fa6040cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6040ae140 0x7fa6040ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 --2- 172.21.15.42:0/1161824359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60406c320 0x7fa60415be80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 -- 172.21.15.42:0/1161824359 >> 172.21.15.42:0/1161824359 conn(0x7fa604073490 msgr2=0x7fa60415d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 -- 172.21.15.42:0/1161824359 shutdown_connections 2024-09-16T01:55:53.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.640+0000 7fa608dc0640 1 -- 172.21.15.42:0/1161824359 wait complete. 2024-09-16T01:55:53.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:55:53.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.763+0000 7f9d5c080640 1 Processor -- start 2024-09-16T01:55:53.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.763+0000 7f9d5c080640 1 -- start start 2024-09-16T01:55:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.764+0000 7f9d5c080640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5406df60 0x7f9d5409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.764+0000 7f9d5c080640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9d5409af70 0x7f9d54168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.764+0000 7f9d5c080640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5406cec0 con 0x7f9d5415e5d0 2024-09-16T01:55:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.764+0000 7f9d5c080640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9d5406dad0 con 0x7f9d5409af70 2024-09-16T01:55:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.764+0000 7f9d5c080640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5406d1a0 con 0x7f9d5406df60 2024-09-16T01:55:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d5a61d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9d5409af70 0x7f9d54168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d5961b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5406df60 0x7f9d5409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d59e1c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9d5415e5d0 0x7f9d540d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:58136/0 (socket says 172.21.15.42:58136) 2024-09-16T01:55:53.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d59e1c640 1 -- 172.21.15.42:0/1296576135 learned_addr learned my addr 172.21.15.42:0/1296576135 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:53.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d58e1a640 1 -- 172.21.15.42:0/1296576135 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282468640 0 0) 0x7f9d5406cec0 con 0x7f9d5415e5d0 2024-09-16T01:55:53.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d58e1a640 1 -- 172.21.15.42:0/1296576135 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d40003520 con 0x7f9d5415e5d0 2024-09-16T01:55:53.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d5a61d640 1 -- 172.21.15.42:0/1296576135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5406df60 msgr2=0x7f9d5409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:53.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d5a61d640 1 --2- 172.21.15.42:0/1296576135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5406df60 0x7f9d5409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d5a61d640 1 -- 172.21.15.42:0/1296576135 >> v1:172.21.15.107:6789/0 conn(0x7f9d5415e5d0 legacy=0x7f9d540d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d5a61d640 1 -- 172.21.15.42:0/1296576135 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5406d480 con 0x7f9d5409af70 2024-09-16T01:55:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.765+0000 7f9d5961b640 1 --2- 172.21.15.42:0/1296576135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5406df60 0x7f9d5409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.766+0000 7f9d5a61d640 1 --2- 172.21.15.42:0/1296576135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d5409af70 0x7f9d54168560 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009d90 tx=0x7f9d4c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1399fe39f79b8086 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.766+0000 7f9d58e1a640 1 -- 172.21.15.42:0/1296576135 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c007740 con 0x7f9d5409af70 2024-09-16T01:55:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.766+0000 7f9d58e1a640 1 -- 172.21.15.42:0/1296576135 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0078e0 con 0x7f9d5409af70 2024-09-16T01:55:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.766+0000 7f9d58e1a640 1 -- 172.21.15.42:0/1296576135 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c007cb0 con 0x7f9d5409af70 2024-09-16T01:55:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.767+0000 7f9d5c080640 1 -- 172.21.15.42:0/1296576135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d5409af70 msgr2=0x7f9d54168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.767+0000 7f9d5c080640 1 --2- 172.21.15.42:0/1296576135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d5409af70 0x7f9d54168560 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009d90 tx=0x7f9d4c02a6f0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.767+0000 7f9d5c080640 1 -- 172.21.15.42:0/1296576135 shutdown_connections 2024-09-16T01:55:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.767+0000 7f9d5c080640 1 --2- 172.21.15.42:0/1296576135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d5409af70 0x7f9d54168560 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.767+0000 7f9d5c080640 1 --2- 172.21.15.42:0/1296576135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5406df60 0x7f9d5409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.767+0000 7f9d5c080640 1 -- 172.21.15.42:0/1296576135 >> 172.21.15.42:0/1296576135 conn(0x7f9d540d23a0 msgr2=0x7f9d540d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:53.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.767+0000 7f9d5c080640 1 -- 172.21.15.42:0/1296576135 shutdown_connections 2024-09-16T01:55:53.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.767+0000 7f9d5c080640 1 -- 172.21.15.42:0/1296576135 wait complete. 2024-09-16T01:55:53.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.768+0000 7f9d5c080640 1 Processor -- start 2024-09-16T01:55:53.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.768+0000 7f9d5c080640 1 -- start start 2024-09-16T01:55:53.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d5c080640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5406df60 0x7f9d5415c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:53.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d5c080640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5409af70 0x7f9d541571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:53.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d5c080640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d5415e5d0 0x7f9d540c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d5c080640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9d540d1980 con 0x7f9d5406df60 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d5c080640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9d540d1800 con 0x7f9d5415e5d0 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d5c080640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5415e9b0 con 0x7f9d5409af70 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d59e1c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5406df60 0x7f9d5415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d59e1c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5406df60 0x7f9d5415c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35062/0 (socket says 172.21.15.42:35062) 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d59e1c640 1 -- 172.21.15.42:0/2083595875 learned_addr learned my addr 172.21.15.42:0/2083595875 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d5961b640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5409af70 0x7f9d541571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d5a61d640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d5415e5d0 0x7f9d540c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d59e1c640 1 -- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5409af70 msgr2=0x7f9d541571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d59e1c640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5409af70 0x7f9d541571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d59e1c640 1 -- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d5415e5d0 msgr2=0x7f9d540c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d59e1c640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d5415e5d0 0x7f9d540c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:53.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d59e1c640 1 -- 172.21.15.42:0/2083595875 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5415c860 con 0x7f9d5406df60 2024-09-16T01:55:53.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.769+0000 7f9d59e1c640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5406df60 0x7f9d5415c010 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000c460 tx=0x7f9d5000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:53.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.770+0000 7f9d4a7fc640 1 -- 172.21.15.42:0/2083595875 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50017070 con 0x7f9d5406df60 2024-09-16T01:55:53.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.770+0000 7f9d4a7fc640 1 -- 172.21.15.42:0/2083595875 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d50005ce0 con 0x7f9d5406df60 2024-09-16T01:55:53.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.770+0000 7f9d5c080640 1 -- 172.21.15.42:0/2083595875 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5415cb40 con 0x7f9d5406df60 2024-09-16T01:55:53.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.770+0000 7f9d4a7fc640 1 -- 172.21.15.42:0/2083595875 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50007290 con 0x7f9d5406df60 2024-09-16T01:55:53.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.770+0000 7f9d5c080640 1 -- 172.21.15.42:0/2083595875 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5415d100 con 0x7f9d5406df60 2024-09-16T01:55:53.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.771+0000 7f9d5c080640 1 -- 172.21.15.42:0/2083595875 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d5415dd50 con 0x7f9d5406df60 2024-09-16T01:55:53.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.771+0000 7f9d4a7fc640 1 -- 172.21.15.42:0/2083595875 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9d5001a070 con 0x7f9d5406df60 2024-09-16T01:55:53.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.772+0000 7f9d4a7fc640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9d3806c2b0 0x7f9d3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:53.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.772+0000 7f9d4a7fc640 1 -- 172.21.15.42:0/2083595875 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5249+0+0 (secure 0 0 0) 0x7f9d5008a650 con 0x7f9d5406df60 2024-09-16T01:55:53.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.772+0000 7f9d5961b640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9d3806c2b0 0x7f9d3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:53.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.773+0000 7f9d5961b640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9d3806c2b0 0x7f9d3806e770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d540b1ce0 tx=0x7f9d44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:53.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:53.776+0000 7f9d4a7fc640 1 -- 172.21.15.42:0/2083595875 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d5415dd50 con 0x7f9d5406df60 2024-09-16T01:55:54.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.016+0000 7f9d5c080640 1 -- 172.21.15.42:0/2083595875 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9d540b8320 con 0x7f9d5406df60 2024-09-16T01:55:54.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.017+0000 7f9d4a7fc640 1 -- 172.21.15.42:0/2083595875 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f9d50058f00 con 0x7f9d5406df60 2024-09-16T01:55:54.019 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:54.019 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:55:54.019 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-16T01:55:54.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.019 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-16T01:55:54.019 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmMcjXCxAAT1mJYvmGTz3j/gt9V7UZSg==", 2024-09-16T01:55:54.019 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.019 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmVSvlFxAA+JMa7tU+TmIufSm1H40/nw==", 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-16T01:55:54.020 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmzDcLExAATadyYI33hfeB5hgeHu78rQ==", 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmJPBuHxAAl4Bgbbslzm974J8HK3/0ZA==", 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.023 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-16T01:55:54.023 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCRj+dm608ZChAAlxPChkfdzKXeHCIJ8BHu/w==", 2024-09-16T01:55:54.023 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.023 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:54.023 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:54.023 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.023 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCUj+dmJdZ0DBAA7uQZ9GIuniJqny516zliSw==", 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCXj+dmtAqWHhAAaGW9phi3HiWZRv0OCDonuA==", 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.024 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCaj+dmZSnzIRAAk6WnucLW3q5dz9FKZxhXtA==", 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.025 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQChj+dmxUS9ABAApVKUWA3LGNafeCQDiPKH9w==", 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-16T01:55:54.026 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCkj+dmzCBvAxAAffM0asgUVUoQR8Lkproybg==", 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCnj+dmgHOUFBAAfSU6pxHqw51D/id51CzAww==", 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.028 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.028 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-16T01:55:54.028 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCqj+dmrBcXNBAAPCT+sn6Mx/1J5ItdLD7tbw==", 2024-09-16T01:55:54.028 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.028 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-16T01:55:54.029 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-16T01:55:54.029 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.029 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.029 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-16T01:55:54.029 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dm96TxJBAAoZCGS2uSu2E2+xtA9fj+5g==", 2024-09-16T01:55:54.029 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.029 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:54.030 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-16T01:55:54.030 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T01:55:54.030 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.030 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-16T01:55:54.030 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmkOUKLhAA+aD+mHe1UrKoAJ1cuqb6Yg==", 2024-09-16T01:55:54.030 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.031 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:54.031 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-16T01:55:54.031 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-16T01:55:54.031 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-16T01:55:54.031 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.032 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-16T01:55:54.032 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dm4JjPKhAAvfE6+QyfNHcahc6uzs34Zg==", 2024-09-16T01:55:54.032 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.032 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:54.032 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-16T01:55:54.032 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-16T01:55:54.032 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-16T01:55:54.032 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.033 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-16T01:55:54.033 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dm4eSVMxAAP1P9R5DYorQup0ujBbfe0A==", 2024-09-16T01:55:54.033 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.033 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-16T01:55:54.033 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-16T01:55:54.033 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-16T01:55:54.034 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-16T01:55:54.034 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.034 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-16T01:55:54.034 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCOj+dmooQvKxAARATh0bGqJJM+BLRIoIX3iw==", 2024-09-16T01:55:54.034 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.035 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-16T01:55:54.035 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-16T01:55:54.035 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-16T01:55:54.035 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.035 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.035 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-16T01:55:54.036 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmJqF8CBAACeom3ua2ACe+FRyBfxqCnA==", 2024-09-16T01:55:54.036 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.036 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-16T01:55:54.036 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-16T01:55:54.036 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.036 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-16T01:55:54.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.037 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-16T01:55:54.037 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQCPj+dmvS++BBAAz/uguUBb9FImHUTqjWn+aQ==", 2024-09-16T01:55:54.037 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-16T01:55:54.037 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-16T01:55:54.037 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-16T01:55:54.037 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-16T01:55:54.038 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.038 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.038 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-16T01:55:54.038 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:55:54.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 -- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9d3806c2b0 msgr2=0x7f9d3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9d3806c2b0 0x7f9d3806e770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d540b1ce0 tx=0x7f9d44008040 comp rx=0 tx=0).stop 2024-09-16T01:55:54.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 -- 172.21.15.42:0/2083595875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5406df60 msgr2=0x7f9d5415c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5406df60 0x7f9d5415c010 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000c460 tx=0x7f9d5000c920 comp rx=0 tx=0).stop 2024-09-16T01:55:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 -- 172.21.15.42:0/2083595875 shutdown_connections 2024-09-16T01:55:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9d3806c2b0 0x7f9d3806e770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9d5415e5d0 0x7f9d540c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9d5409af70 0x7f9d541571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 --2- 172.21.15.42:0/2083595875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d5406df60 0x7f9d5415c010 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 -- 172.21.15.42:0/2083595875 >> 172.21.15.42:0/2083595875 conn(0x7f9d540d23a0 msgr2=0x7f9d54149e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 -- 172.21.15.42:0/2083595875 shutdown_connections 2024-09-16T01:55:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.019+0000 7f9d5c080640 1 -- 172.21.15.42:0/2083595875 wait complete. 2024-09-16T01:55:54.042 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:55:54.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.143+0000 7fd9f2647640 1 Processor -- start 2024-09-16T01:55:54.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.143+0000 7fd9f2647640 1 -- start start 2024-09-16T01:55:54.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9f2647640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd9ec15e5f0 0x7fd9ec0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9f2647640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec0d30f0 0x7fd9ec0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9f2647640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd9ec0b64c0 0x7fd9ec0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9f2647640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd9ec06d530 con 0x7fd9ec15e5f0 2024-09-16T01:55:54.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9f2647640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd9ec0d3690 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9f2647640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ec0d3970 con 0x7fd9ec0d30f0 2024-09-16T01:55:54.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9ebfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd9ec15e5f0 0x7fd9ec0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9ebfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd9ec15e5f0 0x7fd9ec0d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35078/0 (socket says 172.21.15.42:35078) 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9ebfff640 1 -- 172.21.15.42:0/2986303577 learned_addr learned my addr 172.21.15.42:0/2986303577 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9eb7fe640 1 --2- 172.21.15.42:0/2986303577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec0d30f0 0x7fd9ec0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9f0be4640 1 --2- 172.21.15.42:0/2986303577 >> v2:172.21.15.107:3300/0 conn(0x7fd9ec0b64c0 0x7fd9ec0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9ebfff640 1 -- 172.21.15.42:0/2986303577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec0d30f0 msgr2=0x7fd9ec0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9ebfff640 1 --2- 172.21.15.42:0/2986303577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec0d30f0 0x7fd9ec0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9ebfff640 1 -- 172.21.15.42:0/2986303577 >> v2:172.21.15.107:3300/0 conn(0x7fd9ec0b64c0 msgr2=0x7fd9ec0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9ebfff640 1 --2- 172.21.15.42:0/2986303577 >> v2:172.21.15.107:3300/0 conn(0x7fd9ec0b64c0 0x7fd9ec0cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.144+0000 7fd9ebfff640 1 -- 172.21.15.42:0/2986303577 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ec06cee0 con 0x7fd9ec15e5f0 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.145+0000 7fd9ebfff640 1 --2- 172.21.15.42:0/2986303577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec15e5f0 0x7fd9ec0d4dd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0a23f0 tx=0x7fd9dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b545c7149b0dd08e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.145+0000 7fd9eaffd640 1 -- 172.21.15.42:0/2986303577 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc037070 con 0x7fd9ec15e5f0 2024-09-16T01:55:54.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.145+0000 7fd9eaffd640 1 -- 172.21.15.42:0/2986303577 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9dc032440 con 0x7fd9ec15e5f0 2024-09-16T01:55:54.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.145+0000 7fd9eaffd640 1 -- 172.21.15.42:0/2986303577 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc032810 con 0x7fd9ec15e5f0 2024-09-16T01:55:54.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.146+0000 7fd9f2647640 1 -- 172.21.15.42:0/2986303577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec15e5f0 msgr2=0x7fd9ec0d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.146+0000 7fd9f2647640 1 --2- 172.21.15.42:0/2986303577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec15e5f0 0x7fd9ec0d4dd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0a23f0 tx=0x7fd9dc02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.146+0000 7fd9f2647640 1 -- 172.21.15.42:0/2986303577 shutdown_connections 2024-09-16T01:55:54.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.146+0000 7fd9f2647640 1 --2- 172.21.15.42:0/2986303577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec0d30f0 0x7fd9ec0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.146+0000 7fd9f2647640 1 --2- 172.21.15.42:0/2986303577 >> v2:172.21.15.107:3300/0 conn(0x7fd9ec0b64c0 0x7fd9ec0cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.146+0000 7fd9f2647640 1 --2- 172.21.15.42:0/2986303577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec15e5f0 0x7fd9ec0d4dd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.146+0000 7fd9f2647640 1 -- 172.21.15.42:0/2986303577 >> 172.21.15.42:0/2986303577 conn(0x7fd9ec08bfc0 msgr2=0x7fd9ec0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:54.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.146+0000 7fd9f2647640 1 -- 172.21.15.42:0/2986303577 shutdown_connections 2024-09-16T01:55:54.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.146+0000 7fd9f2647640 1 -- 172.21.15.42:0/2986303577 wait complete. 2024-09-16T01:55:54.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.147+0000 7fd9f2647640 1 Processor -- start 2024-09-16T01:55:54.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.147+0000 7fd9f2647640 1 -- start start 2024-09-16T01:55:54.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9f2647640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec0b64c0 0x7fd9ec1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9f2647640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec0d30f0 0x7fd9ec0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9f2647640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec15e5f0 0x7fd9ec0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9f2647640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec0d5310 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9f2647640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ec15e9d0 con 0x7fd9ec0d30f0 2024-09-16T01:55:54.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9f2647640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ec0cf540 con 0x7fd9ec15e5f0 2024-09-16T01:55:54.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9ebfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec0b64c0 0x7fd9ec1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9ebfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec0b64c0 0x7fd9ec1588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35084/0 (socket says 172.21.15.42:35084) 2024-09-16T01:55:54.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9ebfff640 1 -- 172.21.15.42:0/3867318708 learned_addr learned my addr 172.21.15.42:0/3867318708 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:54.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9eb7fe640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec0d30f0 0x7fd9ec0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9f0be4640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec15e5f0 0x7fd9ec0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9ebfff640 1 -- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec15e5f0 msgr2=0x7fd9ec0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9ebfff640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec15e5f0 0x7fd9ec0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9ebfff640 1 -- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec0d30f0 msgr2=0x7fd9ec0c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.148+0000 7fd9ebfff640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec0d30f0 0x7fd9ec0c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.149+0000 7fd9ebfff640 1 -- 172.21.15.42:0/3867318708 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ec0b7350 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.149+0000 7fd9f0be4640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec15e5f0 0x7fd9ec0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:54.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.149+0000 7fd9eb7fe640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec0d30f0 0x7fd9ec0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:54.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.149+0000 7fd9ebfff640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec0b64c0 0x7fd9ec1588b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc000c00 tx=0x7fd9dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:54.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.149+0000 7fd9e8ff9640 1 -- 172.21.15.42:0/3867318708 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc041020 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.149+0000 7fd9e8ff9640 1 -- 172.21.15.42:0/3867318708 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0306c0 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.149+0000 7fd9f2647640 1 -- 172.21.15.42:0/3867318708 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ec0b9ba0 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.149+0000 7fd9e8ff9640 1 -- 172.21.15.42:0/3867318708 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc037040 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.149+0000 7fd9f2647640 1 -- 172.21.15.42:0/3867318708 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ec0ba160 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.150+0000 7fd9f2647640 1 -- 172.21.15.42:0/3867318708 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9ec0b5f80 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.151+0000 7fd9e8ff9640 1 -- 172.21.15.42:0/3867318708 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd9dc044020 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.151+0000 7fd9e8ff9640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd9d806c2b0 0x7fd9d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.151+0000 7fd9e8ff9640 1 -- 172.21.15.42:0/3867318708 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5249+0+0 (secure 0 0 0) 0x7fd9dc0abab0 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.151+0000 7fd9eb7fe640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd9d806c2b0 0x7fd9d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.152+0000 7fd9eb7fe640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd9d806c2b0 0x7fd9d806e770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0b6b00 tx=0x7fd9e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:54.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.155+0000 7fd9e8ff9640 1 -- 172.21.15.42:0/3867318708 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9dc04b030 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.336+0000 7fd9f2647640 1 -- 172.21.15.42:0/3867318708 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd9ec0b6c00 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.336+0000 7fd9e8ff9640 1 -- 172.21.15.42:0/3867318708 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) ==== 84+0+65 (secure 0 0 0) 0x7fd9dc07a3e0 con 0x7fd9ec0b64c0 2024-09-16T01:55:54.338 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:54.338 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-16T01:55:54.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-16T01:55:54.338 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-16T01:55:54.338 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-16T01:55:54.338 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-16T01:55:54.339 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-16T01:55:54.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 -- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd9d806c2b0 msgr2=0x7fd9d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd9d806c2b0 0x7fd9d806e770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0b6b00 tx=0x7fd9e0008040 comp rx=0 tx=0).stop 2024-09-16T01:55:54.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 -- 172.21.15.42:0/3867318708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec0b64c0 msgr2=0x7fd9ec1588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec0b64c0 0x7fd9ec1588b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc000c00 tx=0x7fd9dc0046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 -- 172.21.15.42:0/3867318708 shutdown_connections 2024-09-16T01:55:54.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd9d806c2b0 0x7fd9d806e770 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd9ec15e5f0 0x7fd9ec0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec0d30f0 0x7fd9ec0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 --2- 172.21.15.42:0/3867318708 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9ec0b64c0 0x7fd9ec1588b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 -- 172.21.15.42:0/3867318708 >> 172.21.15.42:0/3867318708 conn(0x7fd9ec08bfc0 msgr2=0x7fd9ec0b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:54.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 -- 172.21.15.42:0/3867318708 shutdown_connections 2024-09-16T01:55:54.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.338+0000 7fd9f2647640 1 -- 172.21.15.42:0/3867318708 wait complete. 2024-09-16T01:55:54.351 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:55:54.351 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:55:54.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.457+0000 7fc175b11640 1 Processor -- start 2024-09-16T01:55:54.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.457+0000 7fc175b11640 1 -- start start 2024-09-16T01:55:54.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc175b11640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc170161a20 0x7fc1700d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc175b11640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc1700cf330 0x7fc17006d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc175b11640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1700cf980 con 0x7fc1700d1420 2024-09-16T01:55:54.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc175b11640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fc170161e00 con 0x7fc1700cf330 2024-09-16T01:55:54.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc175b11640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc17006d050 con 0x7fc170161a20 2024-09-16T01:55:54.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc16ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc1700cf330 0x7fc17006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc16effd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc1700d1420 0x7fc1700cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:41180/0 (socket says 172.21.15.42:41180) 2024-09-16T01:55:54.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc16effd640 1 -- 172.21.15.42:0/687584484 learned_addr learned my addr 172.21.15.42:0/687584484 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:54.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc16f7fe640 1 --2- 172.21.15.42:0/687584484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc170161a20 0x7fc1700d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc16ffff640 1 -- 172.21.15.42:0/687584484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc170161a20 msgr2=0x7fc1700d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:54.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc16ffff640 1 --2- 172.21.15.42:0/687584484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc170161a20 0x7fc1700d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc16ffff640 1 -- 172.21.15.42:0/687584484 >> v1:172.21.15.42:6789/0 conn(0x7fc1700d1420 legacy=0x7fc1700cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc16ffff640 1 -- 172.21.15.42:0/687584484 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1700d1800 con 0x7fc1700cf330 2024-09-16T01:55:54.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.458+0000 7fc16e7fc640 1 -- 172.21.15.42:0/687584484 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4083022617 0 0) 0x7fc1700cf980 con 0x7fc1700d1420 2024-09-16T01:55:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.459+0000 7fc16ffff640 1 --2- 172.21.15.42:0/687584484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 0x7fc17006d810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc1700cfb50 tx=0x7fc16802a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548846ef2bb22b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.459+0000 7fc16e7fc640 1 -- 172.21.15.42:0/687584484 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16802ae60 con 0x7fc1700cf330 2024-09-16T01:55:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.459+0000 7fc16e7fc640 1 -- 172.21.15.42:0/687584484 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc168007740 con 0x7fc1700cf330 2024-09-16T01:55:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.459+0000 7fc16e7fc640 1 -- 172.21.15.42:0/687584484 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168007b10 con 0x7fc1700cf330 2024-09-16T01:55:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.460+0000 7fc175b11640 1 -- 172.21.15.42:0/687584484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 msgr2=0x7fc17006d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.460+0000 7fc175b11640 1 --2- 172.21.15.42:0/687584484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 0x7fc17006d810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc1700cfb50 tx=0x7fc16802a640 comp rx=0 tx=0).stop 2024-09-16T01:55:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.460+0000 7fc175b11640 1 -- 172.21.15.42:0/687584484 shutdown_connections 2024-09-16T01:55:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.460+0000 7fc175b11640 1 --2- 172.21.15.42:0/687584484 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 0x7fc17006d810 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.460+0000 7fc175b11640 1 --2- 172.21.15.42:0/687584484 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc170161a20 0x7fc1700d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.460+0000 7fc175b11640 1 -- 172.21.15.42:0/687584484 >> 172.21.15.42:0/687584484 conn(0x7fc17009d850 msgr2=0x7fc17008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.460+0000 7fc175b11640 1 -- 172.21.15.42:0/687584484 shutdown_connections 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.460+0000 7fc175b11640 1 -- 172.21.15.42:0/687584484 wait complete. 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.461+0000 7fc175b11640 1 Processor -- start 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.461+0000 7fc175b11640 1 -- start start 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc175b11640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 0x7fc1700b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc175b11640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1700d1420 0x7fc1700c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc175b11640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc170161a20 0x7fc1701f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc175b11640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc17006d2f0 con 0x7fc1700cf330 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc175b11640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc1700cff00 con 0x7fc170161a20 2024-09-16T01:55:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc175b11640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc1700b1040 con 0x7fc1700d1420 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 0x7fc1700b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 0x7fc1700b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35106/0 (socket says 172.21.15.42:35106) 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16f7fe640 1 -- 172.21.15.42:0/2271855217 learned_addr learned my addr 172.21.15.42:0/2271855217 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16ffff640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc170161a20 0x7fc1701f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16effd640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1700d1420 0x7fc1700c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16f7fe640 1 -- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1700d1420 msgr2=0x7fc1700c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16f7fe640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1700d1420 0x7fc1700c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16f7fe640 1 -- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc170161a20 msgr2=0x7fc1701f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16f7fe640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc170161a20 0x7fc1701f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16f7fe640 1 -- 172.21.15.42:0/2271855217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1700ca410 con 0x7fc1700cf330 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16effd640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1700d1420 0x7fc1700c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc16f7fe640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 0x7fc1700b7320 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc16000e870 tx=0x7fc16000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc157fff640 1 -- 172.21.15.42:0/2271855217 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160017070 con 0x7fc1700cf330 2024-09-16T01:55:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc157fff640 1 -- 172.21.15.42:0/2271855217 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16000c940 con 0x7fc1700cf330 2024-09-16T01:55:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc175b11640 1 -- 172.21.15.42:0/2271855217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1700b4000 con 0x7fc1700cf330 2024-09-16T01:55:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.462+0000 7fc157fff640 1 -- 172.21.15.42:0/2271855217 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16000cd30 con 0x7fc1700cf330 2024-09-16T01:55:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.463+0000 7fc175b11640 1 -- 172.21.15.42:0/2271855217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1700ca120 con 0x7fc1700cf330 2024-09-16T01:55:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.464+0000 7fc175b11640 1 -- 172.21.15.42:0/2271855217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1700b3df0 con 0x7fc1700cf330 2024-09-16T01:55:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.464+0000 7fc157fff640 1 -- 172.21.15.42:0/2271855217 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc16001a070 con 0x7fc1700cf330 2024-09-16T01:55:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.465+0000 7fc157fff640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc15c06c2b0 0x7fc15c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.465+0000 7fc157fff640 1 -- 172.21.15.42:0/2271855217 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5249+0+0 (secure 0 0 0) 0x7fc16008b4e0 con 0x7fc1700cf330 2024-09-16T01:55:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.465+0000 7fc16effd640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc15c06c2b0 0x7fc15c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.465+0000 7fc16effd640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc15c06c2b0 0x7fc15c06e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc17015a620 tx=0x7fc164007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.469+0000 7fc157fff640 1 -- 172.21.15.42:0/2271855217 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc160059e10 con 0x7fc1700cf330 2024-09-16T01:55:54.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:54.646+0000 7fc175b11640 1 -- 172.21.15.42:0/2271855217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc1700d0ee0 con 0x7fc1700cf330 2024-09-16T01:55:55.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.648+0000 7fc157fff640 1 -- 172.21.15.42:0/2271855217 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) ==== 138+0+0 (secure 0 0 0) 0x7fc160059710 con 0x7fc1700cf330 2024-09-16T01:55:55.650 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-16T01:55:55.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.652+0000 7fc175b11640 1 -- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc15c06c2b0 msgr2=0x7fc15c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:55.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.652+0000 7fc175b11640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc15c06c2b0 0x7fc15c06e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc17015a620 tx=0x7fc164007c10 comp rx=0 tx=0).stop 2024-09-16T01:55:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.652+0000 7fc175b11640 1 -- 172.21.15.42:0/2271855217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 msgr2=0x7fc1700b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.652+0000 7fc175b11640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 0x7fc1700b7320 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc16000e870 tx=0x7fc16000ed30 comp rx=0 tx=0).stop 2024-09-16T01:55:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.652+0000 7fc175b11640 1 -- 172.21.15.42:0/2271855217 shutdown_connections 2024-09-16T01:55:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.652+0000 7fc175b11640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc15c06c2b0 0x7fc15c06e770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.652+0000 7fc175b11640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc170161a20 0x7fc1701f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.652+0000 7fc175b11640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc1700d1420 0x7fc1700c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.652+0000 7fc175b11640 1 --2- 172.21.15.42:0/2271855217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1700cf330 0x7fc1700b7320 secure :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc16000e870 tx=0x7fc16000ed30 comp rx=0 tx=0).stop 2024-09-16T01:55:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.652+0000 7fc175b11640 1 -- 172.21.15.42:0/2271855217 >> 172.21.15.42:0/2271855217 conn(0x7fc17009d850 msgr2=0x7fc17008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.653+0000 7fc175b11640 1 -- 172.21.15.42:0/2271855217 shutdown_connections 2024-09-16T01:55:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.653+0000 7fc175b11640 1 -- 172.21.15.42:0/2271855217 wait complete. 2024-09-16T01:55:55.671 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:55:55.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.786+0000 7ff03500e640 1 Processor -- start 2024-09-16T01:55:55.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.786+0000 7ff03500e640 1 -- start start 2024-09-16T01:55:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.787+0000 7ff03500e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff030162340 0x7ff03006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.787+0000 7ff03500e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff030162e30 0x7ff0300d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.787+0000 7ff03500e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff03015ff70 con 0x7ff0300cf280 2024-09-16T01:55:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.787+0000 7ff03500e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff0301632a0 con 0x7ff030162e30 2024-09-16T01:55:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.787+0000 7ff03500e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff03006de90 con 0x7ff030162340 2024-09-16T01:55:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.787+0000 7ff02f59e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff030162e30 0x7ff0300d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.787+0000 7ff02e59c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff0300cf280 0x7ff030162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:41182/0 (socket says 172.21.15.42:41182) 2024-09-16T01:55:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.787+0000 7ff02e59c640 1 -- 172.21.15.42:0/4206722269 learned_addr learned my addr 172.21.15.42:0/4206722269 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.788+0000 7ff02ed9d640 1 --2- 172.21.15.42:0/4206722269 >> v2:172.21.15.107:3300/0 conn(0x7ff030162340 0x7ff03006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.788+0000 7ff02f59e640 1 -- 172.21.15.42:0/4206722269 >> v2:172.21.15.107:3300/0 conn(0x7ff030162340 msgr2=0x7ff03006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.788+0000 7ff02f59e640 1 --2- 172.21.15.42:0/4206722269 >> v2:172.21.15.107:3300/0 conn(0x7ff030162340 0x7ff03006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.788+0000 7ff02f59e640 1 -- 172.21.15.42:0/4206722269 >> v1:172.21.15.42:6789/0 conn(0x7ff0300cf280 legacy=0x7ff030162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.788+0000 7ff02dd9b640 1 -- 172.21.15.42:0/4206722269 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813098357 0 0) 0x7ff03015ff70 con 0x7ff0300cf280 2024-09-16T01:55:55.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.788+0000 7ff02f59e640 1 -- 172.21.15.42:0/4206722269 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0300d4d10 con 0x7ff030162e30 2024-09-16T01:55:55.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.788+0000 7ff02f59e640 1 --2- 172.21.15.42:0/4206722269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 0x7ff0300d2990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff03008e4c0 tx=0x7ff02802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3457dc549725a6ea server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:55.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff02dd9b640 1 -- 172.21.15.42:0/4206722269 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028037070 con 0x7ff030162e30 2024-09-16T01:55:55.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff02dd9b640 1 -- 172.21.15.42:0/4206722269 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028032440 con 0x7ff030162e30 2024-09-16T01:55:55.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff02dd9b640 1 -- 172.21.15.42:0/4206722269 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02802ae60 con 0x7ff030162e30 2024-09-16T01:55:55.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff03500e640 1 -- 172.21.15.42:0/4206722269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 msgr2=0x7ff0300d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:55.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff03500e640 1 --2- 172.21.15.42:0/4206722269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 0x7ff0300d2990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff03008e4c0 tx=0x7ff02802a110 comp rx=0 tx=0).stop 2024-09-16T01:55:55.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff03500e640 1 -- 172.21.15.42:0/4206722269 shutdown_connections 2024-09-16T01:55:55.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff03500e640 1 --2- 172.21.15.42:0/4206722269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 0x7ff0300d2990 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:55.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff03500e640 1 --2- 172.21.15.42:0/4206722269 >> v2:172.21.15.107:3300/0 conn(0x7ff030162340 0x7ff03006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:55.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff03500e640 1 -- 172.21.15.42:0/4206722269 >> 172.21.15.42:0/4206722269 conn(0x7ff03008bfc0 msgr2=0x7ff0300d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:55.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff03500e640 1 -- 172.21.15.42:0/4206722269 shutdown_connections 2024-09-16T01:55:55.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.789+0000 7ff03500e640 1 -- 172.21.15.42:0/4206722269 wait complete. 2024-09-16T01:55:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.791+0000 7ff03500e640 1 Processor -- start 2024-09-16T01:55:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.791+0000 7ff03500e640 1 -- start start 2024-09-16T01:55:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.791+0000 7ff03500e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0300cf280 0x7ff030155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:55.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.791+0000 7ff03500e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff030162340 0x7ff0300b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff03500e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 0x7ff0300cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff03500e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff0300d52d0 con 0x7ff030162e30 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff03500e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff0300d2470 con 0x7ff030162340 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff03500e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff0300cf6c0 con 0x7ff0300cf280 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 0x7ff0300cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02f59e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 0x7ff0300cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35116/0 (socket says 172.21.15.42:35116) 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02f59e640 1 -- 172.21.15.42:0/254877119 learned_addr learned my addr 172.21.15.42:0/254877119 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02ed9d640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0300cf280 0x7ff030155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02e59c640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff030162340 0x7ff0300b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02f59e640 1 -- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0300cf280 msgr2=0x7ff030155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02f59e640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0300cf280 0x7ff030155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:55.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02f59e640 1 -- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff030162340 msgr2=0x7ff0300b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:55.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02f59e640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff030162340 0x7ff0300b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:55.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02f59e640 1 -- 172.21.15.42:0/254877119 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0301f4600 con 0x7ff030162e30 2024-09-16T01:55:55.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff02f59e640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 0x7ff0300cf8d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff028035040 tx=0x7ff0280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:55.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff0277fe640 1 -- 172.21.15.42:0/254877119 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028037050 con 0x7ff030162e30 2024-09-16T01:55:55.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff0277fe640 1 -- 172.21.15.42:0/254877119 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028038040 con 0x7ff030162e30 2024-09-16T01:55:55.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff03500e640 1 -- 172.21.15.42:0/254877119 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0301f48e0 con 0x7ff030162e30 2024-09-16T01:55:55.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff0277fe640 1 -- 172.21.15.42:0/254877119 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028006e10 con 0x7ff030162e30 2024-09-16T01:55:55.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.792+0000 7ff03500e640 1 -- 172.21.15.42:0/254877119 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0301f53c0 con 0x7ff030162e30 2024-09-16T01:55:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.794+0000 7ff03500e640 1 -- 172.21.15.42:0/254877119 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03006d740 con 0x7ff030162e30 2024-09-16T01:55:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.794+0000 7ff0277fe640 1 -- 172.21.15.42:0/254877119 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff028030980 con 0x7ff030162e30 2024-09-16T01:55:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.795+0000 7ff0277fe640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff01006c2e0 0x7ff01006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.795+0000 7ff0277fe640 1 -- 172.21.15.42:0/254877119 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5619+0+0 (secure 0 0 0) 0x7ff0280abed0 con 0x7ff030162e30 2024-09-16T01:55:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.795+0000 7ff02ed9d640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff01006c2e0 0x7ff01006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:55.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.795+0000 7ff02ed9d640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff01006c2e0 0x7ff01006e7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff020003b80 tx=0x7ff0200098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:55.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.799+0000 7ff0277fe640 1 -- 172.21.15.42:0/254877119 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff028032e20 con 0x7ff030162e30 2024-09-16T01:55:55.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:55.976+0000 7ff03500e640 1 -- 172.21.15.42:0/254877119 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff03008e640 con 0x7ff030162e30 2024-09-16T01:55:56.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.654+0000 7ff0277fe640 1 -- 172.21.15.42:0/254877119 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) ==== 170+0+0 (secure 0 0 0) 0x7ff02807a150 con 0x7ff030162e30 2024-09-16T01:55:56.656 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-16T01:55:56.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.657+0000 7ff03500e640 1 -- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff01006c2e0 msgr2=0x7ff01006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:56.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.657+0000 7ff03500e640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff01006c2e0 0x7ff01006e7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff020003b80 tx=0x7ff0200098d0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.657+0000 7ff03500e640 1 -- 172.21.15.42:0/254877119 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 msgr2=0x7ff0300cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.657+0000 7ff03500e640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 0x7ff0300cf8d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff028035040 tx=0x7ff0280046c0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.657+0000 7ff03500e640 1 -- 172.21.15.42:0/254877119 shutdown_connections 2024-09-16T01:55:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.657+0000 7ff03500e640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff01006c2e0 0x7ff01006e7a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.658+0000 7ff03500e640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff030162e30 0x7ff0300cf8d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.658+0000 7ff03500e640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff030162340 0x7ff0300b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.658+0000 7ff03500e640 1 --2- 172.21.15.42:0/254877119 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0300cf280 0x7ff030155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.658+0000 7ff03500e640 1 -- 172.21.15.42:0/254877119 >> 172.21.15.42:0/254877119 conn(0x7ff03008bfc0 msgr2=0x7ff0300d1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.658+0000 7ff03500e640 1 -- 172.21.15.42:0/254877119 shutdown_connections 2024-09-16T01:55:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.658+0000 7ff03500e640 1 -- 172.21.15.42:0/254877119 wait complete. 2024-09-16T01:55:56.685 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:55:56.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.795+0000 7f8b7f3b9640 1 Processor -- start 2024-09-16T01:55:56.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.796+0000 7f8b7f3b9640 1 -- start start 2024-09-16T01:55:56.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.796+0000 7f8b7f3b9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b78162e30 0x7f8b7806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:56.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.796+0000 7f8b7f3b9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b780cf280 0x7f8b780d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:56.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.796+0000 7f8b7f3b9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b7815ff70 con 0x7f8b78162340 2024-09-16T01:55:56.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.796+0000 7f8b7f3b9640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f8b7806de90 con 0x7f8b780cf280 2024-09-16T01:55:56.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.796+0000 7f8b7f3b9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b78163270 con 0x7f8b78162e30 2024-09-16T01:55:56.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.796+0000 7f8b7d956640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b780cf280 0x7f8b780d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:56.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.796+0000 7f8b7d155640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8b78162340 0x7f8b78162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:41184/0 (socket says 172.21.15.42:41184) 2024-09-16T01:55:56.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.797+0000 7f8b7d155640 1 -- 172.21.15.42:0/111553201 learned_addr learned my addr 172.21.15.42:0/111553201 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:56.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.797+0000 7f8b7c954640 1 --2- 172.21.15.42:0/111553201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b78162e30 0x7f8b7806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:56.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.797+0000 7f8b7d956640 1 -- 172.21.15.42:0/111553201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b78162e30 msgr2=0x7f8b7806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:56.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.797+0000 7f8b7d956640 1 --2- 172.21.15.42:0/111553201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b78162e30 0x7f8b7806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.797+0000 7f8b7d956640 1 -- 172.21.15.42:0/111553201 >> v1:172.21.15.42:6789/0 conn(0x7f8b78162340 legacy=0x7f8b78162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:56.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.797+0000 7f8b7d956640 1 -- 172.21.15.42:0/111553201 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b780d4d10 con 0x7f8b780cf280 2024-09-16T01:55:56.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.797+0000 7f8b77fff640 1 -- 172.21.15.42:0/111553201 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2791512805 0 0) 0x7f8b7815ff70 con 0x7f8b78162340 2024-09-16T01:55:56.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b7d956640 1 --2- 172.21.15.42:0/111553201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b780cf280 0x7f8b780d2990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009d90 tx=0x7f8b6802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cfe4dba8362686 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:56.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b77fff640 1 -- 172.21.15.42:0/111553201 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68031600 con 0x7f8b780cf280 2024-09-16T01:55:56.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b77fff640 1 -- 172.21.15.42:0/111553201 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b680317a0 con 0x7f8b780cf280 2024-09-16T01:55:56.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b77fff640 1 -- 172.21.15.42:0/111553201 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68031b70 con 0x7f8b780cf280 2024-09-16T01:55:56.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/111553201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b780cf280 msgr2=0x7f8b780d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:56.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b7f3b9640 1 --2- 172.21.15.42:0/111553201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b780cf280 0x7f8b780d2990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009d90 tx=0x7f8b6802a5d0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/111553201 shutdown_connections 2024-09-16T01:55:56.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b7f3b9640 1 --2- 172.21.15.42:0/111553201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b780cf280 0x7f8b780d2990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b7f3b9640 1 --2- 172.21.15.42:0/111553201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b78162e30 0x7f8b7806d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/111553201 >> 172.21.15.42:0/111553201 conn(0x7f8b7808bfc0 msgr2=0x7f8b780d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:56.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/111553201 shutdown_connections 2024-09-16T01:55:56.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.798+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/111553201 wait complete. 2024-09-16T01:55:56.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7f3b9640 1 Processor -- start 2024-09-16T01:55:56.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7f3b9640 1 -- start start 2024-09-16T01:55:56.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7f3b9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b780cf280 0x7f8b780cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:56.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7f3b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b78162340 0x7f8b780c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:56.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7f3b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b78162e30 0x7f8b780b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:56.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7f3b9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b780cf710 con 0x7f8b78162e30 2024-09-16T01:55:56.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7f3b9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8b780d2470 con 0x7f8b78162340 2024-09-16T01:55:56.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7f3b9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b780d52d0 con 0x7f8b780cf280 2024-09-16T01:55:56.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7d956640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b78162e30 0x7f8b780b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7d956640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b78162e30 0x7f8b780b20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35146/0 (socket says 172.21.15.42:35146) 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.800+0000 7f8b7d956640 1 -- 172.21.15.42:0/4020694255 learned_addr learned my addr 172.21.15.42:0/4020694255 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b7d155640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b780cf280 0x7f8b780cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b7c954640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b78162340 0x7f8b780c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b7d956640 1 -- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b780cf280 msgr2=0x7f8b780cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b7d956640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b780cf280 0x7f8b780cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b7d956640 1 -- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b78162340 msgr2=0x7f8b780c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b7d956640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b78162340 0x7f8b780c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b7d956640 1 -- 172.21.15.42:0/4020694255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b780b3180 con 0x7f8b78162e30 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b7d956640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b78162e30 0x7f8b780b20d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8b6802abc0 tx=0x7f8b68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b75ffb640 1 -- 172.21.15.42:0/4020694255 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68040070 con 0x7f8b78162e30 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b75ffb640 1 -- 172.21.15.42:0/4020694255 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b68030b60 con 0x7f8b78162e30 2024-09-16T01:55:56.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/4020694255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b780b3460 con 0x7f8b78162e30 2024-09-16T01:55:56.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b75ffb640 1 -- 172.21.15.42:0/4020694255 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68009450 con 0x7f8b78162e30 2024-09-16T01:55:56.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.801+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/4020694255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b78158e90 con 0x7f8b78162e30 2024-09-16T01:55:56.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.802+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/4020694255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7806d740 con 0x7f8b78162e30 2024-09-16T01:55:56.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.803+0000 7f8b75ffb640 1 -- 172.21.15.42:0/4020694255 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8b68039040 con 0x7f8b78162e30 2024-09-16T01:55:56.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.803+0000 7f8b75ffb640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b6406c2e0 0x7f8b6406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:56.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.803+0000 7f8b75ffb640 1 -- 172.21.15.42:0/4020694255 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6001+0+0 (secure 0 0 0) 0x7f8b680acc80 con 0x7f8b78162e30 2024-09-16T01:55:56.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.804+0000 7f8b7d155640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b6406c2e0 0x7f8b6406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:56.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.804+0000 7f8b7d155640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b6406c2e0 0x7f8b6406e7a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000f60 tx=0x7f8b70007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:56.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:56.808+0000 7f8b75ffb640 1 -- 172.21.15.42:0/4020694255 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b6807abd0 con 0x7f8b78162e30 2024-09-16T01:55:57.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.019+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/4020694255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8b780b3630 con 0x7f8b78162e30 2024-09-16T01:55:57.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.656+0000 7f8b75ffb640 1 -- 172.21.15.42:0/4020694255 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) ==== 172+0+0 (secure 0 0 0) 0x7f8b6807eed0 con 0x7f8b78162e30 2024-09-16T01:55:57.658 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 7 and data pool 8 2024-09-16T01:55:57.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.664+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b6406c2e0 msgr2=0x7f8b6406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:57.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.664+0000 7f8b7f3b9640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b6406c2e0 0x7f8b6406e7a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000f60 tx=0x7f8b70007d50 comp rx=0 tx=0).stop 2024-09-16T01:55:57.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.664+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/4020694255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b78162e30 msgr2=0x7f8b780b20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:57.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.664+0000 7f8b7f3b9640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b78162e30 0x7f8b780b20d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8b6802abc0 tx=0x7f8b68004a40 comp rx=0 tx=0).stop 2024-09-16T01:55:57.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.664+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/4020694255 shutdown_connections 2024-09-16T01:55:57.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.664+0000 7f8b7f3b9640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f8b6406c2e0 0x7f8b6406e7a0 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000f60 tx=0x7f8b70007d50 comp rx=0 tx=0).stop 2024-09-16T01:55:57.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.664+0000 7f8b7f3b9640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b78162e30 0x7f8b780b20d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:57.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.664+0000 7f8b7f3b9640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b78162340 0x7f8b780c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:57.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.664+0000 7f8b7f3b9640 1 --2- 172.21.15.42:0/4020694255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b780cf280 0x7f8b780cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:57.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.664+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/4020694255 >> 172.21.15.42:0/4020694255 conn(0x7f8b7808bfc0 msgr2=0x7f8b780d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:57.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.665+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/4020694255 shutdown_connections 2024-09-16T01:55:57.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.665+0000 7f8b7f3b9640 1 -- 172.21.15.42:0/4020694255 wait complete. 2024-09-16T01:55:57.700 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:55:57.801 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-16T01:55:57.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.805+0000 7f9a664d0640 1 Processor -- start 2024-09-16T01:55:57.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.805+0000 7f9a664d0640 1 -- start start 2024-09-16T01:55:57.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.806+0000 7f9a664d0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 0x7f9a600d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:57.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.806+0000 7f9a664d0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9a600d30f0 0x7f9a600b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:57.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.806+0000 7f9a664d0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a600d3690 con 0x7f9a600b64c0 2024-09-16T01:55:57.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.806+0000 7f9a664d0640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9a6006d530 con 0x7f9a600d30f0 2024-09-16T01:55:57.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.806+0000 7f9a664d0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9a600d3970 con 0x7f9a6015e5f0 2024-09-16T01:55:57.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.806+0000 7f9a5ffff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 0x7f9a600d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:57.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.806+0000 7f9a5f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9a600d30f0 0x7f9a600b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:57.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.806+0000 7f9a64a6d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9a600b64c0 0x7f9a600cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:58152/0 (socket says 172.21.15.42:58152) 2024-09-16T01:55:57.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.806+0000 7f9a64a6d640 1 -- 172.21.15.42:0/3317437001 learned_addr learned my addr 172.21.15.42:0/3317437001 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:57.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.807+0000 7f9a5f7fe640 1 -- 172.21.15.42:0/3317437001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 msgr2=0x7f9a600d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:57.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.807+0000 7f9a5f7fe640 1 --2- 172.21.15.42:0/3317437001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 0x7f9a600d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:57.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.807+0000 7f9a5f7fe640 1 -- 172.21.15.42:0/3317437001 >> v1:172.21.15.107:6789/0 conn(0x7f9a600b64c0 legacy=0x7f9a600cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:57.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.807+0000 7f9a5f7fe640 1 -- 172.21.15.42:0/3317437001 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6006cee0 con 0x7f9a600d30f0 2024-09-16T01:55:57.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.807+0000 7f9a5effd640 1 -- 172.21.15.42:0/3317437001 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537105748 0 0) 0x7f9a600d3690 con 0x7f9a600b64c0 2024-09-16T01:55:57.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.807+0000 7f9a5ffff640 1 --2- 172.21.15.42:0/3317437001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 0x7f9a600d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:57.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.807+0000 7f9a5f7fe640 1 --2- 172.21.15.42:0/3317437001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a600d30f0 0x7f9a600b5f80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9a480097a0 tx=0x7f9a4802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4b5c1b1beabe09a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:57.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a5effd640 1 -- 172.21.15.42:0/3317437001 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48037070 con 0x7f9a600d30f0 2024-09-16T01:55:57.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a5effd640 1 -- 172.21.15.42:0/3317437001 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a48032440 con 0x7f9a600d30f0 2024-09-16T01:55:57.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a5effd640 1 -- 172.21.15.42:0/3317437001 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48032810 con 0x7f9a600d30f0 2024-09-16T01:55:57.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a664d0640 1 -- 172.21.15.42:0/3317437001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a600d30f0 msgr2=0x7f9a600b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:57.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a664d0640 1 --2- 172.21.15.42:0/3317437001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a600d30f0 0x7f9a600b5f80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9a480097a0 tx=0x7f9a4802a180 comp rx=0 tx=0).stop 2024-09-16T01:55:57.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a664d0640 1 -- 172.21.15.42:0/3317437001 shutdown_connections 2024-09-16T01:55:57.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a664d0640 1 --2- 172.21.15.42:0/3317437001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a600d30f0 0x7f9a600b5f80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:57.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a664d0640 1 --2- 172.21.15.42:0/3317437001 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 0x7f9a600d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:57.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a664d0640 1 -- 172.21.15.42:0/3317437001 >> 172.21.15.42:0/3317437001 conn(0x7f9a6008bfc0 msgr2=0x7f9a600d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:57.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a664d0640 1 -- 172.21.15.42:0/3317437001 shutdown_connections 2024-09-16T01:55:57.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.808+0000 7f9a664d0640 1 -- 172.21.15.42:0/3317437001 wait complete. 2024-09-16T01:55:57.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.809+0000 7f9a664d0640 1 Processor -- start 2024-09-16T01:55:57.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.810+0000 7f9a664d0640 1 -- start start 2024-09-16T01:55:57.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.810+0000 7f9a664d0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a600b64c0 0x7f9a6014c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:57.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.810+0000 7f9a664d0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a600d30f0 0x7f9a600b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:57.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.810+0000 7f9a664d0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 0x7f9a600b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.810+0000 7f9a664d0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9a600d5310 con 0x7f9a600b64c0 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.810+0000 7f9a664d0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6015e9d0 con 0x7f9a600d30f0 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.810+0000 7f9a664d0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9a6006e9d0 con 0x7f9a6015e5f0 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.810+0000 7f9a5ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a600b64c0 0x7f9a6014c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.810+0000 7f9a5ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a600b64c0 0x7f9a6014c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35154/0 (socket says 172.21.15.42:35154) 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.810+0000 7f9a5ffff640 1 -- 172.21.15.42:0/3630688814 learned_addr learned my addr 172.21.15.42:0/3630688814 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5f7fe640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a600d30f0 0x7f9a600b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a64a6d640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 0x7f9a600b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5ffff640 1 -- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 msgr2=0x7f9a600b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5ffff640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 0x7f9a600b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5ffff640 1 -- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a600d30f0 msgr2=0x7f9a600b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5ffff640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a600d30f0 0x7f9a600b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5ffff640 1 -- 172.21.15.42:0/3630688814 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6014f8d0 con 0x7f9a600b64c0 2024-09-16T01:55:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5f7fe640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a600d30f0 0x7f9a600b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:55:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5ffff640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a600b64c0 0x7f9a6014c2a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000e960 tx=0x7f9a5000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5cff9640 1 -- 172.21.15.42:0/3630688814 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50017070 con 0x7f9a600b64c0 2024-09-16T01:55:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a664d0640 1 -- 172.21.15.42:0/3630688814 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a600cb770 con 0x7f9a600b64c0 2024-09-16T01:55:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5cff9640 1 -- 172.21.15.42:0/3630688814 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5000ca00 con 0x7f9a600b64c0 2024-09-16T01:55:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a5cff9640 1 -- 172.21.15.42:0/3630688814 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000cdd0 con 0x7f9a600b64c0 2024-09-16T01:55:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.811+0000 7f9a664d0640 1 -- 172.21.15.42:0/3630688814 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a600cbd30 con 0x7f9a600b64c0 2024-09-16T01:55:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.812+0000 7f9a664d0640 1 -- 172.21.15.42:0/3630688814 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a600d3690 con 0x7f9a600b64c0 2024-09-16T01:55:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.813+0000 7f9a5cff9640 1 -- 172.21.15.42:0/3630688814 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a5001a070 con 0x7f9a600b64c0 2024-09-16T01:55:57.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.813+0000 7f9a5cff9640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9a4006c2e0 0x7f9a4006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:57.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.813+0000 7f9a5cff9640 1 -- 172.21.15.42:0/3630688814 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f9a5008b7f0 con 0x7f9a600b64c0 2024-09-16T01:55:57.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.814+0000 7f9a5f7fe640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9a4006c2e0 0x7f9a4006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:57.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.814+0000 7f9a5f7fe640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9a4006c2e0 0x7f9a4006e7a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9a48034000 tx=0x7f9a4802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:57.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.818+0000 7f9a5cff9640 1 -- 172.21.15.42:0/3630688814 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a500596f0 con 0x7f9a600b64c0 2024-09-16T01:55:57.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.994+0000 7f9a664d0640 1 -- 172.21.15.42:0/3630688814 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a600b4770 con 0x7f9a600b64c0 2024-09-16T01:55:57.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.996+0000 7f9a5cff9640 1 -- 172.21.15.42:0/3630688814 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+17003 (secure 0 0 0) 0x7f9a5005d9f0 con 0x7f9a600b64c0 2024-09-16T01:55:57.997 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:57.997 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":49,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:57.020826+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:55:54.676980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-16T01:55:56.007224+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:55:57.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 -- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9a4006c2e0 msgr2=0x7f9a4006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9a4006c2e0 0x7f9a4006e7a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9a48034000 tx=0x7f9a4802e000 comp rx=0 tx=0).stop 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 -- 172.21.15.42:0/3630688814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a600b64c0 msgr2=0x7f9a6014c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a600b64c0 0x7f9a6014c2a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000e960 tx=0x7f9a5000ee20 comp rx=0 tx=0).stop 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 -- 172.21.15.42:0/3630688814 shutdown_connections 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f9a4006c2e0 0x7f9a4006e7a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9a6015e5f0 0x7f9a600b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a600d30f0 0x7f9a600b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 --2- 172.21.15.42:0/3630688814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a600b64c0 0x7f9a6014c2a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 -- 172.21.15.42:0/3630688814 >> 172.21.15.42:0/3630688814 conn(0x7f9a6008bfc0 msgr2=0x7f9a600b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 -- 172.21.15.42:0/3630688814 shutdown_connections 2024-09-16T01:55:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:57.998+0000 7f9a664d0640 1 -- 172.21.15.42:0/3630688814 wait complete. 2024-09-16T01:55:58.011 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:55:58.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.112+0000 7f66f379f640 1 Processor -- start 2024-09-16T01:55:58.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.112+0000 7f66f379f640 1 -- start start 2024-09-16T01:55:58.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f379f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec147360 0x7f66ec070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f379f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f66ec070dd0 0x7f66ec0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f379f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f66ec0d09e0 0x7f66ec06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f379f640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f66ec06cb30 con 0x7f66ec0d09e0 2024-09-16T01:55:58.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f379f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f66ec0d0e30 con 0x7f66ec070dd0 2024-09-16T01:55:58.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f379f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f66ec06bfb0 con 0x7f66ec147360 2024-09-16T01:55:58.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f1d3c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f66ec0d09e0 0x7f66ec06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f1d3c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f66ec0d09e0 0x7f66ec06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49084/0 (socket says 172.21.15.42:49084) 2024-09-16T01:55:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f1d3c640 1 -- 172.21.15.42:0/1230956317 learned_addr learned my addr 172.21.15.42:0/1230956317 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f153b640 1 --2- 172.21.15.42:0/1230956317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec147360 0x7f66ec070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f0d3a640 1 --2- 172.21.15.42:0/1230956317 >> v2:172.21.15.107:3300/0 conn(0x7f66ec070dd0 0x7f66ec0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f1d3c640 1 -- 172.21.15.42:0/1230956317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec147360 msgr2=0x7f66ec070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f1d3c640 1 --2- 172.21.15.42:0/1230956317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec147360 0x7f66ec070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f1d3c640 1 -- 172.21.15.42:0/1230956317 >> v2:172.21.15.107:3300/0 conn(0x7f66ec070dd0 msgr2=0x7f66ec0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f1d3c640 1 --2- 172.21.15.42:0/1230956317 >> v2:172.21.15.107:3300/0 conn(0x7f66ec070dd0 0x7f66ec0d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.113+0000 7f66f1d3c640 1 -- 172.21.15.42:0/1230956317 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec06c290 con 0x7f66ec0d09e0 2024-09-16T01:55:58.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.114+0000 7f66f1d3c640 1 --2- 172.21.15.42:0/1230956317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 0x7f66ec06f060 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0ced90 tx=0x7f66e402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3192c4706f2dc9b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:58.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.114+0000 7f66e3fff640 1 -- 172.21.15.42:0/1230956317 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4036070 con 0x7f66ec0d09e0 2024-09-16T01:55:58.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.114+0000 7f66e3fff640 1 -- 172.21.15.42:0/1230956317 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e4031600 con 0x7f66ec0d09e0 2024-09-16T01:55:58.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.114+0000 7f66e3fff640 1 -- 172.21.15.42:0/1230956317 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e40319d0 con 0x7f66ec0d09e0 2024-09-16T01:55:58.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.115+0000 7f66f379f640 1 -- 172.21.15.42:0/1230956317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 msgr2=0x7f66ec06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.115+0000 7f66f379f640 1 --2- 172.21.15.42:0/1230956317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 0x7f66ec06f060 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0ced90 tx=0x7f66e402a610 comp rx=0 tx=0).stop 2024-09-16T01:55:58.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.115+0000 7f66f379f640 1 -- 172.21.15.42:0/1230956317 shutdown_connections 2024-09-16T01:55:58.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.115+0000 7f66f379f640 1 --2- 172.21.15.42:0/1230956317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 0x7f66ec06f060 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.115+0000 7f66f379f640 1 --2- 172.21.15.42:0/1230956317 >> v2:172.21.15.107:3300/0 conn(0x7f66ec070dd0 0x7f66ec0d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.115+0000 7f66f379f640 1 --2- 172.21.15.42:0/1230956317 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec147360 0x7f66ec070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.115+0000 7f66f379f640 1 -- 172.21.15.42:0/1230956317 >> 172.21.15.42:0/1230956317 conn(0x7f66ec0b2f40 msgr2=0x7f66ec0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:58.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.115+0000 7f66f379f640 1 -- 172.21.15.42:0/1230956317 shutdown_connections 2024-09-16T01:55:58.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.115+0000 7f66f379f640 1 -- 172.21.15.42:0/1230956317 wait complete. 2024-09-16T01:55:58.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.116+0000 7f66f379f640 1 Processor -- start 2024-09-16T01:55:58.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.116+0000 7f66f379f640 1 -- start start 2024-09-16T01:55:58.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f379f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec070dd0 0x7f66ec158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f379f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 0x7f66ec141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f379f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ec147360 0x7f66ec1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f379f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec06bc10 con 0x7f66ec0d09e0 2024-09-16T01:55:58.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f379f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec06c850 con 0x7f66ec147360 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f379f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f66ec06bd90 con 0x7f66ec070dd0 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f0d3a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 0x7f66ec141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f0d3a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 0x7f66ec141340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49086/0 (socket says 172.21.15.42:49086) 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f0d3a640 1 -- 172.21.15.42:0/2058885430 learned_addr learned my addr 172.21.15.42:0/2058885430 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f1d3c640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ec147360 0x7f66ec1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f153b640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec070dd0 0x7f66ec158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f0d3a640 1 -- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec070dd0 msgr2=0x7f66ec158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f0d3a640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec070dd0 0x7f66ec158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f0d3a640 1 -- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ec147360 msgr2=0x7f66ec1461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f0d3a640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ec147360 0x7f66ec1461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f0d3a640 1 -- 172.21.15.42:0/2058885430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec15bde0 con 0x7f66ec0d09e0 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f153b640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec070dd0 0x7f66ec158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:58.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f1d3c640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ec147360 0x7f66ec1461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.117+0000 7f66f0d3a640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 0x7f66ec141340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e870 tx=0x7f66dc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.118+0000 7f66e1ffb640 1 -- 172.21.15.42:0/2058885430 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc017070 con 0x7f66ec0d09e0 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.118+0000 7f66e1ffb640 1 -- 172.21.15.42:0/2058885430 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc00ee60 con 0x7f66ec0d09e0 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.118+0000 7f66f379f640 1 -- 172.21.15.42:0/2058885430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ec15b540 con 0x7f66ec0d09e0 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.118+0000 7f66e1ffb640 1 -- 172.21.15.42:0/2058885430 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00cb60 con 0x7f66ec0d09e0 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.118+0000 7f66f379f640 1 -- 172.21.15.42:0/2058885430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ec15bb00 con 0x7f66ec0d09e0 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.119+0000 7f66f379f640 1 -- 172.21.15.42:0/2058885430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ec0d04a0 con 0x7f66ec0d09e0 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.119+0000 7f66e1ffb640 1 -- 172.21.15.42:0/2058885430 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f66dc01a070 con 0x7f66ec0d09e0 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.120+0000 7f66e1ffb640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f66d006c2b0 0x7f66d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.120+0000 7f66e1ffb640 1 -- 172.21.15.42:0/2058885430 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f66dc08b450 con 0x7f66ec0d09e0 2024-09-16T01:55:58.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.120+0000 7f66f153b640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f66d006c2b0 0x7f66d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.121+0000 7f66f153b640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f66d006c2b0 0x7f66d006e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009b90 tx=0x7f66e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:58.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.124+0000 7f66e1ffb640 1 -- 172.21.15.42:0/2058885430 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66dc059990 con 0x7f66ec0d09e0 2024-09-16T01:55:58.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.300+0000 7f66f379f640 1 -- 172.21.15.42:0/2058885430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66ec0b2110 con 0x7f66ec0d09e0 2024-09-16T01:55:58.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.301+0000 7f66e1ffb640 1 -- 172.21.15.42:0/2058885430 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+17003 (secure 0 0 0) 0x7f66dc059290 con 0x7f66ec0d09e0 2024-09-16T01:55:58.303 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:55:58.303 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":49,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:57.020826+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:55:54.676980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-16T01:55:56.007224+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:55:58.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 -- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f66d006c2b0 msgr2=0x7f66d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f66d006c2b0 0x7f66d006e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009b90 tx=0x7f66e8008040 comp rx=0 tx=0).stop 2024-09-16T01:55:58.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 -- 172.21.15.42:0/2058885430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 msgr2=0x7f66ec141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 0x7f66ec141340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e870 tx=0x7f66dc00ed30 comp rx=0 tx=0).stop 2024-09-16T01:55:58.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 -- 172.21.15.42:0/2058885430 shutdown_connections 2024-09-16T01:55:58.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f66d006c2b0 0x7f66d006e770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66ec147360 0x7f66ec1461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66ec0d09e0 0x7f66ec141340 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 --2- 172.21.15.42:0/2058885430 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f66ec070dd0 0x7f66ec158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 -- 172.21.15.42:0/2058885430 >> 172.21.15.42:0/2058885430 conn(0x7f66ec0b2f40 msgr2=0x7f66ec142d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:58.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 -- 172.21.15.42:0/2058885430 shutdown_connections 2024-09-16T01:55:58.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.303+0000 7f66f379f640 1 -- 172.21.15.42:0/2058885430 wait complete. 2024-09-16T01:55:58.316 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:55:58.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.420+0000 7f0310749640 1 Processor -- start 2024-09-16T01:55:58.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.420+0000 7f0310749640 1 -- start start 2024-09-16T01:55:58.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.421+0000 7f0310749640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0308162e30 0x7f030806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.421+0000 7f0310749640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080cf280 0x7f03080d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.421+0000 7f0310749640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f030815ff70 con 0x7f0308162340 2024-09-16T01:55:58.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.421+0000 7f0310749640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f030806de90 con 0x7f0308162e30 2024-09-16T01:55:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.421+0000 7f0310749640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0308163270 con 0x7f03080cf280 2024-09-16T01:55:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.421+0000 7f030e4e5640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0308162340 0x7f0308162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52724/0 (socket says 172.21.15.42:52724) 2024-09-16T01:55:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.421+0000 7f030e4e5640 1 -- 172.21.15.42:0/4278015420 learned_addr learned my addr 172.21.15.42:0/4278015420 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681375780 0 0) 0x7f030815ff70 con 0x7f0308162340 2024-09-16T01:55:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030dce4640 1 --2- 172.21.15.42:0/4278015420 >> v2:172.21.15.107:3300/0 conn(0x7f0308162e30 0x7f030806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02f0003520 con 0x7f0308162340 2024-09-16T01:55:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030ece6640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080cf280 0x7f03080d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 121296148 0 0) 0x7f02f0003520 con 0x7f0308162340 2024-09-16T01:55:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080cf280 msgr2=0x7f03080d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:58.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080cf280 0x7f03080d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 >> v2:172.21.15.107:3300/0 conn(0x7f0308162e30 msgr2=0x7f030806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:58.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 --2- 172.21.15.42:0/4278015420 >> v2:172.21.15.107:3300/0 conn(0x7f0308162e30 0x7f030806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03080d4d10 con 0x7f0308162340 2024-09-16T01:55:58.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f0300001670 con 0x7f0308162340 2024-09-16T01:55:58.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 >> v1:172.21.15.42:6789/0 conn(0x7f0308162340 legacy=0x7f0308162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080cf280 0x7f02f00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02f0003f30 0x7f02f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0004d40 0x7f02f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f030806de90 con 0x7f02f0003f30 2024-09-16T01:55:58.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0308163270 con 0x7f02f0004d40 2024-09-16T01:55:58.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f02f000ba10 con 0x7f03080cf280 2024-09-16T01:55:58.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030dce4640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02f0003f30 0x7f02f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030e4e5640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080cf280 0x7f02f00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030ece6640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0004d40 0x7f02f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030dce4640 1 -- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080cf280 msgr2=0x7f02f00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030dce4640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080cf280 0x7f02f00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030dce4640 1 -- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0004d40 msgr2=0x7f02f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030dce4640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0004d40 0x7f02f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030dce4640 1 -- 172.21.15.42:0/4278015420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f0003520 con 0x7f02f0003f30 2024-09-16T01:55:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030ece6640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0004d40 0x7f02f00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.422+0000 7f030e4e5640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080cf280 0x7f02f00039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.423+0000 7f030dce4640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02f0003f30 0x7f02f0004800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009ae0 tx=0x7f02f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc22042de9fc212d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.423+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc036070 con 0x7f02f0003f30 2024-09-16T01:55:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.423+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02fc005990 con 0x7f02f0003f30 2024-09-16T01:55:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.423+0000 7f030d4e3640 1 -- 172.21.15.42:0/4278015420 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc009680 con 0x7f02f0003f30 2024-09-16T01:55:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.424+0000 7f0310749640 1 -- 172.21.15.42:0/4278015420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02f0003f30 msgr2=0x7f02f0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.424+0000 7f0310749640 1 --2- 172.21.15.42:0/4278015420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02f0003f30 0x7f02f0004800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009ae0 tx=0x7f02f0005830 comp rx=0 tx=0).stop 2024-09-16T01:55:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.424+0000 7f030ece6640 1 -- 172.21.15.42:0/4278015420 reap_dead start 2024-09-16T01:55:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.424+0000 7f0310749640 1 -- 172.21.15.42:0/4278015420 shutdown_connections 2024-09-16T01:55:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.424+0000 7f0310749640 1 -- 172.21.15.42:0/4278015420 >> 172.21.15.42:0/4278015420 conn(0x7f030808bfc0 msgr2=0x7f03080d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.424+0000 7f0310749640 1 -- 172.21.15.42:0/4278015420 shutdown_connections 2024-09-16T01:55:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.424+0000 7f0310749640 1 -- 172.21.15.42:0/4278015420 wait complete. 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.425+0000 7f0310749640 1 Processor -- start 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.425+0000 7f0310749640 1 -- start start 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f0310749640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0003f30 0x7f03080b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f0310749640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03080c8000 0x7f03080c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f0310749640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080b5f50 0x7f03080b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f0310749640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f03080cf710 con 0x7f03080c8000 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f0310749640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f03080d2470 con 0x7f02f0003f30 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f0310749640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f03080d52d0 con 0x7f03080b5f50 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030dce4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03080c8000 0x7f03080c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030dce4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03080c8000 0x7f03080c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49108/0 (socket says 172.21.15.42:49108) 2024-09-16T01:55:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030dce4640 1 -- 172.21.15.42:0/1636380623 learned_addr learned my addr 172.21.15.42:0/1636380623 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030ece6640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080b5f50 0x7f03080b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030e4e5640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0003f30 0x7f03080b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030dce4640 1 -- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080b5f50 msgr2=0x7f03080b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030dce4640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080b5f50 0x7f03080b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030dce4640 1 -- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0003f30 msgr2=0x7f03080b9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030dce4640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0003f30 0x7f03080b9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030dce4640 1 -- 172.21.15.42:0/1636380623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0308155ee0 con 0x7f03080c8000 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030e4e5640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0003f30 0x7f03080b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.426+0000 7f030ece6640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080b5f50 0x7f03080b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.427+0000 7f030dce4640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03080c8000 0x7f03080c8460 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f02fc034040 tx=0x7f02fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.427+0000 7f0306ffd640 1 -- 172.21.15.42:0/1636380623 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc040020 con 0x7f03080c8000 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.427+0000 7f0306ffd640 1 -- 172.21.15.42:0/1636380623 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02fc037040 con 0x7f03080c8000 2024-09-16T01:55:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.427+0000 7f0310749640 1 -- 172.21.15.42:0/1636380623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03080b5190 con 0x7f03080c8000 2024-09-16T01:55:58.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.427+0000 7f0306ffd640 1 -- 172.21.15.42:0/1636380623 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc036030 con 0x7f03080c8000 2024-09-16T01:55:58.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.427+0000 7f0310749640 1 -- 172.21.15.42:0/1636380623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03080b5750 con 0x7f03080c8000 2024-09-16T01:55:58.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.428+0000 7f0310749640 1 -- 172.21.15.42:0/1636380623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030806e3e0 con 0x7f03080c8000 2024-09-16T01:55:58.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.428+0000 7f0306ffd640 1 -- 172.21.15.42:0/1636380623 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f02fc043020 con 0x7f03080c8000 2024-09-16T01:55:58.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.429+0000 7f0306ffd640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f406c2b0 0x7f02f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.429+0000 7f0306ffd640 1 -- 172.21.15.42:0/1636380623 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6101+0+0 (secure 0 0 0) 0x7f02fc0ab860 con 0x7f03080c8000 2024-09-16T01:55:58.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.429+0000 7f030e4e5640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f406c2b0 0x7f02f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.429+0000 7f030e4e5640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f406c2b0 0x7f02f406e770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0300005b90 tx=0x7f0300009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:58.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.433+0000 7f0306ffd640 1 -- 172.21.15.42:0/1636380623 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02fc04a030 con 0x7f03080c8000 2024-09-16T01:55:58.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.646+0000 7f0310749640 1 -- 172.21.15.42:0/1636380623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f030808e640 con 0x7f03080c8000 2024-09-16T01:55:58.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.850+0000 7f0306ffd640 1 -- 172.21.15.42:0/1636380623 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) ==== 118+0+0 (secure 0 0 0) 0x7f02fc079ed0 con 0x7f03080c8000 2024-09-16T01:55:58.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 -- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f406c2b0 msgr2=0x7f02f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f406c2b0 0x7f02f406e770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0300005b90 tx=0x7f0300009040 comp rx=0 tx=0).stop 2024-09-16T01:55:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 -- 172.21.15.42:0/1636380623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03080c8000 msgr2=0x7f03080c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03080c8000 0x7f03080c8460 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f02fc034040 tx=0x7f02fc004730 comp rx=0 tx=0).stop 2024-09-16T01:55:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 -- 172.21.15.42:0/1636380623 shutdown_connections 2024-09-16T01:55:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f02f406c2b0 0x7f02f406e770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03080b5f50 0x7f03080b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03080c8000 0x7f03080c8460 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 --2- 172.21.15.42:0/1636380623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f02f0003f30 0x7f03080b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 -- 172.21.15.42:0/1636380623 >> 172.21.15.42:0/1636380623 conn(0x7f030808bfc0 msgr2=0x7f0308160240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 -- 172.21.15.42:0/1636380623 shutdown_connections 2024-09-16T01:55:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.853+0000 7f0310749640 1 -- 172.21.15.42:0/1636380623 wait complete. 2024-09-16T01:55:58.866 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:55:58.866 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:55:58.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.970+0000 7f3574776640 1 Processor -- start 2024-09-16T01:55:58.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.970+0000 7f3574776640 1 -- start start 2024-09-16T01:55:58.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.971+0000 7f3574776640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c161a20 0x7f356c0d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.971+0000 7f3574776640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356c0cf980 con 0x7f356c0cf330 2024-09-16T01:55:58.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.971+0000 7f3574776640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356c06d050 con 0x7f356c0d1420 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.971+0000 7f3574776640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f356c161e00 con 0x7f356c161a20 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.971+0000 7f3572d13640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f356c0cf330 0x7f356c06d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52738/0 (socket says 172.21.15.42:52738) 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.971+0000 7f3572d13640 1 -- 172.21.15.42:0/1476139335 learned_addr learned my addr 172.21.15.42:0/1476139335 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.971+0000 7f3572512640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c161a20 0x7f356c0d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.971+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3497059442 0 0) 0x7f356c0cf980 con 0x7f356c0cf330 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3554003520 con 0x7f356c0cf330 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1632878259 0 0) 0x7f3554003520 con 0x7f356c0cf330 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c161a20 msgr2=0x7f356c0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c161a20 0x7f356c0d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 >> v1:172.21.15.107:6789/0 conn(0x7f356c0d1420 legacy=0x7f356c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c0d1800 con 0x7f356c0cf330 2024-09-16T01:55:58.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f355c0019f0 con 0x7f356c0cf330 2024-09-16T01:55:58.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 >> v1:172.21.15.42:6789/0 conn(0x7f356c0cf330 legacy=0x7f356c06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c161a20 0x7f35540039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3554003f20 0x7f3554004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 0x7f35540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f356c161e00 con 0x7f3554004d40 2024-09-16T01:55:58.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f355400ba20 con 0x7f3554003f20 2024-09-16T01:55:58.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f355400bc20 con 0x7f356c161a20 2024-09-16T01:55:58.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3572d13640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 0x7f35540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3572512640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c161a20 0x7f35540039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3571d11640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3554003f20 0x7f3554004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3572d13640 1 -- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c161a20 msgr2=0x7f35540039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3572d13640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c161a20 0x7f35540039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3572d13640 1 -- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3554003f20 msgr2=0x7f3554004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3572d13640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3554003f20 0x7f3554004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.972+0000 7f3572d13640 1 -- 172.21.15.42:0/1476139335 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3554003520 con 0x7f3554004d40 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.973+0000 7f3572d13640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 0x7f35540051c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f355c00a920 tx=0x7f3554005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6d354b77d76c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.973+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c00a4c0 con 0x7f3554004d40 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.973+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355c02f070 con 0x7f3554004d40 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.973+0000 7f3571510640 1 -- 172.21.15.42:0/1476139335 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c02bd20 con 0x7f3554004d40 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.974+0000 7f3574776640 1 -- 172.21.15.42:0/1476139335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 msgr2=0x7f35540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.974+0000 7f3574776640 1 --2- 172.21.15.42:0/1476139335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 0x7f35540051c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f355c00a920 tx=0x7f3554005830 comp rx=0 tx=0).stop 2024-09-16T01:55:58.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.974+0000 7f3572d13640 1 -- 172.21.15.42:0/1476139335 reap_dead start 2024-09-16T01:55:58.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.974+0000 7f3574776640 1 -- 172.21.15.42:0/1476139335 shutdown_connections 2024-09-16T01:55:58.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.974+0000 7f3574776640 1 -- 172.21.15.42:0/1476139335 >> 172.21.15.42:0/1476139335 conn(0x7f356c09d850 msgr2=0x7f356c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:58.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.974+0000 7f3574776640 1 -- 172.21.15.42:0/1476139335 shutdown_connections 2024-09-16T01:55:58.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.974+0000 7f3574776640 1 -- 172.21.15.42:0/1476139335 wait complete. 2024-09-16T01:55:58.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.975+0000 7f3574776640 1 Processor -- start 2024-09-16T01:55:58.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.975+0000 7f3574776640 1 -- start start 2024-09-16T01:55:58.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3574776640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 0x7f356c1f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3574776640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c15bbe0 0x7f356c0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3574776640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f356c0c96c0 0x7f356c0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3574776640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f356c06d2f0 con 0x7f3554004d40 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3574776640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f356c0cff00 con 0x7f356c0c96c0 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3574776640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f356c0b1040 con 0x7f356c15bbe0 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572512640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 0x7f356c1f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572512640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 0x7f356c1f3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49124/0 (socket says 172.21.15.42:49124) 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572512640 1 -- 172.21.15.42:0/57958854 learned_addr learned my addr 172.21.15.42:0/57958854 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3571d11640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c15bbe0 0x7f356c0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572d13640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f356c0c96c0 0x7f356c0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572512640 1 -- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c15bbe0 msgr2=0x7f356c0c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572512640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c15bbe0 0x7f356c0c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572512640 1 -- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f356c0c96c0 msgr2=0x7f356c0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:58.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572512640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f356c0c96c0 0x7f356c0c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572512640 1 -- 172.21.15.42:0/57958854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c0c83e0 con 0x7f3554004d40 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572d13640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f356c0c96c0 0x7f356c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.976+0000 7f3572512640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 0x7f356c1f3a60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3564011a00 tx=0x7f3564011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.977+0000 7f356affd640 1 -- 172.21.15.42:0/57958854 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356400faf0 con 0x7f3554004d40 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.977+0000 7f356affd640 1 -- 172.21.15.42:0/57958854 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356400fc90 con 0x7f3554004d40 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.977+0000 7f356affd640 1 -- 172.21.15.42:0/57958854 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564014440 con 0x7f3554004d40 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.977+0000 7f3574776640 1 -- 172.21.15.42:0/57958854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c0b9b60 con 0x7f3554004d40 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.977+0000 7f3574776640 1 -- 172.21.15.42:0/57958854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c0c8980 con 0x7f3554004d40 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.978+0000 7f3574776640 1 -- 172.21.15.42:0/57958854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356c0d0ee0 con 0x7f3554004d40 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.978+0000 7f356affd640 1 -- 172.21.15.42:0/57958854 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3564012040 con 0x7f3554004d40 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.978+0000 7f356affd640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f355806c2b0 0x7f355806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.979+0000 7f356affd640 1 -- 172.21.15.42:0/57958854 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f356408bab0 con 0x7f3554004d40 2024-09-16T01:55:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.979+0000 7f3571d11640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f355806c2b0 0x7f355806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.979+0000 7f3571d11640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f355806c2b0 0x7f355806e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f356c0d1350 tx=0x7f3560009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:58.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:58.983+0000 7f356affd640 1 -- 172.21.15.42:0/57958854 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3564019030 con 0x7f3554004d40 2024-09-16T01:55:59.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.199+0000 7f3574776640 1 -- 172.21.15.42:0/57958854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f356c06bda0 con 0x7f3554004d40 2024-09-16T01:55:59.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.852+0000 7f356affd640 1 -- 172.21.15.42:0/57958854 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) ==== 122+0+0 (secure 0 0 0) 0x7f356405a120 con 0x7f3554004d40 2024-09-16T01:55:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 -- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f355806c2b0 msgr2=0x7f355806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f355806c2b0 0x7f355806e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f356c0d1350 tx=0x7f3560009040 comp rx=0 tx=0).stop 2024-09-16T01:55:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 -- 172.21.15.42:0/57958854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 msgr2=0x7f356c1f3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 0x7f356c1f3a60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3564011a00 tx=0x7f3564011ec0 comp rx=0 tx=0).stop 2024-09-16T01:55:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 -- 172.21.15.42:0/57958854 shutdown_connections 2024-09-16T01:55:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f355806c2b0 0x7f355806e770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:59.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f356c0c96c0 0x7f356c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:59.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f356c15bbe0 0x7f356c0c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:59.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 --2- 172.21.15.42:0/57958854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3554004d40 0x7f356c1f3a60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:59.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 -- 172.21.15.42:0/57958854 >> 172.21.15.42:0/57958854 conn(0x7f356c09d850 msgr2=0x7f356c15c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:59.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 -- 172.21.15.42:0/57958854 shutdown_connections 2024-09-16T01:55:59.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.855+0000 7f3574776640 1 -- 172.21.15.42:0/57958854 wait complete. 2024-09-16T01:55:59.870 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:55:59.870 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:55:59.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.978+0000 7f05ced6d640 1 Processor -- start 2024-09-16T01:55:59.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.978+0000 7f05ced6d640 1 -- start start 2024-09-16T01:55:59.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.979+0000 7f05ced6d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c815e5f0 0x7f05c80d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:59.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.979+0000 7f05ced6d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05c80d30f0 0x7f05c80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:59.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.979+0000 7f05ced6d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c80d3690 con 0x7f05c80b64c0 2024-09-16T01:55:59.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.979+0000 7f05ced6d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f05c806d530 con 0x7f05c80d30f0 2024-09-16T01:55:59.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.979+0000 7f05ced6d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f05c80d3970 con 0x7f05c815e5f0 2024-09-16T01:55:59.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.979+0000 7f05c7fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05c80d30f0 0x7f05c80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:59.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.979+0000 7f05c7fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05c80d30f0 0x7f05c80b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49134/0 (socket says 172.21.15.42:49134) 2024-09-16T01:55:59.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.979+0000 7f05c7fff640 1 -- 172.21.15.42:0/1593763873 learned_addr learned my addr 172.21.15.42:0/1593763873 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:59.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.979+0000 7f05ccb09640 1 --2- 172.21.15.42:0/1593763873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c815e5f0 0x7f05c80d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:59.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.980+0000 7f05c7fff640 1 -- 172.21.15.42:0/1593763873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c815e5f0 msgr2=0x7f05c80d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:55:59.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.980+0000 7f05c7fff640 1 --2- 172.21.15.42:0/1593763873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c815e5f0 0x7f05c80d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:59.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.980+0000 7f05c7fff640 1 -- 172.21.15.42:0/1593763873 >> v1:172.21.15.107:6789/0 conn(0x7f05c80b64c0 legacy=0x7f05c80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:59.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.980+0000 7f05c7fff640 1 -- 172.21.15.42:0/1593763873 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c806cee0 con 0x7f05c80d30f0 2024-09-16T01:55:59.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.980+0000 7f05ccb09640 1 --2- 172.21.15.42:0/1593763873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c815e5f0 0x7f05c80d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:59.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.980+0000 7f05c7fff640 1 --2- 172.21.15.42:0/1593763873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80d30f0 0x7f05c80b5f80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009870 tx=0x7f05bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe85218332a5d1b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.980+0000 7f05c77fe640 1 -- 172.21.15.42:0/1593763873 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc037070 con 0x7f05c80d30f0 2024-09-16T01:55:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.981+0000 7f05c77fe640 1 -- 172.21.15.42:0/1593763873 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05bc032440 con 0x7f05c80d30f0 2024-09-16T01:55:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.981+0000 7f05c77fe640 1 -- 172.21.15.42:0/1593763873 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc032810 con 0x7f05c80d30f0 2024-09-16T01:55:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.981+0000 7f05ced6d640 1 -- 172.21.15.42:0/1593763873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80d30f0 msgr2=0x7f05c80b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.981+0000 7f05ced6d640 1 --2- 172.21.15.42:0/1593763873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80d30f0 0x7f05c80b5f80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009870 tx=0x7f05bc02a270 comp rx=0 tx=0).stop 2024-09-16T01:55:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.981+0000 7f05ced6d640 1 -- 172.21.15.42:0/1593763873 shutdown_connections 2024-09-16T01:55:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.981+0000 7f05ced6d640 1 --2- 172.21.15.42:0/1593763873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80d30f0 0x7f05c80b5f80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.981+0000 7f05ced6d640 1 --2- 172.21.15.42:0/1593763873 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c815e5f0 0x7f05c80d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:59.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.981+0000 7f05ced6d640 1 -- 172.21.15.42:0/1593763873 >> 172.21.15.42:0/1593763873 conn(0x7f05c808bfc0 msgr2=0x7f05c80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:55:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.981+0000 7f05ced6d640 1 -- 172.21.15.42:0/1593763873 shutdown_connections 2024-09-16T01:55:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.981+0000 7f05ced6d640 1 -- 172.21.15.42:0/1593763873 wait complete. 2024-09-16T01:55:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.982+0000 7f05ced6d640 1 Processor -- start 2024-09-16T01:55:59.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.982+0000 7f05ced6d640 1 -- start start 2024-09-16T01:55:59.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05ced6d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80b64c0 0x7f05c8157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:59.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05ced6d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c80d30f0 0x7f05c8158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:59.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05ced6d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c815e5f0 0x7f05c80b7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:59.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05ced6d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05c80d5310 con 0x7f05c80b64c0 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05ced6d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05c815e9d0 con 0x7f05c815e5f0 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05ced6d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f05c806e9d0 con 0x7f05c80d30f0 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05ccb09640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80b64c0 0x7f05c8157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05ccb09640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80b64c0 0x7f05c8157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49148/0 (socket says 172.21.15.42:49148) 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05ccb09640 1 -- 172.21.15.42:0/3208669254 learned_addr learned my addr 172.21.15.42:0/3208669254 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05c7fff640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c80d30f0 0x7f05c8158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.983+0000 7f05cd30a640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c815e5f0 0x7f05c80b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05ccb09640 1 -- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c80d30f0 msgr2=0x7f05c8158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05ccb09640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c80d30f0 0x7f05c8158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05ccb09640 1 -- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c815e5f0 msgr2=0x7f05c80b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05ccb09640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c815e5f0 0x7f05c80b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:55:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05ccb09640 1 -- 172.21.15.42:0/3208669254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c8159510 con 0x7f05c80b64c0 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05cd30a640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c815e5f0 0x7f05c80b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05c7fff640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c80d30f0 0x7f05c8158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05ccb09640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80b64c0 0x7f05c8157c60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f05b800d7d0 tx=0x7f05b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05c57fa640 1 -- 172.21.15.42:0/3208669254 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b8004030 con 0x7f05c80b64c0 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05c57fa640 1 -- 172.21.15.42:0/3208669254 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b80041d0 con 0x7f05c80b64c0 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05c57fa640 1 -- 172.21.15.42:0/3208669254 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b800b6c0 con 0x7f05c80b64c0 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05ced6d640 1 -- 172.21.15.42:0/3208669254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c815fd00 con 0x7f05c80b64c0 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.984+0000 7f05ced6d640 1 -- 172.21.15.42:0/3208669254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c81602c0 con 0x7f05c80b64c0 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.985+0000 7f05ced6d640 1 -- 172.21.15.42:0/3208669254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c80b5f80 con 0x7f05c80b64c0 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.985+0000 7f05c57fa640 1 -- 172.21.15.42:0/3208669254 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f05b800b860 con 0x7f05c80b64c0 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.986+0000 7f05c57fa640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f05b406c2b0 0x7f05b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.986+0000 7f05c57fa640 1 -- 172.21.15.42:0/3208669254 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f05b808b960 con 0x7f05c80b64c0 2024-09-16T01:55:59.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.986+0000 7f05c7fff640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f05b406c2b0 0x7f05b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:55:59.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.987+0000 7f05c7fff640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f05b406c2b0 0x7f05b406e770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f05bc034000 tx=0x7f05bc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:55:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:55:59.990+0000 7f05c57fa640 1 -- 172.21.15.42:0/3208669254 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05b8059eb0 con 0x7f05c80b64c0 2024-09-16T01:56:00.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.201+0000 7f05ced6d640 1 -- 172.21.15.42:0/3208669254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05c80c7980 con 0x7f05c80b64c0 2024-09-16T01:56:00.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.201+0000 7f05c57fa640 1 -- 172.21.15.42:0/3208669254 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5225 (secure 0 0 0) 0x7f05b80597b0 con 0x7f05c80b64c0 2024-09-16T01:56:00.203 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:00.203 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-09-16T01:55:59:851792+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3210303754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3210303754},{"type":"v1","addr":"172.21.15.42:6833","nonce":3210303754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/628179225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":628179225},{"type":"v1","addr":"172.21.15.107:6837","nonce":628179225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3586378815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3586378815},{"type":"v1","addr":"172.21.15.42:6835","nonce":3586378815}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:57.021180+0000","modified":"2024-09-16T01:55:59.200652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34817":{"gid":34817,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6836/19167184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":19167184},{"type":"v1","addr":"172.21.15.107:6836","nonce":19167184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34817,"qdb_cluster":[34817]},"id":3}]} 2024-09-16T01:56:00.203 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-09-16T01:56:00.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 -- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f05b406c2b0 msgr2=0x7f05b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f05b406c2b0 0x7f05b406e770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f05bc034000 tx=0x7f05bc02e000 comp rx=0 tx=0).stop 2024-09-16T01:56:00.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 -- 172.21.15.42:0/3208669254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80b64c0 msgr2=0x7f05c8157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80b64c0 0x7f05c8157c60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f05b800d7d0 tx=0x7f05b800dc90 comp rx=0 tx=0).stop 2024-09-16T01:56:00.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 -- 172.21.15.42:0/3208669254 shutdown_connections 2024-09-16T01:56:00.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f05b406c2b0 0x7f05b406e770 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c815e5f0 0x7f05c80b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f05c80d30f0 0x7f05c8158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 --2- 172.21.15.42:0/3208669254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c80b64c0 0x7f05c8157c60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 -- 172.21.15.42:0/3208669254 >> 172.21.15.42:0/3208669254 conn(0x7f05c808bfc0 msgr2=0x7f05c80cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:00.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 -- 172.21.15.42:0/3208669254 shutdown_connections 2024-09-16T01:56:00.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.203+0000 7f05ced6d640 1 -- 172.21.15.42:0/3208669254 wait complete. 2024-09-16T01:56:00.219 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:56:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.322+0000 7f23370c9640 1 Processor -- start 2024-09-16T01:56:00.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.322+0000 7f23370c9640 1 -- start start 2024-09-16T01:56:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.322+0000 7f23370c9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2330161c80 0x7f233006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.322+0000 7f23370c9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2330162060 0x7f23300b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.322+0000 7f23370c9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f233006e870 con 0x7f23300b64b0 2024-09-16T01:56:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f23370c9640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f233006d9f0 con 0x7f2330161c80 2024-09-16T01:56:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f23370c9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f233006dcd0 con 0x7f2330162060 2024-09-16T01:56:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f2334e65640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2330161c80 0x7f233006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f2335666640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f23300b64b0 0x7f2330162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52742/0 (socket says 172.21.15.42:52742) 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f2335666640 1 -- 172.21.15.42:0/3689690628 learned_addr learned my addr 172.21.15.42:0/3689690628 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f232ffff640 1 --2- 172.21.15.42:0/3689690628 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2330162060 0x7f23300b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f2334e65640 1 -- 172.21.15.42:0/3689690628 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2330162060 msgr2=0x7f23300b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f2334e65640 1 --2- 172.21.15.42:0/3689690628 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2330162060 0x7f23300b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f2334e65640 1 -- 172.21.15.42:0/3689690628 >> v1:172.21.15.42:6789/0 conn(0x7f23300b64b0 legacy=0x7f2330162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f2334e65640 1 -- 172.21.15.42:0/3689690628 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f233006dfb0 con 0x7f2330161c80 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.323+0000 7f232f7fe640 1 -- 172.21.15.42:0/3689690628 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742921426 0 0) 0x7f2328001110 con 0x7f23300b64b0 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.324+0000 7f2334e65640 1 --2- 172.21.15.42:0/3689690628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330161c80 0x7f233006e330 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f23200097a0 tx=0x7f232002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52d34c88117a915 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.324+0000 7f232f7fe640 1 -- 172.21.15.42:0/3689690628 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320037070 con 0x7f2330161c80 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.324+0000 7f232f7fe640 1 -- 172.21.15.42:0/3689690628 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2320032440 con 0x7f2330161c80 2024-09-16T01:56:00.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.324+0000 7f232f7fe640 1 -- 172.21.15.42:0/3689690628 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320032810 con 0x7f2330161c80 2024-09-16T01:56:00.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.324+0000 7f23370c9640 1 -- 172.21.15.42:0/3689690628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330161c80 msgr2=0x7f233006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.324+0000 7f23370c9640 1 --2- 172.21.15.42:0/3689690628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330161c80 0x7f233006e330 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f23200097a0 tx=0x7f232002a180 comp rx=0 tx=0).stop 2024-09-16T01:56:00.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.324+0000 7f23370c9640 1 -- 172.21.15.42:0/3689690628 shutdown_connections 2024-09-16T01:56:00.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.324+0000 7f23370c9640 1 --2- 172.21.15.42:0/3689690628 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2330162060 0x7f23300b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.324+0000 7f23370c9640 1 --2- 172.21.15.42:0/3689690628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330161c80 0x7f233006e330 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.324+0000 7f23370c9640 1 -- 172.21.15.42:0/3689690628 >> 172.21.15.42:0/3689690628 conn(0x7f23300d44f0 msgr2=0x7f23300d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:00.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.325+0000 7f23370c9640 1 -- 172.21.15.42:0/3689690628 shutdown_connections 2024-09-16T01:56:00.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.325+0000 7f23370c9640 1 -- 172.21.15.42:0/3689690628 wait complete. 2024-09-16T01:56:00.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.326+0000 7f23370c9640 1 Processor -- start 2024-09-16T01:56:00.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.326+0000 7f23370c9640 1 -- start start 2024-09-16T01:56:00.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f23370c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23300b64b0 0x7f2330156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f23370c9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2330161c80 0x7f23300cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f23370c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330162060 0x7f23300b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f23370c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f23300d2a10 con 0x7f2330162060 2024-09-16T01:56:00.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f23370c9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f23300d2890 con 0x7f23300b64b0 2024-09-16T01:56:00.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f23370c9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f23300b6960 con 0x7f2330161c80 2024-09-16T01:56:00.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f2335666640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330162060 0x7f23300b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f2335666640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330162060 0x7f23300b86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49156/0 (socket says 172.21.15.42:49156) 2024-09-16T01:56:00.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f2335666640 1 -- 172.21.15.42:0/2548698096 learned_addr learned my addr 172.21.15.42:0/2548698096 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:00.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f232ffff640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2330161c80 0x7f23300cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f2334e65640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23300b64b0 0x7f2330156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f2335666640 1 -- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2330161c80 msgr2=0x7f23300cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f2335666640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2330161c80 0x7f23300cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f2335666640 1 -- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23300b64b0 msgr2=0x7f2330156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f2335666640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23300b64b0 0x7f2330156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f2335666640 1 -- 172.21.15.42:0/2548698096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2330159fa0 con 0x7f2330162060 2024-09-16T01:56:00.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f2335666640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330162060 0x7f23300b86c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f232800c780 tx=0x7f232800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:00.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.327+0000 7f232d7fa640 1 -- 172.21.15.42:0/2548698096 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328018070 con 0x7f2330162060 2024-09-16T01:56:00.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.328+0000 7f232d7fa640 1 -- 172.21.15.42:0/2548698096 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23280070d0 con 0x7f2330162060 2024-09-16T01:56:00.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.328+0000 7f23370c9640 1 -- 172.21.15.42:0/2548698096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23300b7340 con 0x7f2330162060 2024-09-16T01:56:00.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.328+0000 7f232d7fa640 1 -- 172.21.15.42:0/2548698096 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328007500 con 0x7f2330162060 2024-09-16T01:56:00.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.328+0000 7f23370c9640 1 -- 172.21.15.42:0/2548698096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23300b7900 con 0x7f2330162060 2024-09-16T01:56:00.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.328+0000 7f23370c9640 1 -- 172.21.15.42:0/2548698096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f233006e330 con 0x7f2330162060 2024-09-16T01:56:00.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.329+0000 7f232d7fa640 1 -- 172.21.15.42:0/2548698096 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f232801b070 con 0x7f2330162060 2024-09-16T01:56:00.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.329+0000 7f232d7fa640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f231006c2e0 0x7f231006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.330+0000 7f232d7fa640 1 -- 172.21.15.42:0/2548698096 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f232808a730 con 0x7f2330162060 2024-09-16T01:56:00.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.330+0000 7f2334e65640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f231006c2e0 0x7f231006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.330+0000 7f2334e65640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f231006c2e0 0x7f231006e7a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2320034000 tx=0x7f232002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:00.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.334+0000 7f232d7fa640 1 -- 172.21.15.42:0/2548698096 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f233006e870 con 0x7f2330162060 2024-09-16T01:56:00.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.512+0000 7f23370c9640 1 -- 172.21.15.42:0/2548698096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23300ba470 con 0x7f2330162060 2024-09-16T01:56:00.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.513+0000 7f232d7fa640 1 -- 172.21.15.42:0/2548698096 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16990 (secure 0 0 0) 0x7f2328058750 con 0x7f2330162060 2024-09-16T01:56:00.514 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:00.515 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":50,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:58.669116+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:55:54.676980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-16T01:55:56.007224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 -- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f231006c2e0 msgr2=0x7f231006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f231006c2e0 0x7f231006e7a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2320034000 tx=0x7f232002e000 comp rx=0 tx=0).stop 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 -- 172.21.15.42:0/2548698096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330162060 msgr2=0x7f23300b86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330162060 0x7f23300b86c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f232800c780 tx=0x7f232800cc40 comp rx=0 tx=0).stop 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 -- 172.21.15.42:0/2548698096 shutdown_connections 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f231006c2e0 0x7f231006e7a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2330162060 0x7f23300b86c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2330161c80 0x7f23300cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 --2- 172.21.15.42:0/2548698096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23300b64b0 0x7f2330156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 -- 172.21.15.42:0/2548698096 >> 172.21.15.42:0/2548698096 conn(0x7f23300d44f0 msgr2=0x7f233015fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 -- 172.21.15.42:0/2548698096 shutdown_connections 2024-09-16T01:56:00.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.515+0000 7f23370c9640 1 -- 172.21.15.42:0/2548698096 wait complete. 2024-09-16T01:56:00.528 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:56:00.528 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:56:00.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.629+0000 7fbc5a423640 1 Processor -- start 2024-09-16T01:56:00.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.630+0000 7fbc5a423640 1 -- start start 2024-09-16T01:56:00.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.630+0000 7fbc5a423640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbc5415e740 0x7fbc540d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.630+0000 7fbc5a423640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbc5409b690 0x7fbc5406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.630+0000 7fbc5a423640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc540d0780 con 0x7fbc5406d4c0 2024-09-16T01:56:00.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.630+0000 7fbc5a423640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fbc5415eb20 con 0x7fbc5415e740 2024-09-16T01:56:00.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.630+0000 7fbc5a423640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbc5406d260 con 0x7fbc5409b690 2024-09-16T01:56:00.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.631+0000 7fbc53fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbc5415e740 0x7fbc540d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.631+0000 7fbc589c0640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fbc5406d4c0 0x7fbc5406d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52754/0 (socket says 172.21.15.42:52754) 2024-09-16T01:56:00.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.631+0000 7fbc589c0640 1 -- 172.21.15.42:0/2925443375 learned_addr learned my addr 172.21.15.42:0/2925443375 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.631+0000 7fbc537fe640 1 --2- 172.21.15.42:0/2925443375 >> v2:172.21.15.107:3300/0 conn(0x7fbc5409b690 0x7fbc5406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.631+0000 7fbc53fff640 1 -- 172.21.15.42:0/2925443375 >> v2:172.21.15.107:3300/0 conn(0x7fbc5409b690 msgr2=0x7fbc5406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.631+0000 7fbc53fff640 1 --2- 172.21.15.42:0/2925443375 >> v2:172.21.15.107:3300/0 conn(0x7fbc5409b690 0x7fbc5406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.631+0000 7fbc53fff640 1 -- 172.21.15.42:0/2925443375 >> v1:172.21.15.42:6789/0 conn(0x7fbc5406d4c0 legacy=0x7fbc5406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.631+0000 7fbc52ffd640 1 -- 172.21.15.42:0/2925443375 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372500225 0 0) 0x7fbc540d0780 con 0x7fbc5406d4c0 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.631+0000 7fbc53fff640 1 -- 172.21.15.42:0/2925443375 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc540d0a60 con 0x7fbc5415e740 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.631+0000 7fbc537fe640 1 --2- 172.21.15.42:0/2925443375 >> v2:172.21.15.107:3300/0 conn(0x7fbc5409b690 0x7fbc5406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc53fff640 1 --2- 172.21.15.42:0/2925443375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5415e740 0x7fbc540d1540 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbc540691b0 tx=0x7fbc4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfac40904cd81131 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc52ffd640 1 -- 172.21.15.42:0/2925443375 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44037070 con 0x7fbc5415e740 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc52ffd640 1 -- 172.21.15.42:0/2925443375 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc44032440 con 0x7fbc5415e740 2024-09-16T01:56:00.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc52ffd640 1 -- 172.21.15.42:0/2925443375 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44032810 con 0x7fbc5415e740 2024-09-16T01:56:00.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc5a423640 1 -- 172.21.15.42:0/2925443375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5415e740 msgr2=0x7fbc540d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc5a423640 1 --2- 172.21.15.42:0/2925443375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5415e740 0x7fbc540d1540 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbc540691b0 tx=0x7fbc4402a230 comp rx=0 tx=0).stop 2024-09-16T01:56:00.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc5a423640 1 -- 172.21.15.42:0/2925443375 shutdown_connections 2024-09-16T01:56:00.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc5a423640 1 --2- 172.21.15.42:0/2925443375 >> v2:172.21.15.107:3300/0 conn(0x7fbc5409b690 0x7fbc5406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc5a423640 1 --2- 172.21.15.42:0/2925443375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5415e740 0x7fbc540d1540 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc5a423640 1 -- 172.21.15.42:0/2925443375 >> 172.21.15.42:0/2925443375 conn(0x7fbc540d23a0 msgr2=0x7fbc540d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc5a423640 1 -- 172.21.15.42:0/2925443375 shutdown_connections 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.632+0000 7fbc5a423640 1 -- 172.21.15.42:0/2925443375 wait complete. 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.634+0000 7fbc5a423640 1 Processor -- start 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.634+0000 7fbc5a423640 1 -- start start 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.634+0000 7fbc5a423640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5406d4c0 0x7fbc54157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc5a423640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5409b690 0x7fbc540b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc5a423640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc5415e740 0x7fbc540b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc5a423640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5409bac0 con 0x7fbc5409b690 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc5a423640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbc540d1020 con 0x7fbc5406d4c0 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc5a423640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5406dfe0 con 0x7fbc5415e740 2024-09-16T01:56:00.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc537fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5409b690 0x7fbc540b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc537fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5409b690 0x7fbc540b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49184/0 (socket says 172.21.15.42:49184) 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc537fe640 1 -- 172.21.15.42:0/3427642850 learned_addr learned my addr 172.21.15.42:0/3427642850 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc589c0640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc5415e740 0x7fbc540b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc53fff640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5406d4c0 0x7fbc54157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc537fe640 1 -- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc5415e740 msgr2=0x7fbc540b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc537fe640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc5415e740 0x7fbc540b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc537fe640 1 -- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5406d4c0 msgr2=0x7fbc54157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc537fe640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5406d4c0 0x7fbc54157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc537fe640 1 -- 172.21.15.42:0/3427642850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc541f5260 con 0x7fbc5409b690 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc53fff640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5406d4c0 0x7fbc54157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc537fe640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5409b690 0x7fbc540b6770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800c7f0 tx=0x7fbc4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc50ff9640 1 -- 172.21.15.42:0/3427642850 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48015070 con 0x7fbc5409b690 2024-09-16T01:56:00.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc50ff9640 1 -- 172.21.15.42:0/3427642850 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc48007820 con 0x7fbc5409b690 2024-09-16T01:56:00.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc5a423640 1 -- 172.21.15.42:0/3427642850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc541e8040 con 0x7fbc5409b690 2024-09-16T01:56:00.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc50ff9640 1 -- 172.21.15.42:0/3427642850 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48007bd0 con 0x7fbc5409b690 2024-09-16T01:56:00.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.635+0000 7fbc5a423640 1 -- 172.21.15.42:0/3427642850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc541e8600 con 0x7fbc5409b690 2024-09-16T01:56:00.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.636+0000 7fbc5a423640 1 -- 172.21.15.42:0/3427642850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc540d0780 con 0x7fbc5409b690 2024-09-16T01:56:00.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.637+0000 7fbc50ff9640 1 -- 172.21.15.42:0/3427642850 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbc48018070 con 0x7fbc5409b690 2024-09-16T01:56:00.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.637+0000 7fbc50ff9640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbc4006c2b0 0x7fbc4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.638+0000 7fbc50ff9640 1 -- 172.21.15.42:0/3427642850 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fbc4808b3c0 con 0x7fbc5409b690 2024-09-16T01:56:00.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.638+0000 7fbc53fff640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbc4006c2b0 0x7fbc4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.638+0000 7fbc53fff640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbc4006c2b0 0x7fbc4006e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbc44034000 tx=0x7fbc4402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:00.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.642+0000 7fbc50ff9640 1 -- 172.21.15.42:0/3427642850 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc480593e0 con 0x7fbc5409b690 2024-09-16T01:56:00.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.815+0000 7fbc5a423640 1 -- 172.21.15.42:0/3427642850 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc540d1cb0 con 0x7fbc4006c2b0 2024-09-16T01:56:00.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.821+0000 7fbc50ff9640 1 -- 172.21.15.42:0/3427642850 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239731 (secure 0 0 0) 0x7fbc540d1cb0 con 0x7fbc4006c2b0 2024-09-16T01:56:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:00.827 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:56:00.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.824+0000 7fbc5a423640 1 -- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbc4006c2b0 msgr2=0x7fbc4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbc4006c2b0 0x7fbc4006e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbc44034000 tx=0x7fbc4402e000 comp rx=0 tx=0).stop 2024-09-16T01:56:00.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 -- 172.21.15.42:0/3427642850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5409b690 msgr2=0x7fbc540b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5409b690 0x7fbc540b6770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800c7f0 tx=0x7fbc4800ccb0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 -- 172.21.15.42:0/3427642850 shutdown_connections 2024-09-16T01:56:00.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fbc4006c2b0 0x7fbc4006e770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbc5415e740 0x7fbc540b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc5409b690 0x7fbc540b6770 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 --2- 172.21.15.42:0/3427642850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc5406d4c0 0x7fbc54157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 -- 172.21.15.42:0/3427642850 >> 172.21.15.42:0/3427642850 conn(0x7fbc540d23a0 msgr2=0x7fbc540b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:00.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 -- 172.21.15.42:0/3427642850 shutdown_connections 2024-09-16T01:56:00.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.825+0000 7fbc5a423640 1 -- 172.21.15.42:0/3427642850 wait complete. 2024-09-16T01:56:00.837 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-16T01:56:00.273210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":238280,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736440,"statfs":{"total":773094113280,"available":772850114560,"internally_reserved":0,"allocated":5529600,"data_stored":3060760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.621602"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687263+0000","last_change":"2024-09-16T01:55:57.685621+0000","last_active":"2024-09-16T01:55:57.687263+0000","last_peered":"2024-09-16T01:55:57.687263+0000","last_clean":"2024-09-16T01:55:57.687263+0000","last_became_active":"2024-09-16T01:55:57.685327+0000","last_became_peered":"2024-09-16T01:55:57.685327+0000","last_unstale":"2024-09-16T01:55:57.687263+0000","last_undegraded":"2024-09-16T01:55:57.687263+0000","last_fullsized":"2024-09-16T01:55:57.687263+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:05.569965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.691289+0000","last_change":"2024-09-16T01:55:57.690864+0000","last_active":"2024-09-16T01:55:57.691289+0000","last_peered":"2024-09-16T01:55:57.691289+0000","last_clean":"2024-09-16T01:55:57.691289+0000","last_became_active":"2024-09-16T01:55:57.690592+0000","last_became_peered":"2024-09-16T01:55:57.690592+0000","last_unstale":"2024-09-16T01:55:57.691289+0000","last_undegraded":"2024-09-16T01:55:57.691289+0000","last_fullsized":"2024-09-16T01:55:57.691289+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:07.055332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-16T01:55:56.661097+0000","last_change":"2024-09-16T01:55:56.661097+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.661097+0000","last_undegraded":"2024-09-16T01:55:56.661097+0000","last_fullsized":"2024-09-16T01:55:56.661097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.686829+0000","last_change":"2024-09-16T01:55:57.682642+0000","last_active":"2024-09-16T01:55:57.686829+0000","last_peered":"2024-09-16T01:55:57.686829+0000","last_clean":"2024-09-16T01:55:57.686829+0000","last_became_active":"2024-09-16T01:55:57.682366+0000","last_became_peered":"2024-09-16T01:55:57.682366+0000","last_unstale":"2024-09-16T01:55:57.686829+0000","last_undegraded":"2024-09-16T01:55:57.686829+0000","last_fullsized":"2024-09-16T01:55:57.686829+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:31.190709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687283+0000","last_change":"2024-09-16T01:55:57.685916+0000","last_active":"2024-09-16T01:55:57.687283+0000","last_peered":"2024-09-16T01:55:57.687283+0000","last_clean":"2024-09-16T01:55:57.687283+0000","last_became_active":"2024-09-16T01:55:57.685633+0000","last_became_peered":"2024-09-16T01:55:57.685633+0000","last_unstale":"2024-09-16T01:55:57.687283+0000","last_undegraded":"2024-09-16T01:55:57.687283+0000","last_fullsized":"2024-09-16T01:55:57.687283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:17.321579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-16T01:55:56.661482+0000","last_change":"2024-09-16T01:55:56.661482+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.661482+0000","last_undegraded":"2024-09-16T01:55:56.661482+0000","last_fullsized":"2024-09-16T01:55:56.661482+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687174+0000","last_change":"2024-09-16T01:55:57.685078+0000","last_active":"2024-09-16T01:55:57.687174+0000","last_peered":"2024-09-16T01:55:57.687174+0000","last_clean":"2024-09-16T01:55:57.687174+0000","last_became_active":"2024-09-16T01:55:57.684620+0000","last_became_peered":"2024-09-16T01:55:57.684620+0000","last_unstale":"2024-09-16T01:55:57.687174+0000","last_undegraded":"2024-09-16T01:55:57.687174+0000","last_fullsized":"2024-09-16T01:55:57.687174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:32.690387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687222+0000","last_change":"2024-09-16T01:55:57.685696+0000","last_active":"2024-09-16T01:55:57.687222+0000","last_peered":"2024-09-16T01:55:57.687222+0000","last_clean":"2024-09-16T01:55:57.687222+0000","last_became_active":"2024-09-16T01:55:57.685420+0000","last_became_peered":"2024-09-16T01:55:57.685420+0000","last_unstale":"2024-09-16T01:55:57.687222+0000","last_undegraded":"2024-09-16T01:55:57.687222+0000","last_fullsized":"2024-09-16T01:55:57.687222+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:00.492003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.689141+0000","last_change":"2024-09-16T01:55:57.687961+0000","last_active":"2024-09-16T01:55:57.689141+0000","last_peered":"2024-09-16T01:55:57.689141+0000","last_clean":"2024-09-16T01:55:57.689141+0000","last_became_active":"2024-09-16T01:55:57.687680+0000","last_became_peered":"2024-09-16T01:55:57.687680+0000","last_unstale":"2024-09-16T01:55:57.689141+0000","last_undegraded":"2024-09-16T01:55:57.689141+0000","last_fullsized":"2024-09-16T01:55:57.689141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:19.323091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.688781+0000","last_change":"2024-09-16T01:55:57.686963+0000","last_active":"2024-09-16T01:55:57.688781+0000","last_peered":"2024-09-16T01:55:57.688781+0000","last_clean":"2024-09-16T01:55:57.688781+0000","last_became_active":"2024-09-16T01:55:57.686686+0000","last_became_peered":"2024-09-16T01:55:57.686686+0000","last_unstale":"2024-09-16T01:55:57.688781+0000","last_undegraded":"2024-09-16T01:55:57.688781+0000","last_fullsized":"2024-09-16T01:55:57.688781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:18.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.676027+0000","last_change":"2024-09-16T01:55:56.674828+0000","last_active":"2024-09-16T01:55:57.676027+0000","last_peered":"2024-09-16T01:55:57.676027+0000","last_clean":"2024-09-16T01:55:57.676027+0000","last_became_active":"2024-09-16T01:55:56.674519+0000","last_became_peered":"2024-09-16T01:55:56.674519+0000","last_unstale":"2024-09-16T01:55:57.676027+0000","last_undegraded":"2024-09-16T01:55:57.676027+0000","last_fullsized":"2024-09-16T01:55:57.676027+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:34.317242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.686332+0000","last_change":"2024-09-16T01:55:56.678488+0000","last_active":"2024-09-16T01:55:57.686332+0000","last_peered":"2024-09-16T01:55:57.686332+0000","last_clean":"2024-09-16T01:55:57.686332+0000","last_became_active":"2024-09-16T01:55:56.678214+0000","last_became_peered":"2024-09-16T01:55:56.678214+0000","last_unstale":"2024-09-16T01:55:57.686332+0000","last_undegraded":"2024-09-16T01:55:57.686332+0000","last_fullsized":"2024-09-16T01:55:57.686332+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:10.936010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673991+0000","last_change":"2024-09-16T01:55:56.677509+0000","last_active":"2024-09-16T01:55:57.673991+0000","last_peered":"2024-09-16T01:55:57.673991+0000","last_clean":"2024-09-16T01:55:57.673991+0000","last_became_active":"2024-09-16T01:55:56.677242+0000","last_became_peered":"2024-09-16T01:55:56.677242+0000","last_unstale":"2024-09-16T01:55:57.673991+0000","last_undegraded":"2024-09-16T01:55:57.673991+0000","last_fullsized":"2024-09-16T01:55:57.673991+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:09.600659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-16T01:55:56.675261+0000","last_change":"2024-09-16T01:55:56.671401+0000","last_active":"2024-09-16T01:55:56.675261+0000","last_peered":"2024-09-16T01:55:56.675261+0000","last_clean":"2024-09-16T01:55:56.675261+0000","last_became_active":"2024-09-16T01:55:56.671110+0000","last_became_peered":"2024-09-16T01:55:56.671110+0000","last_unstale":"2024-09-16T01:55:56.675261+0000","last_undegraded":"2024-09-16T01:55:56.675261+0000","last_fullsized":"2024-09-16T01:55:56.675261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:03.371540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-16T01:55:56.675221+0000","last_change":"2024-09-16T01:55:56.671230+0000","last_active":"2024-09-16T01:55:56.675221+0000","last_peered":"2024-09-16T01:55:56.675221+0000","last_clean":"2024-09-16T01:55:56.675221+0000","last_became_active":"2024-09-16T01:55:56.670928+0000","last_became_peered":"2024-09-16T01:55:56.670928+0000","last_unstale":"2024-09-16T01:55:56.675221+0000","last_undegraded":"2024-09-16T01:55:56.675221+0000","last_fullsized":"2024-09-16T01:55:56.675221+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:15.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673380+0000","last_change":"2024-09-16T01:55:56.675512+0000","last_active":"2024-09-16T01:55:57.673380+0000","last_peered":"2024-09-16T01:55:57.673380+0000","last_clean":"2024-09-16T01:55:57.673380+0000","last_became_active":"2024-09-16T01:55:56.675235+0000","last_became_peered":"2024-09-16T01:55:56.675235+0000","last_unstale":"2024-09-16T01:55:57.673380+0000","last_undegraded":"2024-09-16T01:55:57.673380+0000","last_fullsized":"2024-09-16T01:55:57.673380+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:44.890291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":221,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673695+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:55:57.673695+0000","last_peered":"2024-09-16T01:55:57.673695+0000","last_clean":"2024-09-16T01:55:57.673695+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:55:57.673695+0000","last_undegraded":"2024-09-16T01:55:57.673695+0000","last_fullsized":"2024-09-16T01:55:57.673695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1130496,"data_stored":822152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1155072,"data_stored":835028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":561152,"data_stored":244660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:56:00.841 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:56:00.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.978+0000 7f6408053640 1 Processor -- start 2024-09-16T01:56:00.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.978+0000 7f6408053640 1 -- start start 2024-09-16T01:56:00.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6408053640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6400161c80 0x7f640006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6408053640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 0x7f64000cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6408053640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640006e870 con 0x7f6400162060 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6408053640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f640006d9f0 con 0x7f6400161c80 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6408053640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f640006dcd0 con 0x7f64000b6680 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6405def640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6400161c80 0x7f640006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6405def640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6400161c80 0x7f640006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49186/0 (socket says 172.21.15.42:49186) 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f64055ee640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6400162060 0x7f64000b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52758/0 (socket says 172.21.15.42:52758) 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6405def640 1 -- 172.21.15.42:0/2971166448 learned_addr learned my addr 172.21.15.42:0/2971166448 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f64065f0640 1 --2- 172.21.15.42:0/2971166448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 0x7f64000cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6405def640 1 -- 172.21.15.42:0/2971166448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 msgr2=0x7f64000cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6405def640 1 --2- 172.21.15.42:0/2971166448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 0x7f64000cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6405def640 1 -- 172.21.15.42:0/2971166448 >> v1:172.21.15.42:6789/0 conn(0x7f6400162060 legacy=0x7f64000b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6405def640 1 -- 172.21.15.42:0/2971166448 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640006dfb0 con 0x7f6400161c80 2024-09-16T01:56:00.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f6404ded640 1 -- 172.21.15.42:0/2971166448 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 794563496 0 0) 0x7f63f0001110 con 0x7f6400162060 2024-09-16T01:56:00.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.979+0000 7f64065f0640 1 --2- 172.21.15.42:0/2971166448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 0x7f64000cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:56:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.980+0000 7f6405def640 1 --2- 172.21.15.42:0/2971166448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 0x7f640006e330 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009870 tx=0x7f63fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8403d65823a232 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.980+0000 7f6404ded640 1 -- 172.21.15.42:0/2971166448 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc037070 con 0x7f6400161c80 2024-09-16T01:56:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.980+0000 7f6404ded640 1 -- 172.21.15.42:0/2971166448 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63fc032440 con 0x7f6400161c80 2024-09-16T01:56:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.980+0000 7f6404ded640 1 -- 172.21.15.42:0/2971166448 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc032810 con 0x7f6400161c80 2024-09-16T01:56:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.981+0000 7f6408053640 1 -- 172.21.15.42:0/2971166448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 msgr2=0x7f640006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.981+0000 7f6408053640 1 --2- 172.21.15.42:0/2971166448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 0x7f640006e330 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009870 tx=0x7f63fc02a270 comp rx=0 tx=0).stop 2024-09-16T01:56:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.981+0000 7f6408053640 1 -- 172.21.15.42:0/2971166448 shutdown_connections 2024-09-16T01:56:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.981+0000 7f6408053640 1 --2- 172.21.15.42:0/2971166448 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 0x7f64000cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.981+0000 7f6408053640 1 --2- 172.21.15.42:0/2971166448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 0x7f640006e330 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.981+0000 7f6408053640 1 -- 172.21.15.42:0/2971166448 >> 172.21.15.42:0/2971166448 conn(0x7f64000d44f0 msgr2=0x7f64000d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.981+0000 7f6408053640 1 -- 172.21.15.42:0/2971166448 shutdown_connections 2024-09-16T01:56:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.981+0000 7f6408053640 1 -- 172.21.15.42:0/2971166448 wait complete. 2024-09-16T01:56:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.982+0000 7f6408053640 1 Processor -- start 2024-09-16T01:56:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.982+0000 7f6408053640 1 -- start start 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f6408053640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 0x7f64000cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f6408053640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 0x7f64000b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f6408053640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6400162060 0x7f64000b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f6408053640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f64000b6cb0 con 0x7f6400161c80 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f6408053640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f64000b6b30 con 0x7f6400162060 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f6408053640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f64000cf720 con 0x7f64000b6680 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64055ee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 0x7f64000b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64055ee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 0x7f64000b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49200/0 (socket says 172.21.15.42:49200) 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64055ee640 1 -- 172.21.15.42:0/1985249632 learned_addr learned my addr 172.21.15.42:0/1985249632 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f6405def640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 0x7f64000cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64065f0640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6400162060 0x7f64000b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64055ee640 1 -- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 msgr2=0x7f64000cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64055ee640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 0x7f64000cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64055ee640 1 -- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6400162060 msgr2=0x7f64000b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64055ee640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6400162060 0x7f64000b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64055ee640 1 -- 172.21.15.42:0/1985249632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64000b2cc0 con 0x7f6400161c80 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64065f0640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6400162060 0x7f64000b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f64055ee640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 0x7f64000b20b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f63f000c410 tx=0x7f63f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.983+0000 7f63f67fc640 1 -- 172.21.15.42:0/1985249632 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f00074e0 con 0x7f6400161c80 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.984+0000 7f63f67fc640 1 -- 172.21.15.42:0/1985249632 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f00047e0 con 0x7f6400161c80 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.984+0000 7f6408053640 1 -- 172.21.15.42:0/1985249632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64000b2fa0 con 0x7f6400161c80 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.984+0000 7f63f67fc640 1 -- 172.21.15.42:0/1985249632 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0004bd0 con 0x7f6400161c80 2024-09-16T01:56:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.984+0000 7f6408053640 1 -- 172.21.15.42:0/1985249632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64000b3560 con 0x7f6400161c80 2024-09-16T01:56:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.985+0000 7f6408053640 1 -- 172.21.15.42:0/1985249632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64000ba470 con 0x7f6400161c80 2024-09-16T01:56:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.985+0000 7f63f67fc640 1 -- 172.21.15.42:0/1985249632 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f63f0011070 con 0x7f6400161c80 2024-09-16T01:56:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.986+0000 7f63f67fc640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f63e406c2b0 0x7f63e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.986+0000 7f63f67fc640 1 -- 172.21.15.42:0/1985249632 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f63f008b1a0 con 0x7f6400161c80 2024-09-16T01:56:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.986+0000 7f6405def640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f63e406c2b0 0x7f63e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.986+0000 7f6405def640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f63e406c2b0 0x7f63e406e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f63fc034000 tx=0x7f63fc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:00.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:00.990+0000 7f63f67fc640 1 -- 172.21.15.42:0/1985249632 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f640006e870 con 0x7f6400161c80 2024-09-16T01:56:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.163+0000 7f6408053640 1 -- 172.21.15.42:0/1985249632 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64000cf1c0 con 0x7f63e406c2b0 2024-09-16T01:56:01.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.169+0000 7f63f67fc640 1 -- 172.21.15.42:0/1985249632 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239731 (secure 0 0 0) 0x7f64000cf1c0 con 0x7f63e406c2b0 2024-09-16T01:56:01.173 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:01.174 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:56:01.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 -- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f63e406c2b0 msgr2=0x7f63e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f63e406c2b0 0x7f63e406e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f63fc034000 tx=0x7f63fc02e000 comp rx=0 tx=0).stop 2024-09-16T01:56:01.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 -- 172.21.15.42:0/1985249632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 msgr2=0x7f64000b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 0x7f64000b20b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f63f000c410 tx=0x7f63f000c8d0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 -- 172.21.15.42:0/1985249632 shutdown_connections 2024-09-16T01:56:01.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f63e406c2b0 0x7f63e406e770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6400162060 0x7f64000b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6400161c80 0x7f64000b20b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 --2- 172.21.15.42:0/1985249632 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f64000b6680 0x7f64000cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 -- 172.21.15.42:0/1985249632 >> 172.21.15.42:0/1985249632 conn(0x7f64000d44f0 msgr2=0x7f64000b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:01.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 -- 172.21.15.42:0/1985249632 shutdown_connections 2024-09-16T01:56:01.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.172+0000 7f6408053640 1 -- 172.21.15.42:0/1985249632 wait complete. 2024-09-16T01:56:01.184 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-16T01:56:00.273210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":238280,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736440,"statfs":{"total":773094113280,"available":772850114560,"internally_reserved":0,"allocated":5529600,"data_stored":3060760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.621602"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687263+0000","last_change":"2024-09-16T01:55:57.685621+0000","last_active":"2024-09-16T01:55:57.687263+0000","last_peered":"2024-09-16T01:55:57.687263+0000","last_clean":"2024-09-16T01:55:57.687263+0000","last_became_active":"2024-09-16T01:55:57.685327+0000","last_became_peered":"2024-09-16T01:55:57.685327+0000","last_unstale":"2024-09-16T01:55:57.687263+0000","last_undegraded":"2024-09-16T01:55:57.687263+0000","last_fullsized":"2024-09-16T01:55:57.687263+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:05.569965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.691289+0000","last_change":"2024-09-16T01:55:57.690864+0000","last_active":"2024-09-16T01:55:57.691289+0000","last_peered":"2024-09-16T01:55:57.691289+0000","last_clean":"2024-09-16T01:55:57.691289+0000","last_became_active":"2024-09-16T01:55:57.690592+0000","last_became_peered":"2024-09-16T01:55:57.690592+0000","last_unstale":"2024-09-16T01:55:57.691289+0000","last_undegraded":"2024-09-16T01:55:57.691289+0000","last_fullsized":"2024-09-16T01:55:57.691289+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:07.055332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-16T01:55:56.661097+0000","last_change":"2024-09-16T01:55:56.661097+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.661097+0000","last_undegraded":"2024-09-16T01:55:56.661097+0000","last_fullsized":"2024-09-16T01:55:56.661097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.686829+0000","last_change":"2024-09-16T01:55:57.682642+0000","last_active":"2024-09-16T01:55:57.686829+0000","last_peered":"2024-09-16T01:55:57.686829+0000","last_clean":"2024-09-16T01:55:57.686829+0000","last_became_active":"2024-09-16T01:55:57.682366+0000","last_became_peered":"2024-09-16T01:55:57.682366+0000","last_unstale":"2024-09-16T01:55:57.686829+0000","last_undegraded":"2024-09-16T01:55:57.686829+0000","last_fullsized":"2024-09-16T01:55:57.686829+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:31.190709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687283+0000","last_change":"2024-09-16T01:55:57.685916+0000","last_active":"2024-09-16T01:55:57.687283+0000","last_peered":"2024-09-16T01:55:57.687283+0000","last_clean":"2024-09-16T01:55:57.687283+0000","last_became_active":"2024-09-16T01:55:57.685633+0000","last_became_peered":"2024-09-16T01:55:57.685633+0000","last_unstale":"2024-09-16T01:55:57.687283+0000","last_undegraded":"2024-09-16T01:55:57.687283+0000","last_fullsized":"2024-09-16T01:55:57.687283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:17.321579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-16T01:55:56.661482+0000","last_change":"2024-09-16T01:55:56.661482+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.661482+0000","last_undegraded":"2024-09-16T01:55:56.661482+0000","last_fullsized":"2024-09-16T01:55:56.661482+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687174+0000","last_change":"2024-09-16T01:55:57.685078+0000","last_active":"2024-09-16T01:55:57.687174+0000","last_peered":"2024-09-16T01:55:57.687174+0000","last_clean":"2024-09-16T01:55:57.687174+0000","last_became_active":"2024-09-16T01:55:57.684620+0000","last_became_peered":"2024-09-16T01:55:57.684620+0000","last_unstale":"2024-09-16T01:55:57.687174+0000","last_undegraded":"2024-09-16T01:55:57.687174+0000","last_fullsized":"2024-09-16T01:55:57.687174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:32.690387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687222+0000","last_change":"2024-09-16T01:55:57.685696+0000","last_active":"2024-09-16T01:55:57.687222+0000","last_peered":"2024-09-16T01:55:57.687222+0000","last_clean":"2024-09-16T01:55:57.687222+0000","last_became_active":"2024-09-16T01:55:57.685420+0000","last_became_peered":"2024-09-16T01:55:57.685420+0000","last_unstale":"2024-09-16T01:55:57.687222+0000","last_undegraded":"2024-09-16T01:55:57.687222+0000","last_fullsized":"2024-09-16T01:55:57.687222+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:00.492003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.689141+0000","last_change":"2024-09-16T01:55:57.687961+0000","last_active":"2024-09-16T01:55:57.689141+0000","last_peered":"2024-09-16T01:55:57.689141+0000","last_clean":"2024-09-16T01:55:57.689141+0000","last_became_active":"2024-09-16T01:55:57.687680+0000","last_became_peered":"2024-09-16T01:55:57.687680+0000","last_unstale":"2024-09-16T01:55:57.689141+0000","last_undegraded":"2024-09-16T01:55:57.689141+0000","last_fullsized":"2024-09-16T01:55:57.689141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:19.323091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.688781+0000","last_change":"2024-09-16T01:55:57.686963+0000","last_active":"2024-09-16T01:55:57.688781+0000","last_peered":"2024-09-16T01:55:57.688781+0000","last_clean":"2024-09-16T01:55:57.688781+0000","last_became_active":"2024-09-16T01:55:57.686686+0000","last_became_peered":"2024-09-16T01:55:57.686686+0000","last_unstale":"2024-09-16T01:55:57.688781+0000","last_undegraded":"2024-09-16T01:55:57.688781+0000","last_fullsized":"2024-09-16T01:55:57.688781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:18.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.676027+0000","last_change":"2024-09-16T01:55:56.674828+0000","last_active":"2024-09-16T01:55:57.676027+0000","last_peered":"2024-09-16T01:55:57.676027+0000","last_clean":"2024-09-16T01:55:57.676027+0000","last_became_active":"2024-09-16T01:55:56.674519+0000","last_became_peered":"2024-09-16T01:55:56.674519+0000","last_unstale":"2024-09-16T01:55:57.676027+0000","last_undegraded":"2024-09-16T01:55:57.676027+0000","last_fullsized":"2024-09-16T01:55:57.676027+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:34.317242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.686332+0000","last_change":"2024-09-16T01:55:56.678488+0000","last_active":"2024-09-16T01:55:57.686332+0000","last_peered":"2024-09-16T01:55:57.686332+0000","last_clean":"2024-09-16T01:55:57.686332+0000","last_became_active":"2024-09-16T01:55:56.678214+0000","last_became_peered":"2024-09-16T01:55:56.678214+0000","last_unstale":"2024-09-16T01:55:57.686332+0000","last_undegraded":"2024-09-16T01:55:57.686332+0000","last_fullsized":"2024-09-16T01:55:57.686332+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:10.936010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673991+0000","last_change":"2024-09-16T01:55:56.677509+0000","last_active":"2024-09-16T01:55:57.673991+0000","last_peered":"2024-09-16T01:55:57.673991+0000","last_clean":"2024-09-16T01:55:57.673991+0000","last_became_active":"2024-09-16T01:55:56.677242+0000","last_became_peered":"2024-09-16T01:55:56.677242+0000","last_unstale":"2024-09-16T01:55:57.673991+0000","last_undegraded":"2024-09-16T01:55:57.673991+0000","last_fullsized":"2024-09-16T01:55:57.673991+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:09.600659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-16T01:55:56.675261+0000","last_change":"2024-09-16T01:55:56.671401+0000","last_active":"2024-09-16T01:55:56.675261+0000","last_peered":"2024-09-16T01:55:56.675261+0000","last_clean":"2024-09-16T01:55:56.675261+0000","last_became_active":"2024-09-16T01:55:56.671110+0000","last_became_peered":"2024-09-16T01:55:56.671110+0000","last_unstale":"2024-09-16T01:55:56.675261+0000","last_undegraded":"2024-09-16T01:55:56.675261+0000","last_fullsized":"2024-09-16T01:55:56.675261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:03.371540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-16T01:55:56.675221+0000","last_change":"2024-09-16T01:55:56.671230+0000","last_active":"2024-09-16T01:55:56.675221+0000","last_peered":"2024-09-16T01:55:56.675221+0000","last_clean":"2024-09-16T01:55:56.675221+0000","last_became_active":"2024-09-16T01:55:56.670928+0000","last_became_peered":"2024-09-16T01:55:56.670928+0000","last_unstale":"2024-09-16T01:55:56.675221+0000","last_undegraded":"2024-09-16T01:55:56.675221+0000","last_fullsized":"2024-09-16T01:55:56.675221+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:15.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673380+0000","last_change":"2024-09-16T01:55:56.675512+0000","last_active":"2024-09-16T01:55:57.673380+0000","last_peered":"2024-09-16T01:55:57.673380+0000","last_clean":"2024-09-16T01:55:57.673380+0000","last_became_active":"2024-09-16T01:55:56.675235+0000","last_became_peered":"2024-09-16T01:55:56.675235+0000","last_unstale":"2024-09-16T01:55:57.673380+0000","last_undegraded":"2024-09-16T01:55:57.673380+0000","last_fullsized":"2024-09-16T01:55:57.673380+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:44.890291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":221,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673695+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:55:57.673695+0000","last_peered":"2024-09-16T01:55:57.673695+0000","last_clean":"2024-09-16T01:55:57.673695+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:55:57.673695+0000","last_undegraded":"2024-09-16T01:55:57.673695+0000","last_fullsized":"2024-09-16T01:55:57.673695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1130496,"data_stored":822152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1155072,"data_stored":835028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":561152,"data_stored":244660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:56:01.189 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:56:01.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.325+0000 7fd952fc0640 1 Processor -- start 2024-09-16T01:56:01.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.325+0000 7fd952fc0640 1 -- start start 2024-09-16T01:56:01.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.326+0000 7fd952fc0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd94c15e5b0 0x7fd94c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:01.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.326+0000 7fd952fc0640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94c0b6520 con 0x7fd94c0ae140 2024-09-16T01:56:01.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.326+0000 7fd952fc0640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94c0b1a40 con 0x7fd94c15e990 2024-09-16T01:56:01.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.326+0000 7fd952fc0640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd94c0b2c30 con 0x7fd94c15e5b0 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.326+0000 7fd950d5c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd94c15e5b0 0x7fd94c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.326+0000 7fd95155d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd94c0ae140 0x7fd94c0ae5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52772/0 (socket says 172.21.15.42:52772) 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.327+0000 7fd95155d640 1 -- 172.21.15.42:0/731053448 learned_addr learned my addr 172.21.15.42:0/731053448 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.327+0000 7fd950d5c640 1 -- 172.21.15.42:0/731053448 >> v1:172.21.15.107:6789/0 conn(0x7fd94c15e990 legacy=0x7fd94c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.327+0000 7fd950d5c640 1 -- 172.21.15.42:0/731053448 >> v1:172.21.15.42:6789/0 conn(0x7fd94c0ae140 legacy=0x7fd94c0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.327+0000 7fd94b7fe640 1 -- 172.21.15.42:0/731053448 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2364342042 0 0) 0x7fd94c0b6520 con 0x7fd94c0ae140 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.327+0000 7fd950d5c640 1 -- 172.21.15.42:0/731053448 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c0b1d20 con 0x7fd94c15e5b0 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd950d5c640 1 --2- 172.21.15.42:0/731053448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c15e5b0 0x7fd94c0b5f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd944009d90 tx=0x7fd94402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa603b627e4d9d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd94b7fe640 1 -- 172.21.15.42:0/731053448 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944007740 con 0x7fd94c15e5b0 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd94b7fe640 1 -- 172.21.15.42:0/731053448 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9440078e0 con 0x7fd94c15e5b0 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd94b7fe640 1 -- 172.21.15.42:0/731053448 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944007cb0 con 0x7fd94c15e5b0 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd952fc0640 1 -- 172.21.15.42:0/731053448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c15e5b0 msgr2=0x7fd94c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd952fc0640 1 --2- 172.21.15.42:0/731053448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c15e5b0 0x7fd94c0b5f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd944009d90 tx=0x7fd94402a6a0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd952fc0640 1 -- 172.21.15.42:0/731053448 shutdown_connections 2024-09-16T01:56:01.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd952fc0640 1 --2- 172.21.15.42:0/731053448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c15e5b0 0x7fd94c0b5f40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd952fc0640 1 -- 172.21.15.42:0/731053448 >> 172.21.15.42:0/731053448 conn(0x7fd94c073490 msgr2=0x7fd94c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:01.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd952fc0640 1 -- 172.21.15.42:0/731053448 shutdown_connections 2024-09-16T01:56:01.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.328+0000 7fd952fc0640 1 -- 172.21.15.42:0/731053448 wait complete. 2024-09-16T01:56:01.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.329+0000 7fd952fc0640 1 Processor -- start 2024-09-16T01:56:01.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.330+0000 7fd952fc0640 1 -- start start 2024-09-16T01:56:01.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.330+0000 7fd952fc0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c0ae140 0x7fd94c149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:01.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.330+0000 7fd952fc0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd94c15e5b0 0x7fd94c1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:01.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.330+0000 7fd952fc0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd94c15e990 0x7fd94c155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:01.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.330+0000 7fd952fc0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c0b0490 con 0x7fd94c0ae140 2024-09-16T01:56:01.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.330+0000 7fd952fc0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c0b17f0 con 0x7fd94c15e990 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.330+0000 7fd952fc0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c169360 con 0x7fd94c15e5b0 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd950d5c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c0ae140 0x7fd94c149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd950d5c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c0ae140 0x7fd94c149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49228/0 (socket says 172.21.15.42:49228) 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd950d5c640 1 -- 172.21.15.42:0/1773964162 learned_addr learned my addr 172.21.15.42:0/1773964162 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd94bfff640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd94c15e5b0 0x7fd94c1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd95155d640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd94c15e990 0x7fd94c155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd950d5c640 1 -- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd94c15e5b0 msgr2=0x7fd94c1555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd950d5c640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd94c15e5b0 0x7fd94c1555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd950d5c640 1 -- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd94c15e990 msgr2=0x7fd94c155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd950d5c640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd94c15e990 0x7fd94c155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd950d5c640 1 -- 172.21.15.42:0/1773964162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c1f6640 con 0x7fd94c0ae140 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd94bfff640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd94c15e5b0 0x7fd94c1555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:01.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd950d5c640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c0ae140 0x7fd94c149eb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd944009d90 tx=0x7fd944004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:01.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd9497fa640 1 -- 172.21.15.42:0/1773964162 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944040070 con 0x7fd94c0ae140 2024-09-16T01:56:01.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd9497fa640 1 -- 172.21.15.42:0/1773964162 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd944031c40 con 0x7fd94c0ae140 2024-09-16T01:56:01.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd9497fa640 1 -- 172.21.15.42:0/1773964162 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944003990 con 0x7fd94c0ae140 2024-09-16T01:56:01.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd952fc0640 1 -- 172.21.15.42:0/1773964162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94c1f6920 con 0x7fd94c0ae140 2024-09-16T01:56:01.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.331+0000 7fd952fc0640 1 -- 172.21.15.42:0/1773964162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94c1f6ee0 con 0x7fd94c0ae140 2024-09-16T01:56:01.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.332+0000 7fd952fc0640 1 -- 172.21.15.42:0/1773964162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd94c0b5f40 con 0x7fd94c0ae140 2024-09-16T01:56:01.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.333+0000 7fd9497fa640 1 -- 172.21.15.42:0/1773964162 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd944039040 con 0x7fd94c0ae140 2024-09-16T01:56:01.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.333+0000 7fd9497fa640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd93806c2b0 0x7fd93806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:01.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.333+0000 7fd9497fa640 1 -- 172.21.15.42:0/1773964162 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fd9440ac5e0 con 0x7fd94c0ae140 2024-09-16T01:56:01.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.334+0000 7fd94bfff640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd93806c2b0 0x7fd93806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:01.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.334+0000 7fd94bfff640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd93806c2b0 0x7fd93806e770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd94c150bf0 tx=0x7fd940009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:01.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.338+0000 7fd9497fa640 1 -- 172.21.15.42:0/1773964162 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd94407abc0 con 0x7fd94c0ae140 2024-09-16T01:56:01.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.509+0000 7fd952fc0640 1 -- 172.21.15.42:0/1773964162 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd94c1f7360 con 0x7fd93806c2b0 2024-09-16T01:56:01.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.515+0000 7fd9497fa640 1 -- 172.21.15.42:0/1773964162 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239731 (secure 0 0 0) 0x7fd94c1f7360 con 0x7fd93806c2b0 2024-09-16T01:56:01.519 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:01.520 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:56:01.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 -- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd93806c2b0 msgr2=0x7fd93806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd93806c2b0 0x7fd93806e770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd94c150bf0 tx=0x7fd940009040 comp rx=0 tx=0).stop 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 -- 172.21.15.42:0/1773964162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c0ae140 msgr2=0x7fd94c149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c0ae140 0x7fd94c149eb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd944009d90 tx=0x7fd944004a40 comp rx=0 tx=0).stop 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 -- 172.21.15.42:0/1773964162 shutdown_connections 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd93806c2b0 0x7fd93806e770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd94c15e990 0x7fd94c155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd94c15e5b0 0x7fd94c1555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 --2- 172.21.15.42:0/1773964162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd94c0ae140 0x7fd94c149eb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 -- 172.21.15.42:0/1773964162 >> 172.21.15.42:0/1773964162 conn(0x7fd94c073490 msgr2=0x7fd94c06eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 -- 172.21.15.42:0/1773964162 shutdown_connections 2024-09-16T01:56:01.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.518+0000 7fd952fc0640 1 -- 172.21.15.42:0/1773964162 wait complete. 2024-09-16T01:56:01.530 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-16T01:56:00.273210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":238280,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736440,"statfs":{"total":773094113280,"available":772850114560,"internally_reserved":0,"allocated":5529600,"data_stored":3060760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.621602"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687263+0000","last_change":"2024-09-16T01:55:57.685621+0000","last_active":"2024-09-16T01:55:57.687263+0000","last_peered":"2024-09-16T01:55:57.687263+0000","last_clean":"2024-09-16T01:55:57.687263+0000","last_became_active":"2024-09-16T01:55:57.685327+0000","last_became_peered":"2024-09-16T01:55:57.685327+0000","last_unstale":"2024-09-16T01:55:57.687263+0000","last_undegraded":"2024-09-16T01:55:57.687263+0000","last_fullsized":"2024-09-16T01:55:57.687263+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:05.569965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.691289+0000","last_change":"2024-09-16T01:55:57.690864+0000","last_active":"2024-09-16T01:55:57.691289+0000","last_peered":"2024-09-16T01:55:57.691289+0000","last_clean":"2024-09-16T01:55:57.691289+0000","last_became_active":"2024-09-16T01:55:57.690592+0000","last_became_peered":"2024-09-16T01:55:57.690592+0000","last_unstale":"2024-09-16T01:55:57.691289+0000","last_undegraded":"2024-09-16T01:55:57.691289+0000","last_fullsized":"2024-09-16T01:55:57.691289+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:07.055332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-16T01:55:56.661097+0000","last_change":"2024-09-16T01:55:56.661097+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.661097+0000","last_undegraded":"2024-09-16T01:55:56.661097+0000","last_fullsized":"2024-09-16T01:55:56.661097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.686829+0000","last_change":"2024-09-16T01:55:57.682642+0000","last_active":"2024-09-16T01:55:57.686829+0000","last_peered":"2024-09-16T01:55:57.686829+0000","last_clean":"2024-09-16T01:55:57.686829+0000","last_became_active":"2024-09-16T01:55:57.682366+0000","last_became_peered":"2024-09-16T01:55:57.682366+0000","last_unstale":"2024-09-16T01:55:57.686829+0000","last_undegraded":"2024-09-16T01:55:57.686829+0000","last_fullsized":"2024-09-16T01:55:57.686829+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:31.190709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687283+0000","last_change":"2024-09-16T01:55:57.685916+0000","last_active":"2024-09-16T01:55:57.687283+0000","last_peered":"2024-09-16T01:55:57.687283+0000","last_clean":"2024-09-16T01:55:57.687283+0000","last_became_active":"2024-09-16T01:55:57.685633+0000","last_became_peered":"2024-09-16T01:55:57.685633+0000","last_unstale":"2024-09-16T01:55:57.687283+0000","last_undegraded":"2024-09-16T01:55:57.687283+0000","last_fullsized":"2024-09-16T01:55:57.687283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:17.321579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-16T01:55:56.661482+0000","last_change":"2024-09-16T01:55:56.661482+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.661482+0000","last_undegraded":"2024-09-16T01:55:56.661482+0000","last_fullsized":"2024-09-16T01:55:56.661482+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687174+0000","last_change":"2024-09-16T01:55:57.685078+0000","last_active":"2024-09-16T01:55:57.687174+0000","last_peered":"2024-09-16T01:55:57.687174+0000","last_clean":"2024-09-16T01:55:57.687174+0000","last_became_active":"2024-09-16T01:55:57.684620+0000","last_became_peered":"2024-09-16T01:55:57.684620+0000","last_unstale":"2024-09-16T01:55:57.687174+0000","last_undegraded":"2024-09-16T01:55:57.687174+0000","last_fullsized":"2024-09-16T01:55:57.687174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:32.690387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687222+0000","last_change":"2024-09-16T01:55:57.685696+0000","last_active":"2024-09-16T01:55:57.687222+0000","last_peered":"2024-09-16T01:55:57.687222+0000","last_clean":"2024-09-16T01:55:57.687222+0000","last_became_active":"2024-09-16T01:55:57.685420+0000","last_became_peered":"2024-09-16T01:55:57.685420+0000","last_unstale":"2024-09-16T01:55:57.687222+0000","last_undegraded":"2024-09-16T01:55:57.687222+0000","last_fullsized":"2024-09-16T01:55:57.687222+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:00.492003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.689141+0000","last_change":"2024-09-16T01:55:57.687961+0000","last_active":"2024-09-16T01:55:57.689141+0000","last_peered":"2024-09-16T01:55:57.689141+0000","last_clean":"2024-09-16T01:55:57.689141+0000","last_became_active":"2024-09-16T01:55:57.687680+0000","last_became_peered":"2024-09-16T01:55:57.687680+0000","last_unstale":"2024-09-16T01:55:57.689141+0000","last_undegraded":"2024-09-16T01:55:57.689141+0000","last_fullsized":"2024-09-16T01:55:57.689141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:19.323091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.688781+0000","last_change":"2024-09-16T01:55:57.686963+0000","last_active":"2024-09-16T01:55:57.688781+0000","last_peered":"2024-09-16T01:55:57.688781+0000","last_clean":"2024-09-16T01:55:57.688781+0000","last_became_active":"2024-09-16T01:55:57.686686+0000","last_became_peered":"2024-09-16T01:55:57.686686+0000","last_unstale":"2024-09-16T01:55:57.688781+0000","last_undegraded":"2024-09-16T01:55:57.688781+0000","last_fullsized":"2024-09-16T01:55:57.688781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:18.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.676027+0000","last_change":"2024-09-16T01:55:56.674828+0000","last_active":"2024-09-16T01:55:57.676027+0000","last_peered":"2024-09-16T01:55:57.676027+0000","last_clean":"2024-09-16T01:55:57.676027+0000","last_became_active":"2024-09-16T01:55:56.674519+0000","last_became_peered":"2024-09-16T01:55:56.674519+0000","last_unstale":"2024-09-16T01:55:57.676027+0000","last_undegraded":"2024-09-16T01:55:57.676027+0000","last_fullsized":"2024-09-16T01:55:57.676027+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:34.317242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.686332+0000","last_change":"2024-09-16T01:55:56.678488+0000","last_active":"2024-09-16T01:55:57.686332+0000","last_peered":"2024-09-16T01:55:57.686332+0000","last_clean":"2024-09-16T01:55:57.686332+0000","last_became_active":"2024-09-16T01:55:56.678214+0000","last_became_peered":"2024-09-16T01:55:56.678214+0000","last_unstale":"2024-09-16T01:55:57.686332+0000","last_undegraded":"2024-09-16T01:55:57.686332+0000","last_fullsized":"2024-09-16T01:55:57.686332+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:10.936010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673991+0000","last_change":"2024-09-16T01:55:56.677509+0000","last_active":"2024-09-16T01:55:57.673991+0000","last_peered":"2024-09-16T01:55:57.673991+0000","last_clean":"2024-09-16T01:55:57.673991+0000","last_became_active":"2024-09-16T01:55:56.677242+0000","last_became_peered":"2024-09-16T01:55:56.677242+0000","last_unstale":"2024-09-16T01:55:57.673991+0000","last_undegraded":"2024-09-16T01:55:57.673991+0000","last_fullsized":"2024-09-16T01:55:57.673991+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:09.600659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-16T01:55:56.675261+0000","last_change":"2024-09-16T01:55:56.671401+0000","last_active":"2024-09-16T01:55:56.675261+0000","last_peered":"2024-09-16T01:55:56.675261+0000","last_clean":"2024-09-16T01:55:56.675261+0000","last_became_active":"2024-09-16T01:55:56.671110+0000","last_became_peered":"2024-09-16T01:55:56.671110+0000","last_unstale":"2024-09-16T01:55:56.675261+0000","last_undegraded":"2024-09-16T01:55:56.675261+0000","last_fullsized":"2024-09-16T01:55:56.675261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:03.371540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-16T01:55:56.675221+0000","last_change":"2024-09-16T01:55:56.671230+0000","last_active":"2024-09-16T01:55:56.675221+0000","last_peered":"2024-09-16T01:55:56.675221+0000","last_clean":"2024-09-16T01:55:56.675221+0000","last_became_active":"2024-09-16T01:55:56.670928+0000","last_became_peered":"2024-09-16T01:55:56.670928+0000","last_unstale":"2024-09-16T01:55:56.675221+0000","last_undegraded":"2024-09-16T01:55:56.675221+0000","last_fullsized":"2024-09-16T01:55:56.675221+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:15.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673380+0000","last_change":"2024-09-16T01:55:56.675512+0000","last_active":"2024-09-16T01:55:57.673380+0000","last_peered":"2024-09-16T01:55:57.673380+0000","last_clean":"2024-09-16T01:55:57.673380+0000","last_became_active":"2024-09-16T01:55:56.675235+0000","last_became_peered":"2024-09-16T01:55:56.675235+0000","last_unstale":"2024-09-16T01:55:57.673380+0000","last_undegraded":"2024-09-16T01:55:57.673380+0000","last_fullsized":"2024-09-16T01:55:57.673380+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:44.890291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":221,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673695+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:55:57.673695+0000","last_peered":"2024-09-16T01:55:57.673695+0000","last_clean":"2024-09-16T01:55:57.673695+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:55:57.673695+0000","last_undegraded":"2024-09-16T01:55:57.673695+0000","last_fullsized":"2024-09-16T01:55:57.673695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1130496,"data_stored":822152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1155072,"data_stored":835028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":561152,"data_stored":244660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:56:01.537 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3f is not active+clean 2024-09-16T01:56:01.537 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.537 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3d is not active+clean 2024-09-16T01:56:01.537 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.537 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-09-16T01:56:01.537 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.537 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3a is not active+clean 2024-09-16T01:56:01.537 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.538 INFO:tasks.ceph.ceph_manager.ceph:PG 8.39 is not active+clean 2024-09-16T01:56:01.538 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.538 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-09-16T01:56:01.538 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.538 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-09-16T01:56:01.538 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.538 INFO:tasks.ceph.ceph_manager.ceph:PG 8.36 is not active+clean 2024-09-16T01:56:01.538 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.538 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-09-16T01:56:01.538 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:55:56.661097+0000', 'last_change': '2024-09-16T01:55:56.661097+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.661097+0000', 'last_undegraded': '2024-09-16T01:55:56.661097+0000', 'last_fullsized': '2024-09-16T01:55:56.661097+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:56:01.539 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-09-16T01:56:01.539 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.539 INFO:tasks.ceph.ceph_manager.ceph:PG 8.33 is not active+clean 2024-09-16T01:56:01.539 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.539 INFO:tasks.ceph.ceph_manager.ceph:PG 8.32 is not active+clean 2024-09-16T01:56:01.539 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.539 INFO:tasks.ceph.ceph_manager.ceph:PG 8.30 is not active+clean 2024-09-16T01:56:01.539 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.539 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2f is not active+clean 2024-09-16T01:56:01.539 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:55:56.661482+0000', 'last_change': '2024-09-16T01:55:56.661482+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.661482+0000', 'last_undegraded': '2024-09-16T01:55:56.661482+0000', 'last_fullsized': '2024-09-16T01:55:56.661482+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:PG 8.28 is not active+clean 2024-09-16T01:56:01.540 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.541 INFO:tasks.ceph.ceph_manager.ceph:PG 8.27 is not active+clean 2024-09-16T01:56:01.541 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.541 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-16T01:56:01.541 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.541 INFO:tasks.ceph.ceph_manager.ceph:PG 8.25 is not active+clean 2024-09-16T01:56:01.541 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.541 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-09-16T01:56:01.541 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.541 INFO:tasks.ceph.ceph_manager.ceph:PG 8.23 is not active+clean 2024-09-16T01:56:01.541 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:PG 8.21 is not active+clean 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.542 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-16T01:56:01.543 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.544 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-16T01:56:01.545 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.546 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-16T01:56:01.547 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-09-16T01:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-16T01:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-16T01:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-16T01:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-09-16T01:56:01.548 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-16T01:56:01.549 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.550 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-09-16T01:56:01.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.550 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-16T01:56:01.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.550 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-16T01:56:01.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.550 INFO:tasks.ceph.ceph_manager.ceph:PG 8.c is not active+clean 2024-09-16T01:56:01.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.550 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-16T01:56:01.550 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:PG 8.e is not active+clean 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-16T01:56:01.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.552 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-09-16T01:56:01.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:56.650152+0000', 'last_change': '2024-09-16T01:55:56.650152+0000', 'last_active': '2024-09-16T01:55:56.650152+0000', 'last_peered': '2024-09-16T01:55:56.650152+0000', 'last_clean': '2024-09-16T01:55:56.650152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:56.650152+0000', 'last_undegraded': '2024-09-16T01:55:56.650152+0000', 'last_fullsized': '2024-09-16T01:55:56.650152+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:56.650152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.552 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-16T01:56:01.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:55:55.642749+0000', 'last_change': '2024-09-16T01:55:55.642749+0000', 'last_active': '2024-09-16T01:55:55.642749+0000', 'last_peered': '2024-09-16T01:55:55.642749+0000', 'last_clean': '2024-09-16T01:55:55.642749+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:55:55.642749+0000', 'last_undegraded': '2024-09-16T01:55:55.642749+0000', 'last_fullsized': '2024-09-16T01:55:55.642749+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'last_clean_scrub_stamp': '2024-09-16T01:55:55.642749+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:56:01.552 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T01:56:01.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.670+0000 7f69f6742640 1 Processor -- start 2024-09-16T01:56:01.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.670+0000 7f69f6742640 1 -- start start 2024-09-16T01:56:01.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69f6742640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 0x7f69f00d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:01.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69f6742640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f00cf980 con 0x7f69f00cf330 2024-09-16T01:56:01.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69f6742640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f006d050 con 0x7f69f00d1420 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69f6742640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f69f0161e00 con 0x7f69f0161a20 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69f4cdf640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f69f00cf330 0x7f69f006d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52780/0 (socket says 172.21.15.42:52780) 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69f4cdf640 1 -- 172.21.15.42:0/671314546 learned_addr learned my addr 172.21.15.42:0/671314546 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69effff640 1 --2- 172.21.15.42:0/671314546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 0x7f69f00d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69eeffd640 1 -- 172.21.15.42:0/671314546 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 423891027 0 0) 0x7f69f00cf980 con 0x7f69f00cf330 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69eeffd640 1 -- 172.21.15.42:0/671314546 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69dc003520 con 0x7f69f00cf330 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69eeffd640 1 -- 172.21.15.42:0/671314546 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259161690 0 0) 0x7f69f006d050 con 0x7f69f00d1420 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69eeffd640 1 -- 172.21.15.42:0/671314546 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69f00cf980 con 0x7f69f00d1420 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69eeffd640 1 -- 172.21.15.42:0/671314546 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2121562764 0 0) 0x7f69dc003520 con 0x7f69f00cf330 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69effff640 1 -- 172.21.15.42:0/671314546 >> v1:172.21.15.107:6789/0 conn(0x7f69f00d1420 legacy=0x7f69f00cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.671+0000 7f69effff640 1 -- 172.21.15.42:0/671314546 >> v1:172.21.15.42:6789/0 conn(0x7f69f00cf330 legacy=0x7f69f006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.672+0000 7f69effff640 1 -- 172.21.15.42:0/671314546 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f00d1800 con 0x7f69f0161a20 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.672+0000 7f69effff640 1 --2- 172.21.15.42:0/671314546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 0x7f69f00d0ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f69e00097d0 tx=0x7f69e002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1de41e515f74d85f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.672+0000 7f69eeffd640 1 -- 172.21.15.42:0/671314546 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0037070 con 0x7f69f0161a20 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.672+0000 7f69eeffd640 1 -- 172.21.15.42:0/671314546 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69e002ac30 con 0x7f69f0161a20 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.673+0000 7f69eeffd640 1 -- 172.21.15.42:0/671314546 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e80019f0 con 0x7f69f0161a20 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.673+0000 7f69f6742640 1 -- 172.21.15.42:0/671314546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 msgr2=0x7f69f00d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.673+0000 7f69f6742640 1 --2- 172.21.15.42:0/671314546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 0x7f69f00d0ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f69e00097d0 tx=0x7f69e002a1a0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.673+0000 7f69f6742640 1 -- 172.21.15.42:0/671314546 shutdown_connections 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.673+0000 7f69f6742640 1 --2- 172.21.15.42:0/671314546 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 0x7f69f00d0ee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.673+0000 7f69f6742640 1 -- 172.21.15.42:0/671314546 >> 172.21.15.42:0/671314546 conn(0x7f69f009d850 msgr2=0x7f69f008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.673+0000 7f69f6742640 1 -- 172.21.15.42:0/671314546 shutdown_connections 2024-09-16T01:56:01.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.673+0000 7f69f6742640 1 -- 172.21.15.42:0/671314546 wait complete. 2024-09-16T01:56:01.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.674+0000 7f69f6742640 1 Processor -- start 2024-09-16T01:56:01.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.674+0000 7f69f6742640 1 -- start start 2024-09-16T01:56:01.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69f6742640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69f00cf330 0x7f69f01528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:01.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69f6742640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69f00d1420 0x7f69f00b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:01.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69f6742640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 0x7f69f00d2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:01.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69f6742640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f69f006d2f0 con 0x7f69f00d1420 2024-09-16T01:56:01.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69f6742640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f69f00cff00 con 0x7f69f00cf330 2024-09-16T01:56:01.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69f6742640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f69f00b1040 con 0x7f69f0161a20 2024-09-16T01:56:01.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69ef7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69f00d1420 0x7f69f00b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69ef7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69f00d1420 0x7f69f00b7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49230/0 (socket says 172.21.15.42:49230) 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69ef7fe640 1 -- 172.21.15.42:0/4102598227 learned_addr learned my addr 172.21.15.42:0/4102598227 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69effff640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69f00cf330 0x7f69f01528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.675+0000 7f69f4cdf640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 0x7f69f00d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69ef7fe640 1 -- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 msgr2=0x7f69f00d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69ef7fe640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 0x7f69f00d2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69ef7fe640 1 -- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69f00cf330 msgr2=0x7f69f01528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69ef7fe640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69f00cf330 0x7f69f01528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69ef7fe640 1 -- 172.21.15.42:0/4102598227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f009fb20 con 0x7f69f00d1420 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69f4cdf640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 0x7f69f00d2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69effff640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69f00cf330 0x7f69f01528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69ef7fe640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69f00d1420 0x7f69f00b7f00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f69d800c530 tx=0x7f69d800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:01.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69ecff9640 1 -- 172.21.15.42:0/4102598227 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d80052d0 con 0x7f69f00d1420 2024-09-16T01:56:01.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69ecff9640 1 -- 172.21.15.42:0/4102598227 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d8005490 con 0x7f69f00d1420 2024-09-16T01:56:01.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69f6742640 1 -- 172.21.15.42:0/4102598227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f00b8730 con 0x7f69f00d1420 2024-09-16T01:56:01.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69ecff9640 1 -- 172.21.15.42:0/4102598227 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8012870 con 0x7f69f00d1420 2024-09-16T01:56:01.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.676+0000 7f69f6742640 1 -- 172.21.15.42:0/4102598227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f00b8cf0 con 0x7f69f00d1420 2024-09-16T01:56:01.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.677+0000 7f69f6742640 1 -- 172.21.15.42:0/4102598227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f00d0ee0 con 0x7f69f00d1420 2024-09-16T01:56:01.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.677+0000 7f69ecff9640 1 -- 172.21.15.42:0/4102598227 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f69d8012a10 con 0x7f69f00d1420 2024-09-16T01:56:01.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.678+0000 7f69ecff9640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69d006c2e0 0x7f69d006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:01.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.678+0000 7f69ecff9640 1 -- 172.21.15.42:0/4102598227 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f69d808b2c0 con 0x7f69f00d1420 2024-09-16T01:56:01.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.678+0000 7f69effff640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69d006c2e0 0x7f69d006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:01.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.679+0000 7f69effff640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69d006c2e0 0x7f69d006e7a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f69e0034000 tx=0x7f69e002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:01.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.682+0000 7f69ecff9640 1 -- 172.21.15.42:0/4102598227 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69d80598e0 con 0x7f69f00d1420 2024-09-16T01:56:01.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.923+0000 7f69f6742640 1 -- 172.21.15.42:0/4102598227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f69f00cbe80 con 0x7f69f00d1420 2024-09-16T01:56:01.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.924+0000 7f69ecff9640 1 -- 172.21.15.42:0/4102598227 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1764 (secure 0 0 0) 0x7f69d80591e0 con 0x7f69f00d1420 2024-09-16T01:56:01.925 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:01.926 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":122,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1726451649,"num_in_osds":8,"osd_in_since":1726451640,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":80},{"state_name":"active+clean","count":15},{"state_name":"creating+peering","count":2}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590458,"bytes_used":243998720,"bytes_avail":772850114560,"bytes_total":773094113280,"unknown_pgs_ratio":0.82474225759506226,"inactive_pgs_ratio":0.020618556067347527,"write_bytes_sec":221,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":23,"btime":"2024-09-16T01:55:59:851792+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":34817}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-16T01:55:12.261235+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T01:56:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 -- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69d006c2e0 msgr2=0x7f69d006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69d006c2e0 0x7f69d006e7a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f69e0034000 tx=0x7f69e002e000 comp rx=0 tx=0).stop 2024-09-16T01:56:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 -- 172.21.15.42:0/4102598227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69f00d1420 msgr2=0x7f69f00b7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69f00d1420 0x7f69f00b7f00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f69d800c530 tx=0x7f69d800c9f0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 -- 172.21.15.42:0/4102598227 shutdown_connections 2024-09-16T01:56:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69d006c2e0 0x7f69d006e7a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69f0161a20 0x7f69f00d2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69f00d1420 0x7f69f00b7f00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 --2- 172.21.15.42:0/4102598227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69f00cf330 0x7f69f01528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 -- 172.21.15.42:0/4102598227 >> 172.21.15.42:0/4102598227 conn(0x7f69f009d850 msgr2=0x7f69f00cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:01.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 -- 172.21.15.42:0/4102598227 shutdown_connections 2024-09-16T01:56:01.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:01.926+0000 7f69f6742640 1 -- 172.21.15.42:0/4102598227 wait complete. 2024-09-16T01:56:01.940 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T01:56:01.941 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:56:02.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.041+0000 7f03c12af640 1 Processor -- start 2024-09-16T01:56:02.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.041+0000 7f03c12af640 1 -- start start 2024-09-16T01:56:02.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.042+0000 7f03c12af640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f03bc161c80 0x7f03bc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:02.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.042+0000 7f03c12af640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f03bc162060 0x7f03bc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:02.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.042+0000 7f03c12af640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc06e870 con 0x7f03bc0b64b0 2024-09-16T01:56:02.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.042+0000 7f03c12af640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f03bc06d9f0 con 0x7f03bc161c80 2024-09-16T01:56:02.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.042+0000 7f03c12af640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f03bc06dcd0 con 0x7f03bc162060 2024-09-16T01:56:02.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.042+0000 7f03baffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f03bc161c80 0x7f03bc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:02.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.042+0000 7f03baffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f03bc161c80 0x7f03bc06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49234/0 (socket says 172.21.15.42:49234) 2024-09-16T01:56:02.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.042+0000 7f03baffd640 1 -- 172.21.15.42:0/554267898 learned_addr learned my addr 172.21.15.42:0/554267898 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:02.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.043+0000 7f03ba7fc640 1 --2- 172.21.15.42:0/554267898 >> v2:172.21.15.107:3300/0 conn(0x7f03bc162060 0x7f03bc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:02.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.043+0000 7f03baffd640 1 -- 172.21.15.42:0/554267898 >> v2:172.21.15.107:3300/0 conn(0x7f03bc162060 msgr2=0x7f03bc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:02.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.043+0000 7f03baffd640 1 --2- 172.21.15.42:0/554267898 >> v2:172.21.15.107:3300/0 conn(0x7f03bc162060 0x7f03bc0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:02.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.043+0000 7f03baffd640 1 -- 172.21.15.42:0/554267898 >> v1:172.21.15.107:6789/0 conn(0x7f03bc0b64b0 legacy=0x7f03bc162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:02.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.043+0000 7f03baffd640 1 -- 172.21.15.42:0/554267898 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc06dfb0 con 0x7f03bc161c80 2024-09-16T01:56:02.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.043+0000 7f03baffd640 1 --2- 172.21.15.42:0/554267898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc161c80 0x7f03bc06e330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f03bc08e830 tx=0x7f03ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620d321f187806c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:02.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03b9ffb640 1 -- 172.21.15.42:0/554267898 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac037070 con 0x7f03bc161c80 2024-09-16T01:56:02.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03b9ffb640 1 -- 172.21.15.42:0/554267898 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ac032440 con 0x7f03bc161c80 2024-09-16T01:56:02.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03b9ffb640 1 -- 172.21.15.42:0/554267898 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac032810 con 0x7f03bc161c80 2024-09-16T01:56:02.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03c12af640 1 -- 172.21.15.42:0/554267898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc161c80 msgr2=0x7f03bc06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:02.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03c12af640 1 --2- 172.21.15.42:0/554267898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc161c80 0x7f03bc06e330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f03bc08e830 tx=0x7f03ac02a270 comp rx=0 tx=0).stop 2024-09-16T01:56:02.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03c12af640 1 -- 172.21.15.42:0/554267898 shutdown_connections 2024-09-16T01:56:02.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03c12af640 1 --2- 172.21.15.42:0/554267898 >> v2:172.21.15.107:3300/0 conn(0x7f03bc162060 0x7f03bc0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:02.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03c12af640 1 --2- 172.21.15.42:0/554267898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc161c80 0x7f03bc06e330 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:02.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03c12af640 1 -- 172.21.15.42:0/554267898 >> 172.21.15.42:0/554267898 conn(0x7f03bc0d44f0 msgr2=0x7f03bc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:02.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03c12af640 1 -- 172.21.15.42:0/554267898 shutdown_connections 2024-09-16T01:56:02.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.044+0000 7f03c12af640 1 -- 172.21.15.42:0/554267898 wait complete. 2024-09-16T01:56:02.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.046+0000 7f03c12af640 1 Processor -- start 2024-09-16T01:56:02.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.046+0000 7f03c12af640 1 -- start start 2024-09-16T01:56:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.046+0000 7f03c12af640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03bc0b64b0 0x7f03bc159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.046+0000 7f03c12af640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03bc161c80 0x7f03bc1f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.046+0000 7f03c12af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc162060 0x7f03bc15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.046+0000 7f03c12af640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc0d2a10 con 0x7f03bc162060 2024-09-16T01:56:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.046+0000 7f03c12af640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc0d2890 con 0x7f03bc0b64b0 2024-09-16T01:56:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.046+0000 7f03c12af640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f03bc0b6960 con 0x7f03bc161c80 2024-09-16T01:56:02.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.046+0000 7f03bb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc162060 0x7f03bc15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03bb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc162060 0x7f03bc15ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49246/0 (socket says 172.21.15.42:49246) 2024-09-16T01:56:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03bb7fe640 1 -- 172.21.15.42:0/3169766665 learned_addr learned my addr 172.21.15.42:0/3169766665 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03baffd640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03bc0b64b0 0x7f03bc159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03ba7fc640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03bc161c80 0x7f03bc1f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03bb7fe640 1 -- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03bc161c80 msgr2=0x7f03bc1f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03bb7fe640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03bc161c80 0x7f03bc1f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03bb7fe640 1 -- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03bc0b64b0 msgr2=0x7f03bc159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:02.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03bb7fe640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03bc0b64b0 0x7f03bc159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:02.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03bb7fe640 1 -- 172.21.15.42:0/3169766665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc1f7b30 con 0x7f03bc162060 2024-09-16T01:56:02.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03bb7fe640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc162060 0x7f03bc15ea80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f03b400c7d0 tx=0x7f03b400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:02.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03a37fe640 1 -- 172.21.15.42:0/3169766665 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b4003b70 con 0x7f03bc162060 2024-09-16T01:56:02.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03a37fe640 1 -- 172.21.15.42:0/3169766665 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b4003d30 con 0x7f03bc162060 2024-09-16T01:56:02.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03c12af640 1 -- 172.21.15.42:0/3169766665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03bc1f49a0 con 0x7f03bc162060 2024-09-16T01:56:02.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03a37fe640 1 -- 172.21.15.42:0/3169766665 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b400aa90 con 0x7f03bc162060 2024-09-16T01:56:02.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.047+0000 7f03c12af640 1 -- 172.21.15.42:0/3169766665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03bc1f4f60 con 0x7f03bc162060 2024-09-16T01:56:02.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.048+0000 7f03c12af640 1 -- 172.21.15.42:0/3169766665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03bc0ba470 con 0x7f03bc162060 2024-09-16T01:56:02.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.049+0000 7f03a37fe640 1 -- 172.21.15.42:0/3169766665 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f03b400ac30 con 0x7f03bc162060 2024-09-16T01:56:02.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.049+0000 7f03a37fe640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f03a806c2b0 0x7f03a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:02.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.049+0000 7f03a37fe640 1 -- 172.21.15.42:0/3169766665 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f03b408b3b0 con 0x7f03bc162060 2024-09-16T01:56:02.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.049+0000 7f03baffd640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f03a806c2b0 0x7f03a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:02.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.050+0000 7f03baffd640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f03a806c2b0 0x7f03a806e770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f03ac034000 tx=0x7f03ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:02.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.053+0000 7f03a37fe640 1 -- 172.21.15.42:0/3169766665 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03bc06e870 con 0x7f03bc162060 2024-09-16T01:56:02.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.224+0000 7f03c12af640 1 -- 172.21.15.42:0/3169766665 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03bc0b3070 con 0x7f03a806c2b0 2024-09-16T01:56:02.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.230+0000 7f03a37fe640 1 -- 172.21.15.42:0/3169766665 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239731 (secure 0 0 0) 0x7f03bc0b3070 con 0x7f03a806c2b0 2024-09-16T01:56:02.234 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:56:02.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 -- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f03a806c2b0 msgr2=0x7f03a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f03a806c2b0 0x7f03a806e770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f03ac034000 tx=0x7f03ac02e000 comp rx=0 tx=0).stop 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 -- 172.21.15.42:0/3169766665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc162060 msgr2=0x7f03bc15ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc162060 0x7f03bc15ea80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f03b400c7d0 tx=0x7f03b400cc90 comp rx=0 tx=0).stop 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 -- 172.21.15.42:0/3169766665 shutdown_connections 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f03a806c2b0 0x7f03a806e770 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03bc162060 0x7f03bc15ea80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f03bc161c80 0x7f03bc1f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 --2- 172.21.15.42:0/3169766665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03bc0b64b0 0x7f03bc159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 -- 172.21.15.42:0/3169766665 >> 172.21.15.42:0/3169766665 conn(0x7f03bc0d44f0 msgr2=0x7f03bc0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 -- 172.21.15.42:0/3169766665 shutdown_connections 2024-09-16T01:56:02.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:02.233+0000 7f03c12af640 1 -- 172.21.15.42:0/3169766665 wait complete. 2024-09-16T01:56:02.245 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-16T01:56:00.273210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":238280,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736440,"statfs":{"total":773094113280,"available":772850114560,"internally_reserved":0,"allocated":5529600,"data_stored":3060760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.621602"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687263+0000","last_change":"2024-09-16T01:55:57.685621+0000","last_active":"2024-09-16T01:55:57.687263+0000","last_peered":"2024-09-16T01:55:57.687263+0000","last_clean":"2024-09-16T01:55:57.687263+0000","last_became_active":"2024-09-16T01:55:57.685327+0000","last_became_peered":"2024-09-16T01:55:57.685327+0000","last_unstale":"2024-09-16T01:55:57.687263+0000","last_undegraded":"2024-09-16T01:55:57.687263+0000","last_fullsized":"2024-09-16T01:55:57.687263+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:05.569965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.691289+0000","last_change":"2024-09-16T01:55:57.690864+0000","last_active":"2024-09-16T01:55:57.691289+0000","last_peered":"2024-09-16T01:55:57.691289+0000","last_clean":"2024-09-16T01:55:57.691289+0000","last_became_active":"2024-09-16T01:55:57.690592+0000","last_became_peered":"2024-09-16T01:55:57.690592+0000","last_unstale":"2024-09-16T01:55:57.691289+0000","last_undegraded":"2024-09-16T01:55:57.691289+0000","last_fullsized":"2024-09-16T01:55:57.691289+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:07.055332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-16T01:55:56.661097+0000","last_change":"2024-09-16T01:55:56.661097+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.661097+0000","last_undegraded":"2024-09-16T01:55:56.661097+0000","last_fullsized":"2024-09-16T01:55:56.661097+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.686829+0000","last_change":"2024-09-16T01:55:57.682642+0000","last_active":"2024-09-16T01:55:57.686829+0000","last_peered":"2024-09-16T01:55:57.686829+0000","last_clean":"2024-09-16T01:55:57.686829+0000","last_became_active":"2024-09-16T01:55:57.682366+0000","last_became_peered":"2024-09-16T01:55:57.682366+0000","last_unstale":"2024-09-16T01:55:57.686829+0000","last_undegraded":"2024-09-16T01:55:57.686829+0000","last_fullsized":"2024-09-16T01:55:57.686829+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:31.190709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687283+0000","last_change":"2024-09-16T01:55:57.685916+0000","last_active":"2024-09-16T01:55:57.687283+0000","last_peered":"2024-09-16T01:55:57.687283+0000","last_clean":"2024-09-16T01:55:57.687283+0000","last_became_active":"2024-09-16T01:55:57.685633+0000","last_became_peered":"2024-09-16T01:55:57.685633+0000","last_unstale":"2024-09-16T01:55:57.687283+0000","last_undegraded":"2024-09-16T01:55:57.687283+0000","last_fullsized":"2024-09-16T01:55:57.687283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:17.321579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-16T01:55:56.661482+0000","last_change":"2024-09-16T01:55:56.661482+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.661482+0000","last_undegraded":"2024-09-16T01:55:56.661482+0000","last_fullsized":"2024-09-16T01:55:56.661482+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687174+0000","last_change":"2024-09-16T01:55:57.685078+0000","last_active":"2024-09-16T01:55:57.687174+0000","last_peered":"2024-09-16T01:55:57.687174+0000","last_clean":"2024-09-16T01:55:57.687174+0000","last_became_active":"2024-09-16T01:55:57.684620+0000","last_became_peered":"2024-09-16T01:55:57.684620+0000","last_unstale":"2024-09-16T01:55:57.687174+0000","last_undegraded":"2024-09-16T01:55:57.687174+0000","last_fullsized":"2024-09-16T01:55:57.687174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:32.690387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.687222+0000","last_change":"2024-09-16T01:55:57.685696+0000","last_active":"2024-09-16T01:55:57.687222+0000","last_peered":"2024-09-16T01:55:57.687222+0000","last_clean":"2024-09-16T01:55:57.687222+0000","last_became_active":"2024-09-16T01:55:57.685420+0000","last_became_peered":"2024-09-16T01:55:57.685420+0000","last_unstale":"2024-09-16T01:55:57.687222+0000","last_undegraded":"2024-09-16T01:55:57.687222+0000","last_fullsized":"2024-09-16T01:55:57.687222+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:00.492003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.689141+0000","last_change":"2024-09-16T01:55:57.687961+0000","last_active":"2024-09-16T01:55:57.689141+0000","last_peered":"2024-09-16T01:55:57.689141+0000","last_clean":"2024-09-16T01:55:57.689141+0000","last_became_active":"2024-09-16T01:55:57.687680+0000","last_became_peered":"2024-09-16T01:55:57.687680+0000","last_unstale":"2024-09-16T01:55:57.689141+0000","last_undegraded":"2024-09-16T01:55:57.689141+0000","last_fullsized":"2024-09-16T01:55:57.689141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:19.323091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.688781+0000","last_change":"2024-09-16T01:55:57.686963+0000","last_active":"2024-09-16T01:55:57.688781+0000","last_peered":"2024-09-16T01:55:57.688781+0000","last_clean":"2024-09-16T01:55:57.688781+0000","last_became_active":"2024-09-16T01:55:57.686686+0000","last_became_peered":"2024-09-16T01:55:57.686686+0000","last_unstale":"2024-09-16T01:55:57.688781+0000","last_undegraded":"2024-09-16T01:55:57.688781+0000","last_fullsized":"2024-09-16T01:55:57.688781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:18.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.676027+0000","last_change":"2024-09-16T01:55:56.674828+0000","last_active":"2024-09-16T01:55:57.676027+0000","last_peered":"2024-09-16T01:55:57.676027+0000","last_clean":"2024-09-16T01:55:57.676027+0000","last_became_active":"2024-09-16T01:55:56.674519+0000","last_became_peered":"2024-09-16T01:55:56.674519+0000","last_unstale":"2024-09-16T01:55:57.676027+0000","last_undegraded":"2024-09-16T01:55:57.676027+0000","last_fullsized":"2024-09-16T01:55:57.676027+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:34.317242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.686332+0000","last_change":"2024-09-16T01:55:56.678488+0000","last_active":"2024-09-16T01:55:57.686332+0000","last_peered":"2024-09-16T01:55:57.686332+0000","last_clean":"2024-09-16T01:55:57.686332+0000","last_became_active":"2024-09-16T01:55:56.678214+0000","last_became_peered":"2024-09-16T01:55:56.678214+0000","last_unstale":"2024-09-16T01:55:57.686332+0000","last_undegraded":"2024-09-16T01:55:57.686332+0000","last_fullsized":"2024-09-16T01:55:57.686332+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:10.936010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673991+0000","last_change":"2024-09-16T01:55:56.677509+0000","last_active":"2024-09-16T01:55:57.673991+0000","last_peered":"2024-09-16T01:55:57.673991+0000","last_clean":"2024-09-16T01:55:57.673991+0000","last_became_active":"2024-09-16T01:55:56.677242+0000","last_became_peered":"2024-09-16T01:55:56.677242+0000","last_unstale":"2024-09-16T01:55:57.673991+0000","last_undegraded":"2024-09-16T01:55:57.673991+0000","last_fullsized":"2024-09-16T01:55:57.673991+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:09.600659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-16T01:55:56.675261+0000","last_change":"2024-09-16T01:55:56.671401+0000","last_active":"2024-09-16T01:55:56.675261+0000","last_peered":"2024-09-16T01:55:56.675261+0000","last_clean":"2024-09-16T01:55:56.675261+0000","last_became_active":"2024-09-16T01:55:56.671110+0000","last_became_peered":"2024-09-16T01:55:56.671110+0000","last_unstale":"2024-09-16T01:55:56.675261+0000","last_undegraded":"2024-09-16T01:55:56.675261+0000","last_fullsized":"2024-09-16T01:55:56.675261+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:03.371540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-16T01:55:56.675221+0000","last_change":"2024-09-16T01:55:56.671230+0000","last_active":"2024-09-16T01:55:56.675221+0000","last_peered":"2024-09-16T01:55:56.675221+0000","last_clean":"2024-09-16T01:55:56.675221+0000","last_became_active":"2024-09-16T01:55:56.670928+0000","last_became_peered":"2024-09-16T01:55:56.670928+0000","last_unstale":"2024-09-16T01:55:56.675221+0000","last_undegraded":"2024-09-16T01:55:56.675221+0000","last_fullsized":"2024-09-16T01:55:56.675221+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:15.009579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673380+0000","last_change":"2024-09-16T01:55:56.675512+0000","last_active":"2024-09-16T01:55:57.673380+0000","last_peered":"2024-09-16T01:55:57.673380+0000","last_clean":"2024-09-16T01:55:57.673380+0000","last_became_active":"2024-09-16T01:55:56.675235+0000","last_became_peered":"2024-09-16T01:55:56.675235+0000","last_unstale":"2024-09-16T01:55:57.673380+0000","last_undegraded":"2024-09-16T01:55:57.673380+0000","last_fullsized":"2024-09-16T01:55:57.673380+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:44.890291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:56.650152+0000","last_change":"2024-09-16T01:55:56.650152+0000","last_active":"2024-09-16T01:55:56.650152+0000","last_peered":"2024-09-16T01:55:56.650152+0000","last_clean":"2024-09-16T01:55:56.650152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:56.650152+0000","last_undegraded":"2024-09-16T01:55:56.650152+0000","last_fullsized":"2024-09-16T01:55:56.650152+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:55:55.642749+0000","last_change":"2024-09-16T01:55:55.642749+0000","last_active":"2024-09-16T01:55:55.642749+0000","last_peered":"2024-09-16T01:55:55.642749+0000","last_clean":"2024-09-16T01:55:55.642749+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:55:55.642749+0000","last_undegraded":"2024-09-16T01:55:55.642749+0000","last_fullsized":"2024-09-16T01:55:55.642749+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":221,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T01:55:57.673695+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:55:57.673695+0000","last_peered":"2024-09-16T01:55:57.673695+0000","last_clean":"2024-09-16T01:55:57.673695+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:55:57.673695+0000","last_undegraded":"2024-09-16T01:55:57.673695+0000","last_fullsized":"2024-09-16T01:55:57.673695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":231784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1130496,"data_stored":822152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1155072,"data_stored":835028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":561152,"data_stored":244660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:56:02.622 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-09-16T01:56:02.621+0000 7f1192f5a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:56:05.250 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:56:05.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.364+0000 7f5c085b7640 1 Processor -- start 2024-09-16T01:56:05.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.364+0000 7f5c085b7640 1 -- start start 2024-09-16T01:56:05.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.365+0000 7f5c085b7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5c000d30f0 0x7f5c000b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.365+0000 7f5c085b7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000b64c0 0x7f5c0006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.365+0000 7f5c085b7640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c000d3690 con 0x7f5c0015e5f0 2024-09-16T01:56:05.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.365+0000 7f5c085b7640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f5c0006d530 con 0x7f5c000d30f0 2024-09-16T01:56:05.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.365+0000 7f5c085b7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5c000d3970 con 0x7f5c000b64c0 2024-09-16T01:56:05.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.365+0000 7f5c05b52640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5c000d30f0 0x7f5c000b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.365+0000 7f5c06353640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5c0015e5f0 0x7f5c000d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52786/0 (socket says 172.21.15.42:52786) 2024-09-16T01:56:05.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.365+0000 7f5c06353640 1 -- 172.21.15.42:0/2618826996 learned_addr learned my addr 172.21.15.42:0/2618826996 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:05.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.366+0000 7f5c06b54640 1 --2- 172.21.15.42:0/2618826996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000b64c0 0x7f5c0006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.366+0000 7f5c05b52640 1 -- 172.21.15.42:0/2618826996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000b64c0 msgr2=0x7f5c0006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:05.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.366+0000 7f5c05b52640 1 --2- 172.21.15.42:0/2618826996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000b64c0 0x7f5c0006d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.366+0000 7f5c05b52640 1 -- 172.21.15.42:0/2618826996 >> v1:172.21.15.42:6789/0 conn(0x7f5c0015e5f0 legacy=0x7f5c000d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.366+0000 7f5c05b52640 1 -- 172.21.15.42:0/2618826996 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0006cee0 con 0x7f5c000d30f0 2024-09-16T01:56:05.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.366+0000 7f5c06b54640 1 --2- 172.21.15.42:0/2618826996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000b64c0 0x7f5c0006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:56:05.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c05b52640 1 --2- 172.21.15.42:0/2618826996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c000d30f0 0x7f5c000b5f80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00097a0 tx=0x7f5bf002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9f4b94e7bbe9d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:05.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c05351640 1 -- 172.21.15.42:0/2618826996 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0037070 con 0x7f5c000d30f0 2024-09-16T01:56:05.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c05351640 1 -- 172.21.15.42:0/2618826996 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf0032440 con 0x7f5c000d30f0 2024-09-16T01:56:05.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c05351640 1 -- 172.21.15.42:0/2618826996 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0032810 con 0x7f5c000d30f0 2024-09-16T01:56:05.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c085b7640 1 -- 172.21.15.42:0/2618826996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c000d30f0 msgr2=0x7f5c000b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c085b7640 1 --2- 172.21.15.42:0/2618826996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c000d30f0 0x7f5c000b5f80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00097a0 tx=0x7f5bf002a180 comp rx=0 tx=0).stop 2024-09-16T01:56:05.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c085b7640 1 -- 172.21.15.42:0/2618826996 shutdown_connections 2024-09-16T01:56:05.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c085b7640 1 --2- 172.21.15.42:0/2618826996 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000b64c0 0x7f5c0006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c085b7640 1 --2- 172.21.15.42:0/2618826996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c000d30f0 0x7f5c000b5f80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c085b7640 1 -- 172.21.15.42:0/2618826996 >> 172.21.15.42:0/2618826996 conn(0x7f5c0008bfc0 msgr2=0x7f5c000d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:05.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c085b7640 1 -- 172.21.15.42:0/2618826996 shutdown_connections 2024-09-16T01:56:05.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.367+0000 7f5c085b7640 1 -- 172.21.15.42:0/2618826996 wait complete. 2024-09-16T01:56:05.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.369+0000 7f5c085b7640 1 Processor -- start 2024-09-16T01:56:05.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.369+0000 7f5c085b7640 1 -- start start 2024-09-16T01:56:05.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.369+0000 7f5c085b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c000b64c0 0x7f5c00161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.369+0000 7f5c085b7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000d30f0 0x7f5c00155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.369+0000 7f5c085b7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c0015e5f0 0x7f5c00155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.369+0000 7f5c085b7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0006df00 con 0x7f5c0015e5f0 2024-09-16T01:56:05.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.369+0000 7f5c085b7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0015e9d0 con 0x7f5c000b64c0 2024-09-16T01:56:05.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.369+0000 7f5c085b7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0006e080 con 0x7f5c000d30f0 2024-09-16T01:56:05.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06b54640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c0015e5f0 0x7f5c00155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06b54640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c0015e5f0 0x7f5c00155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49270/0 (socket says 172.21.15.42:49270) 2024-09-16T01:56:05.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06b54640 1 -- 172.21.15.42:0/3284743255 learned_addr learned my addr 172.21.15.42:0/3284743255 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:05.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c05b52640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000d30f0 0x7f5c00155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06353640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c000b64c0 0x7f5c00161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06b54640 1 -- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000d30f0 msgr2=0x7f5c00155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06b54640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000d30f0 0x7f5c00155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06b54640 1 -- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c000b64c0 msgr2=0x7f5c00161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06b54640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c000b64c0 0x7f5c00161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06b54640 1 -- 172.21.15.42:0/3284743255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c000b9720 con 0x7f5c0015e5f0 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06353640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c000b64c0 0x7f5c00161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c06b54640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c0015e5f0 0x7f5c00155c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800cef0 tx=0x7f5bf800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5bf6ffd640 1 -- 172.21.15.42:0/3284743255 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf801a070 con 0x7f5c0015e5f0 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5bf6ffd640 1 -- 172.21.15.42:0/3284743255 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf800d860 con 0x7f5c0015e5f0 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c085b7640 1 -- 172.21.15.42:0/3284743255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0015ec80 con 0x7f5c0015e5f0 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5bf6ffd640 1 -- 172.21.15.42:0/3284743255 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf800dc50 con 0x7f5c0015e5f0 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.370+0000 7f5c085b7640 1 -- 172.21.15.42:0/3284743255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c000b9a00 con 0x7f5c0015e5f0 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.371+0000 7f5c085b7640 1 -- 172.21.15.42:0/3284743255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0006d9c0 con 0x7f5c0015e5f0 2024-09-16T01:56:05.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.372+0000 7f5bf6ffd640 1 -- 172.21.15.42:0/3284743255 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5bf801d070 con 0x7f5c0015e5f0 2024-09-16T01:56:05.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.372+0000 7f5bf6ffd640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5be406c2b0 0x7f5be406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.372+0000 7f5bf6ffd640 1 -- 172.21.15.42:0/3284743255 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f5bf808bd60 con 0x7f5c0015e5f0 2024-09-16T01:56:05.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.373+0000 7f5c06353640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5be406c2b0 0x7f5be406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.373+0000 7f5c06353640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5be406c2b0 0x7f5be406e770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc000f60 tx=0x7f5bfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:05.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.377+0000 7f5bf6ffd640 1 -- 172.21.15.42:0/3284743255 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5bf8059e40 con 0x7f5c0015e5f0 2024-09-16T01:56:05.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.550+0000 7f5c085b7640 1 -- 172.21.15.42:0/3284743255 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c000b1c10 con 0x7f5be406c2b0 2024-09-16T01:56:05.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.557+0000 7f5bf6ffd640 1 -- 172.21.15.42:0/3284743255 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7f5c000b1c10 con 0x7f5be406c2b0 2024-09-16T01:56:05.561 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:56:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 -- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5be406c2b0 msgr2=0x7f5be406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5be406c2b0 0x7f5be406e770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc000f60 tx=0x7f5bfc009040 comp rx=0 tx=0).stop 2024-09-16T01:56:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 -- 172.21.15.42:0/3284743255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c0015e5f0 msgr2=0x7f5c00155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c0015e5f0 0x7f5c00155c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800cef0 tx=0x7f5bf800a710 comp rx=0 tx=0).stop 2024-09-16T01:56:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 -- 172.21.15.42:0/3284743255 shutdown_connections 2024-09-16T01:56:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5be406c2b0 0x7f5be406e770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c0015e5f0 0x7f5c00155c40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5c000d30f0 0x7f5c00155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 --2- 172.21.15.42:0/3284743255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c000b64c0 0x7f5c00161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 -- 172.21.15.42:0/3284743255 >> 172.21.15.42:0/3284743255 conn(0x7f5c0008bfc0 msgr2=0x7f5c000b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 -- 172.21.15.42:0/3284743255 shutdown_connections 2024-09-16T01:56:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.560+0000 7f5c085b7640 1 -- 172.21.15.42:0/3284743255 wait complete. 2024-09-16T01:56:05.572 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-16T01:56:04.274084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238680,"kb_used_data":5788,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736040,"statfs":{"total":773094113280,"available":772849704960,"internally_reserved":0,"allocated":5926912,"data_stored":3247016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.615266"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555506+0000","last_change":"2024-09-16T01:55:57.681265+0000","last_active":"2024-09-16T01:55:59.555506+0000","last_peered":"2024-09-16T01:55:59.555506+0000","last_clean":"2024-09-16T01:55:59.555506+0000","last_became_active":"2024-09-16T01:55:57.680938+0000","last_became_peered":"2024-09-16T01:55:57.680938+0000","last_unstale":"2024-09-16T01:55:59.555506+0000","last_undegraded":"2024-09-16T01:55:59.555506+0000","last_fullsized":"2024-09-16T01:55:59.555506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:23.438332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.790256+0000","last_change":"2024-09-16T01:55:57.685621+0000","last_active":"2024-09-16T01:55:59.790256+0000","last_peered":"2024-09-16T01:55:59.790256+0000","last_clean":"2024-09-16T01:55:59.790256+0000","last_became_active":"2024-09-16T01:55:57.685327+0000","last_became_peered":"2024-09-16T01:55:57.685327+0000","last_unstale":"2024-09-16T01:55:59.790256+0000","last_undegraded":"2024-09-16T01:55:59.790256+0000","last_fullsized":"2024-09-16T01:55:59.790256+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:55.859490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789436+0000","last_change":"2024-09-16T01:55:57.680248+0000","last_active":"2024-09-16T01:55:59.789436+0000","last_peered":"2024-09-16T01:55:59.789436+0000","last_clean":"2024-09-16T01:55:59.789436+0000","last_became_active":"2024-09-16T01:55:57.679946+0000","last_became_peered":"2024-09-16T01:55:57.679946+0000","last_unstale":"2024-09-16T01:55:59.789436+0000","last_undegraded":"2024-09-16T01:55:59.789436+0000","last_fullsized":"2024-09-16T01:55:59.789436+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:42.660593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789018+0000","last_change":"2024-09-16T01:55:57.690864+0000","last_active":"2024-09-16T01:55:59.789018+0000","last_peered":"2024-09-16T01:55:59.789018+0000","last_clean":"2024-09-16T01:55:59.789018+0000","last_became_active":"2024-09-16T01:55:57.690592+0000","last_became_peered":"2024-09-16T01:55:57.690592+0000","last_unstale":"2024-09-16T01:55:59.789018+0000","last_undegraded":"2024-09-16T01:55:59.789018+0000","last_fullsized":"2024-09-16T01:55:59.789018+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:14.784103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.682903+0000","last_change":"2024-09-16T01:55:57.681974+0000","last_active":"2024-09-16T01:55:58.682903+0000","last_peered":"2024-09-16T01:55:58.682903+0000","last_clean":"2024-09-16T01:55:58.682903+0000","last_became_active":"2024-09-16T01:55:57.681693+0000","last_became_peered":"2024-09-16T01:55:57.681693+0000","last_unstale":"2024-09-16T01:55:58.682903+0000","last_undegraded":"2024-09-16T01:55:58.682903+0000","last_fullsized":"2024-09-16T01:55:58.682903+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:39.430114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555357+0000","last_change":"2024-09-16T01:55:57.682136+0000","last_active":"2024-09-16T01:55:59.555357+0000","last_peered":"2024-09-16T01:55:59.555357+0000","last_clean":"2024-09-16T01:55:59.555357+0000","last_became_active":"2024-09-16T01:55:57.680846+0000","last_became_peered":"2024-09-16T01:55:57.680846+0000","last_unstale":"2024-09-16T01:55:59.555357+0000","last_undegraded":"2024-09-16T01:55:59.555357+0000","last_fullsized":"2024-09-16T01:55:59.555357+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:44.757223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.788845+0000","last_change":"2024-09-16T01:55:57.679387+0000","last_active":"2024-09-16T01:55:59.788845+0000","last_peered":"2024-09-16T01:55:59.788845+0000","last_clean":"2024-09-16T01:55:59.788845+0000","last_became_active":"2024-09-16T01:55:57.678977+0000","last_became_peered":"2024-09-16T01:55:57.678977+0000","last_unstale":"2024-09-16T01:55:59.788845+0000","last_undegraded":"2024-09-16T01:55:59.788845+0000","last_fullsized":"2024-09-16T01:55:59.788845+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:12.663082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676468+0000","last_change":"2024-09-16T01:55:57.688975+0000","last_active":"2024-09-16T01:55:58.676468+0000","last_peered":"2024-09-16T01:55:58.676468+0000","last_clean":"2024-09-16T01:55:58.676468+0000","last_became_active":"2024-09-16T01:55:57.688337+0000","last_became_peered":"2024-09-16T01:55:57.688337+0000","last_unstale":"2024-09-16T01:55:58.676468+0000","last_undegraded":"2024-09-16T01:55:58.676468+0000","last_fullsized":"2024-09-16T01:55:58.676468+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:32.194897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676314+0000","last_change":"2024-09-16T01:55:57.687838+0000","last_active":"2024-09-16T01:55:58.676314+0000","last_peered":"2024-09-16T01:55:58.676314+0000","last_clean":"2024-09-16T01:55:58.676314+0000","last_became_active":"2024-09-16T01:55:57.687579+0000","last_became_peered":"2024-09-16T01:55:57.687579+0000","last_unstale":"2024-09-16T01:55:58.676314+0000","last_undegraded":"2024-09-16T01:55:58.676314+0000","last_fullsized":"2024-09-16T01:55:58.676314+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:49.414955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555509+0000","last_change":"2024-09-16T01:55:57.669739+0000","last_active":"2024-09-16T01:55:59.555509+0000","last_peered":"2024-09-16T01:55:59.555509+0000","last_clean":"2024-09-16T01:55:59.555509+0000","last_became_active":"2024-09-16T01:55:57.669460+0000","last_became_peered":"2024-09-16T01:55:57.669460+0000","last_unstale":"2024-09-16T01:55:59.555509+0000","last_undegraded":"2024-09-16T01:55:59.555509+0000","last_fullsized":"2024-09-16T01:55:59.555509+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:35:58.733753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.815531+0000","last_change":"2024-09-16T01:55:57.686712+0000","last_active":"2024-09-16T01:55:58.815531+0000","last_peered":"2024-09-16T01:55:58.815531+0000","last_clean":"2024-09-16T01:55:58.815531+0000","last_became_active":"2024-09-16T01:55:57.685048+0000","last_became_peered":"2024-09-16T01:55:57.685048+0000","last_unstale":"2024-09-16T01:55:58.815531+0000","last_undegraded":"2024-09-16T01:55:58.815531+0000","last_fullsized":"2024-09-16T01:55:58.815531+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:27.197821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676238+0000","last_change":"2024-09-16T01:55:57.689382+0000","last_active":"2024-09-16T01:55:58.676238+0000","last_peered":"2024-09-16T01:55:58.676238+0000","last_clean":"2024-09-16T01:55:58.676238+0000","last_became_active":"2024-09-16T01:55:57.689012+0000","last_became_peered":"2024-09-16T01:55:57.689012+0000","last_unstale":"2024-09-16T01:55:58.676238+0000","last_undegraded":"2024-09-16T01:55:58.676238+0000","last_fullsized":"2024-09-16T01:55:58.676238+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:23.686777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555299+0000","last_change":"2024-09-16T01:55:57.671370+0000","last_active":"2024-09-16T01:55:59.555299+0000","last_peered":"2024-09-16T01:55:59.555299+0000","last_clean":"2024-09-16T01:55:59.555299+0000","last_became_active":"2024-09-16T01:55:57.671103+0000","last_became_peered":"2024-09-16T01:55:57.671103+0000","last_unstale":"2024-09-16T01:55:59.555299+0000","last_undegraded":"2024-09-16T01:55:59.555299+0000","last_fullsized":"2024-09-16T01:55:59.555299+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:07.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.788977+0000","last_change":"2024-09-16T01:55:57.680128+0000","last_active":"2024-09-16T01:55:59.788977+0000","last_peered":"2024-09-16T01:55:59.788977+0000","last_clean":"2024-09-16T01:55:59.788977+0000","last_became_active":"2024-09-16T01:55:57.679879+0000","last_became_peered":"2024-09-16T01:55:57.679879+0000","last_unstale":"2024-09-16T01:55:59.788977+0000","last_undegraded":"2024-09-16T01:55:59.788977+0000","last_fullsized":"2024-09-16T01:55:59.788977+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:20.822892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789106+0000","last_change":"2024-09-16T01:55:57.682642+0000","last_active":"2024-09-16T01:55:59.789106+0000","last_peered":"2024-09-16T01:55:59.789106+0000","last_clean":"2024-09-16T01:55:59.789106+0000","last_became_active":"2024-09-16T01:55:57.682366+0000","last_became_peered":"2024-09-16T01:55:57.682366+0000","last_unstale":"2024-09-16T01:55:59.789106+0000","last_undegraded":"2024-09-16T01:55:59.789106+0000","last_fullsized":"2024-09-16T01:55:59.789106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:06.317787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555247+0000","last_change":"2024-09-16T01:55:57.668957+0000","last_active":"2024-09-16T01:55:59.555247+0000","last_peered":"2024-09-16T01:55:59.555247+0000","last_clean":"2024-09-16T01:55:59.555247+0000","last_became_active":"2024-09-16T01:55:57.668662+0000","last_became_peered":"2024-09-16T01:55:57.668662+0000","last_unstale":"2024-09-16T01:55:59.555247+0000","last_undegraded":"2024-09-16T01:55:59.555247+0000","last_fullsized":"2024-09-16T01:55:59.555247+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:40.268236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789697+0000","last_change":"2024-09-16T01:55:57.681106+0000","last_active":"2024-09-16T01:55:59.789697+0000","last_peered":"2024-09-16T01:55:59.789697+0000","last_clean":"2024-09-16T01:55:59.789697+0000","last_became_active":"2024-09-16T01:55:57.680647+0000","last_became_peered":"2024-09-16T01:55:57.680647+0000","last_unstale":"2024-09-16T01:55:59.789697+0000","last_undegraded":"2024-09-16T01:55:59.789697+0000","last_fullsized":"2024-09-16T01:55:59.789697+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:50.883878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.790411+0000","last_change":"2024-09-16T01:55:57.685916+0000","last_active":"2024-09-16T01:55:59.790411+0000","last_peered":"2024-09-16T01:55:59.790411+0000","last_clean":"2024-09-16T01:55:59.790411+0000","last_became_active":"2024-09-16T01:55:57.685633+0000","last_became_peered":"2024-09-16T01:55:57.685633+0000","last_unstale":"2024-09-16T01:55:59.790411+0000","last_undegraded":"2024-09-16T01:55:59.790411+0000","last_fullsized":"2024-09-16T01:55:59.790411+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:33.447135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789507+0000","last_change":"2024-09-16T01:55:57.670469+0000","last_active":"2024-09-16T01:55:59.789507+0000","last_peered":"2024-09-16T01:55:59.789507+0000","last_clean":"2024-09-16T01:55:59.789507+0000","last_became_active":"2024-09-16T01:55:57.670174+0000","last_became_peered":"2024-09-16T01:55:57.670174+0000","last_unstale":"2024-09-16T01:55:59.789507+0000","last_undegraded":"2024-09-16T01:55:59.789507+0000","last_fullsized":"2024-09-16T01:55:59.789507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:23.686777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789414+0000","last_change":"2024-09-16T01:55:57.676584+0000","last_active":"2024-09-16T01:55:59.789414+0000","last_peered":"2024-09-16T01:55:59.789414+0000","last_clean":"2024-09-16T01:55:59.789414+0000","last_became_active":"2024-09-16T01:55:57.676278+0000","last_became_peered":"2024-09-16T01:55:57.676278+0000","last_unstale":"2024-09-16T01:55:59.789414+0000","last_undegraded":"2024-09-16T01:55:59.789414+0000","last_fullsized":"2024-09-16T01:55:59.789414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:48.368163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789474+0000","last_change":"2024-09-16T01:55:57.681193+0000","last_active":"2024-09-16T01:55:59.789474+0000","last_peered":"2024-09-16T01:55:59.789474+0000","last_clean":"2024-09-16T01:55:59.789474+0000","last_became_active":"2024-09-16T01:55:57.680912+0000","last_became_peered":"2024-09-16T01:55:57.680912+0000","last_unstale":"2024-09-16T01:55:59.789474+0000","last_undegraded":"2024-09-16T01:55:59.789474+0000","last_fullsized":"2024-09-16T01:55:59.789474+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:05.061419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676083+0000","last_change":"2024-09-16T01:55:57.686632+0000","last_active":"2024-09-16T01:55:58.676083+0000","last_peered":"2024-09-16T01:55:58.676083+0000","last_clean":"2024-09-16T01:55:58.676083+0000","last_became_active":"2024-09-16T01:55:57.683010+0000","last_became_peered":"2024-09-16T01:55:57.683010+0000","last_unstale":"2024-09-16T01:55:58.676083+0000","last_undegraded":"2024-09-16T01:55:58.676083+0000","last_fullsized":"2024-09-16T01:55:58.676083+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:08.564330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.815333+0000","last_change":"2024-09-16T01:55:57.682112+0000","last_active":"2024-09-16T01:55:58.815333+0000","last_peered":"2024-09-16T01:55:58.815333+0000","last_clean":"2024-09-16T01:55:58.815333+0000","last_became_active":"2024-09-16T01:55:57.681803+0000","last_became_peered":"2024-09-16T01:55:57.681803+0000","last_unstale":"2024-09-16T01:55:58.815333+0000","last_undegraded":"2024-09-16T01:55:58.815333+0000","last_fullsized":"2024-09-16T01:55:58.815333+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:09.924504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.788859+0000","last_change":"2024-09-16T01:55:57.677753+0000","last_active":"2024-09-16T01:55:59.788859+0000","last_peered":"2024-09-16T01:55:59.788859+0000","last_clean":"2024-09-16T01:55:59.788859+0000","last_became_active":"2024-09-16T01:55:57.677467+0000","last_became_peered":"2024-09-16T01:55:57.677467+0000","last_unstale":"2024-09-16T01:55:59.788859+0000","last_undegraded":"2024-09-16T01:55:59.788859+0000","last_fullsized":"2024-09-16T01:55:59.788859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:31.165237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789809+0000","last_change":"2024-09-16T01:55:57.682887+0000","last_active":"2024-09-16T01:55:59.789809+0000","last_peered":"2024-09-16T01:55:59.789809+0000","last_clean":"2024-09-16T01:55:59.789809+0000","last_became_active":"2024-09-16T01:55:57.681101+0000","last_became_peered":"2024-09-16T01:55:57.681101+0000","last_unstale":"2024-09-16T01:55:59.789809+0000","last_undegraded":"2024-09-16T01:55:59.789809+0000","last_fullsized":"2024-09-16T01:55:59.789809+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:42.916123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676029+0000","last_change":"2024-09-16T01:55:57.685799+0000","last_active":"2024-09-16T01:55:58.676029+0000","last_peered":"2024-09-16T01:55:58.676029+0000","last_clean":"2024-09-16T01:55:58.676029+0000","last_became_active":"2024-09-16T01:55:57.683001+0000","last_became_peered":"2024-09-16T01:55:57.683001+0000","last_unstale":"2024-09-16T01:55:58.676029+0000","last_undegraded":"2024-09-16T01:55:58.676029+0000","last_fullsized":"2024-09-16T01:55:58.676029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:07.204047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555579+0000","last_change":"2024-09-16T01:55:57.670245+0000","last_active":"2024-09-16T01:55:59.555579+0000","last_peered":"2024-09-16T01:55:59.555579+0000","last_clean":"2024-09-16T01:55:59.555579+0000","last_became_active":"2024-09-16T01:55:57.669509+0000","last_became_peered":"2024-09-16T01:55:57.669509+0000","last_unstale":"2024-09-16T01:55:59.555579+0000","last_undegraded":"2024-09-16T01:55:59.555579+0000","last_fullsized":"2024-09-16T01:55:59.555579+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:18.940780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789569+0000","last_change":"2024-09-16T01:55:57.680151+0000","last_active":"2024-09-16T01:55:59.789569+0000","last_peered":"2024-09-16T01:55:59.789569+0000","last_clean":"2024-09-16T01:55:59.789569+0000","last_became_active":"2024-09-16T01:55:57.679841+0000","last_became_peered":"2024-09-16T01:55:57.679841+0000","last_unstale":"2024-09-16T01:55:59.789569+0000","last_undegraded":"2024-09-16T01:55:59.789569+0000","last_fullsized":"2024-09-16T01:55:59.789569+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:40.268236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789033+0000","last_change":"2024-09-16T01:55:57.674131+0000","last_active":"2024-09-16T01:55:59.789033+0000","last_peered":"2024-09-16T01:55:59.789033+0000","last_clean":"2024-09-16T01:55:59.789033+0000","last_became_active":"2024-09-16T01:55:57.673235+0000","last_became_peered":"2024-09-16T01:55:57.673235+0000","last_unstale":"2024-09-16T01:55:59.789033+0000","last_undegraded":"2024-09-16T01:55:59.789033+0000","last_fullsized":"2024-09-16T01:55:59.789033+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:08:07.204047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789608+0000","last_change":"2024-09-16T01:55:57.685078+0000","last_active":"2024-09-16T01:55:59.789608+0000","last_peered":"2024-09-16T01:55:59.789608+0000","last_clean":"2024-09-16T01:55:59.789608+0000","last_became_active":"2024-09-16T01:55:57.684620+0000","last_became_peered":"2024-09-16T01:55:57.684620+0000","last_unstale":"2024-09-16T01:55:59.789608+0000","last_undegraded":"2024-09-16T01:55:59.789608+0000","last_fullsized":"2024-09-16T01:55:59.789608+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:20.172783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.788962+0000","last_change":"2024-09-16T01:55:57.678414+0000","last_active":"2024-09-16T01:55:59.788962+0000","last_peered":"2024-09-16T01:55:59.788962+0000","last_clean":"2024-09-16T01:55:59.788962+0000","last_became_active":"2024-09-16T01:55:57.678150+0000","last_became_peered":"2024-09-16T01:55:57.678150+0000","last_unstale":"2024-09-16T01:55:59.788962+0000","last_undegraded":"2024-09-16T01:55:59.788962+0000","last_fullsized":"2024-09-16T01:55:59.788962+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:03.204535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789812+0000","last_change":"2024-09-16T01:55:57.684321+0000","last_active":"2024-09-16T01:55:59.789812+0000","last_peered":"2024-09-16T01:55:59.789812+0000","last_clean":"2024-09-16T01:55:59.789812+0000","last_became_active":"2024-09-16T01:55:57.684036+0000","last_became_peered":"2024-09-16T01:55:57.684036+0000","last_unstale":"2024-09-16T01:55:59.789812+0000","last_undegraded":"2024-09-16T01:55:59.789812+0000","last_fullsized":"2024-09-16T01:55:59.789812+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:23.438332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.788891+0000","last_change":"2024-09-16T01:55:57.685696+0000","last_active":"2024-09-16T01:55:59.788891+0000","last_peered":"2024-09-16T01:55:59.788891+0000","last_clean":"2024-09-16T01:55:59.788891+0000","last_became_active":"2024-09-16T01:55:57.685420+0000","last_became_peered":"2024-09-16T01:55:57.685420+0000","last_unstale":"2024-09-16T01:55:59.788891+0000","last_undegraded":"2024-09-16T01:55:59.788891+0000","last_fullsized":"2024-09-16T01:55:59.788891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:38.689942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"49'4","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789361+0000","last_change":"2024-09-16T01:55:56.678283+0000","last_active":"2024-09-16T01:55:59.789361+0000","last_peered":"2024-09-16T01:55:59.789361+0000","last_clean":"2024-09-16T01:55:59.789361+0000","last_became_active":"2024-09-16T01:55:56.676972+0000","last_became_peered":"2024-09-16T01:55:56.676972+0000","last_unstale":"2024-09-16T01:55:59.789361+0000","last_undegraded":"2024-09-16T01:55:59.789361+0000","last_fullsized":"2024-09-16T01:55:59.789361+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:43.384207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.790282+0000","last_change":"2024-09-16T01:55:57.680321+0000","last_active":"2024-09-16T01:55:59.790282+0000","last_peered":"2024-09-16T01:55:59.790282+0000","last_clean":"2024-09-16T01:55:59.790282+0000","last_became_active":"2024-09-16T01:55:57.680024+0000","last_became_peered":"2024-09-16T01:55:57.680024+0000","last_unstale":"2024-09-16T01:55:59.790282+0000","last_undegraded":"2024-09-16T01:55:59.790282+0000","last_fullsized":"2024-09-16T01:55:59.790282+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:52.221959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555445+0000","last_change":"2024-09-16T01:55:56.667927+0000","last_active":"2024-09-16T01:55:59.555445+0000","last_peered":"2024-09-16T01:55:59.555445+0000","last_clean":"2024-09-16T01:55:59.555445+0000","last_became_active":"2024-09-16T01:55:56.667639+0000","last_became_peered":"2024-09-16T01:55:56.667639+0000","last_unstale":"2024-09-16T01:55:59.555445+0000","last_undegraded":"2024-09-16T01:55:59.555445+0000","last_fullsized":"2024-09-16T01:55:59.555445+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:04.062859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789756+0000","last_change":"2024-09-16T01:55:57.680323+0000","last_active":"2024-09-16T01:55:59.789756+0000","last_peered":"2024-09-16T01:55:59.789756+0000","last_clean":"2024-09-16T01:55:59.789756+0000","last_became_active":"2024-09-16T01:55:57.679835+0000","last_became_peered":"2024-09-16T01:55:57.679835+0000","last_unstale":"2024-09-16T01:55:59.789756+0000","last_undegraded":"2024-09-16T01:55:59.789756+0000","last_fullsized":"2024-09-16T01:55:59.789756+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:33.641641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555535+0000","last_change":"2024-09-16T01:55:56.678527+0000","last_active":"2024-09-16T01:55:59.555535+0000","last_peered":"2024-09-16T01:55:59.555535+0000","last_clean":"2024-09-16T01:55:59.555535+0000","last_became_active":"2024-09-16T01:55:56.678231+0000","last_became_peered":"2024-09-16T01:55:56.678231+0000","last_unstale":"2024-09-16T01:55:59.555535+0000","last_undegraded":"2024-09-16T01:55:59.555535+0000","last_fullsized":"2024-09-16T01:55:59.555535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:59.642281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.675929+0000","last_change":"2024-09-16T01:55:57.681631+0000","last_active":"2024-09-16T01:55:58.675929+0000","last_peered":"2024-09-16T01:55:58.675929+0000","last_clean":"2024-09-16T01:55:58.675929+0000","last_became_active":"2024-09-16T01:55:57.681348+0000","last_became_peered":"2024-09-16T01:55:57.681348+0000","last_unstale":"2024-09-16T01:55:58.675929+0000","last_undegraded":"2024-09-16T01:55:58.675929+0000","last_fullsized":"2024-09-16T01:55:58.675929+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:20.822892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789287+0000","last_change":"2024-09-16T01:55:56.678496+0000","last_active":"2024-09-16T01:55:59.789287+0000","last_peered":"2024-09-16T01:55:59.789287+0000","last_clean":"2024-09-16T01:55:59.789287+0000","last_became_active":"2024-09-16T01:55:56.678239+0000","last_became_peered":"2024-09-16T01:55:56.678239+0000","last_unstale":"2024-09-16T01:55:59.789287+0000","last_undegraded":"2024-09-16T01:55:59.789287+0000","last_fullsized":"2024-09-16T01:55:59.789287+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:34:53.787303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.682865+0000","last_change":"2024-09-16T01:55:57.679271+0000","last_active":"2024-09-16T01:55:58.682865+0000","last_peered":"2024-09-16T01:55:58.682865+0000","last_clean":"2024-09-16T01:55:58.682865+0000","last_became_active":"2024-09-16T01:55:57.679014+0000","last_became_peered":"2024-09-16T01:55:57.679014+0000","last_unstale":"2024-09-16T01:55:58.682865+0000","last_undegraded":"2024-09-16T01:55:58.682865+0000","last_fullsized":"2024-09-16T01:55:58.682865+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:23.847253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789200+0000","last_change":"2024-09-16T01:55:56.683075+0000","last_active":"2024-09-16T01:55:59.789200+0000","last_peered":"2024-09-16T01:55:59.789200+0000","last_clean":"2024-09-16T01:55:59.789200+0000","last_became_active":"2024-09-16T01:55:56.682754+0000","last_became_peered":"2024-09-16T01:55:56.682754+0000","last_unstale":"2024-09-16T01:55:59.789200+0000","last_undegraded":"2024-09-16T01:55:59.789200+0000","last_fullsized":"2024-09-16T01:55:59.789200+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:02.397131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789426+0000","last_change":"2024-09-16T01:55:57.687961+0000","last_active":"2024-09-16T01:55:59.789426+0000","last_peered":"2024-09-16T01:55:59.789426+0000","last_clean":"2024-09-16T01:55:59.789426+0000","last_became_active":"2024-09-16T01:55:57.687680+0000","last_became_peered":"2024-09-16T01:55:57.687680+0000","last_unstale":"2024-09-16T01:55:59.789426+0000","last_undegraded":"2024-09-16T01:55:59.789426+0000","last_fullsized":"2024-09-16T01:55:59.789426+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:59.078531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.682529+0000","last_change":"2024-09-16T01:55:56.677546+0000","last_active":"2024-09-16T01:55:58.682529+0000","last_peered":"2024-09-16T01:55:58.682529+0000","last_clean":"2024-09-16T01:55:58.682529+0000","last_became_active":"2024-09-16T01:55:56.677258+0000","last_became_peered":"2024-09-16T01:55:56.677258+0000","last_unstale":"2024-09-16T01:55:58.682529+0000","last_undegraded":"2024-09-16T01:55:58.682529+0000","last_fullsized":"2024-09-16T01:55:58.682529+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:03.802559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676341+0000","last_change":"2024-09-16T01:55:57.685563+0000","last_active":"2024-09-16T01:55:58.676341+0000","last_peered":"2024-09-16T01:55:58.676341+0000","last_clean":"2024-09-16T01:55:58.676341+0000","last_became_active":"2024-09-16T01:55:57.682612+0000","last_became_peered":"2024-09-16T01:55:57.682612+0000","last_unstale":"2024-09-16T01:55:58.676341+0000","last_undegraded":"2024-09-16T01:55:58.676341+0000","last_fullsized":"2024-09-16T01:55:58.676341+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:49.778554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789082+0000","last_change":"2024-09-16T01:55:56.675588+0000","last_active":"2024-09-16T01:55:59.789082+0000","last_peered":"2024-09-16T01:55:59.789082+0000","last_clean":"2024-09-16T01:55:59.789082+0000","last_became_active":"2024-09-16T01:55:56.675289+0000","last_became_peered":"2024-09-16T01:55:56.675289+0000","last_unstale":"2024-09-16T01:55:59.789082+0000","last_undegraded":"2024-09-16T01:55:59.789082+0000","last_fullsized":"2024-09-16T01:55:59.789082+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:03.802559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789684+0000","last_change":"2024-09-16T01:55:57.686963+0000","last_active":"2024-09-16T01:55:59.789684+0000","last_peered":"2024-09-16T01:55:59.789684+0000","last_clean":"2024-09-16T01:55:59.789684+0000","last_became_active":"2024-09-16T01:55:57.686686+0000","last_became_peered":"2024-09-16T01:55:57.686686+0000","last_unstale":"2024-09-16T01:55:59.789684+0000","last_undegraded":"2024-09-16T01:55:59.789684+0000","last_fullsized":"2024-09-16T01:55:59.789684+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:07.059511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789049+0000","last_change":"2024-09-16T01:55:56.681693+0000","last_active":"2024-09-16T01:55:59.789049+0000","last_peered":"2024-09-16T01:55:59.789049+0000","last_clean":"2024-09-16T01:55:59.789049+0000","last_became_active":"2024-09-16T01:55:56.681451+0000","last_became_peered":"2024-09-16T01:55:56.681451+0000","last_unstale":"2024-09-16T01:55:59.789049+0000","last_undegraded":"2024-09-16T01:55:59.789049+0000","last_fullsized":"2024-09-16T01:55:59.789049+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:40.072701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.682632+0000","last_change":"2024-09-16T01:55:57.678275+0000","last_active":"2024-09-16T01:55:58.682632+0000","last_peered":"2024-09-16T01:55:58.682632+0000","last_clean":"2024-09-16T01:55:58.682632+0000","last_became_active":"2024-09-16T01:55:57.677970+0000","last_became_peered":"2024-09-16T01:55:57.677970+0000","last_unstale":"2024-09-16T01:55:58.682632+0000","last_undegraded":"2024-09-16T01:55:58.682632+0000","last_fullsized":"2024-09-16T01:55:58.682632+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:11.772599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789814+0000","last_change":"2024-09-16T01:55:56.674828+0000","last_active":"2024-09-16T01:55:59.789814+0000","last_peered":"2024-09-16T01:55:59.789814+0000","last_clean":"2024-09-16T01:55:59.789814+0000","last_became_active":"2024-09-16T01:55:56.674519+0000","last_became_peered":"2024-09-16T01:55:56.674519+0000","last_unstale":"2024-09-16T01:55:59.789814+0000","last_undegraded":"2024-09-16T01:55:59.789814+0000","last_fullsized":"2024-09-16T01:55:59.789814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:34.317242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.790198+0000","last_change":"2024-09-16T01:55:57.683738+0000","last_active":"2024-09-16T01:55:59.790198+0000","last_peered":"2024-09-16T01:55:59.790198+0000","last_clean":"2024-09-16T01:55:59.790198+0000","last_became_active":"2024-09-16T01:55:57.683453+0000","last_became_peered":"2024-09-16T01:55:57.683453+0000","last_unstale":"2024-09-16T01:55:59.790198+0000","last_undegraded":"2024-09-16T01:55:59.790198+0000","last_fullsized":"2024-09-16T01:55:59.790198+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:18.940780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.682701+0000","last_change":"2024-09-16T01:55:56.674106+0000","last_active":"2024-09-16T01:55:58.682701+0000","last_peered":"2024-09-16T01:55:58.682701+0000","last_clean":"2024-09-16T01:55:58.682701+0000","last_became_active":"2024-09-16T01:55:56.673703+0000","last_became_peered":"2024-09-16T01:55:56.673703+0000","last_unstale":"2024-09-16T01:55:58.682701+0000","last_undegraded":"2024-09-16T01:55:58.682701+0000","last_fullsized":"2024-09-16T01:55:58.682701+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:59.174893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.788974+0000","last_change":"2024-09-16T01:55:57.674298+0000","last_active":"2024-09-16T01:55:59.788974+0000","last_peered":"2024-09-16T01:55:59.788974+0000","last_clean":"2024-09-16T01:55:59.788974+0000","last_became_active":"2024-09-16T01:55:57.673925+0000","last_became_peered":"2024-09-16T01:55:57.673925+0000","last_unstale":"2024-09-16T01:55:59.788974+0000","last_undegraded":"2024-09-16T01:55:59.788974+0000","last_fullsized":"2024-09-16T01:55:59.788974+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:39.585327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789726+0000","last_change":"2024-09-16T01:55:56.678488+0000","last_active":"2024-09-16T01:55:59.789726+0000","last_peered":"2024-09-16T01:55:59.789726+0000","last_clean":"2024-09-16T01:55:59.789726+0000","last_became_active":"2024-09-16T01:55:56.678214+0000","last_became_peered":"2024-09-16T01:55:56.678214+0000","last_unstale":"2024-09-16T01:55:59.789726+0000","last_undegraded":"2024-09-16T01:55:59.789726+0000","last_fullsized":"2024-09-16T01:55:59.789726+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:10.936010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.682740+0000","last_change":"2024-09-16T01:55:57.677627+0000","last_active":"2024-09-16T01:55:58.682740+0000","last_peered":"2024-09-16T01:55:58.682740+0000","last_clean":"2024-09-16T01:55:58.682740+0000","last_became_active":"2024-09-16T01:55:57.677344+0000","last_became_peered":"2024-09-16T01:55:57.677344+0000","last_unstale":"2024-09-16T01:55:58.682740+0000","last_undegraded":"2024-09-16T01:55:58.682740+0000","last_fullsized":"2024-09-16T01:55:58.682740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:03.404535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"49'6","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676262+0000","last_change":"2024-09-16T01:55:56.675095+0000","last_active":"2024-09-16T01:55:58.676262+0000","last_peered":"2024-09-16T01:55:58.676262+0000","last_clean":"2024-09-16T01:55:58.676262+0000","last_became_active":"2024-09-16T01:55:56.673929+0000","last_became_peered":"2024-09-16T01:55:56.673929+0000","last_unstale":"2024-09-16T01:55:58.676262+0000","last_undegraded":"2024-09-16T01:55:58.676262+0000","last_fullsized":"2024-09-16T01:55:58.676262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:32.634237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789177+0000","last_change":"2024-09-16T01:55:57.681195+0000","last_active":"2024-09-16T01:55:59.789177+0000","last_peered":"2024-09-16T01:55:59.789177+0000","last_clean":"2024-09-16T01:55:59.789177+0000","last_became_active":"2024-09-16T01:55:57.680850+0000","last_became_peered":"2024-09-16T01:55:57.680850+0000","last_unstale":"2024-09-16T01:55:59.789177+0000","last_undegraded":"2024-09-16T01:55:59.789177+0000","last_fullsized":"2024-09-16T01:55:59.789177+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:33.641641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789203+0000","last_change":"2024-09-16T01:55:56.678271+0000","last_active":"2024-09-16T01:55:59.789203+0000","last_peered":"2024-09-16T01:55:59.789203+0000","last_clean":"2024-09-16T01:55:59.789203+0000","last_became_active":"2024-09-16T01:55:56.678035+0000","last_became_peered":"2024-09-16T01:55:56.678035+0000","last_unstale":"2024-09-16T01:55:59.789203+0000","last_undegraded":"2024-09-16T01:55:59.789203+0000","last_fullsized":"2024-09-16T01:55:59.789203+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:34:53.787303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789645+0000","last_change":"2024-09-16T01:55:57.668027+0000","last_active":"2024-09-16T01:55:59.789645+0000","last_peered":"2024-09-16T01:55:59.789645+0000","last_clean":"2024-09-16T01:55:59.789645+0000","last_became_active":"2024-09-16T01:55:57.667613+0000","last_became_peered":"2024-09-16T01:55:57.667613+0000","last_unstale":"2024-09-16T01:55:59.789645+0000","last_undegraded":"2024-09-16T01:55:59.789645+0000","last_fullsized":"2024-09-16T01:55:59.789645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:49.778554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789262+0000","last_change":"2024-09-16T01:55:56.678381+0000","last_active":"2024-09-16T01:55:59.789262+0000","last_peered":"2024-09-16T01:55:59.789262+0000","last_clean":"2024-09-16T01:55:59.789262+0000","last_became_active":"2024-09-16T01:55:56.678000+0000","last_became_peered":"2024-09-16T01:55:56.678000+0000","last_unstale":"2024-09-16T01:55:59.789262+0000","last_undegraded":"2024-09-16T01:55:59.789262+0000","last_fullsized":"2024-09-16T01:55:59.789262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:59.642281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676190+0000","last_change":"2024-09-16T01:55:57.682299+0000","last_active":"2024-09-16T01:55:58.676190+0000","last_peered":"2024-09-16T01:55:58.676190+0000","last_clean":"2024-09-16T01:55:58.676190+0000","last_became_active":"2024-09-16T01:55:57.682005+0000","last_became_peered":"2024-09-16T01:55:57.682005+0000","last_unstale":"2024-09-16T01:55:58.676190+0000","last_undegraded":"2024-09-16T01:55:58.676190+0000","last_fullsized":"2024-09-16T01:55:58.676190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:51.634020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789269+0000","last_change":"2024-09-16T01:55:56.677509+0000","last_active":"2024-09-16T01:55:59.789269+0000","last_peered":"2024-09-16T01:55:59.789269+0000","last_clean":"2024-09-16T01:55:59.789269+0000","last_became_active":"2024-09-16T01:55:56.677242+0000","last_became_peered":"2024-09-16T01:55:56.677242+0000","last_unstale":"2024-09-16T01:55:59.789269+0000","last_undegraded":"2024-09-16T01:55:59.789269+0000","last_fullsized":"2024-09-16T01:55:59.789269+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:09.600659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789698+0000","last_change":"2024-09-16T01:55:57.680781+0000","last_active":"2024-09-16T01:55:59.789698+0000","last_peered":"2024-09-16T01:55:59.789698+0000","last_clean":"2024-09-16T01:55:59.789698+0000","last_became_active":"2024-09-16T01:55:57.680275+0000","last_became_peered":"2024-09-16T01:55:57.680275+0000","last_unstale":"2024-09-16T01:55:59.789698+0000","last_undegraded":"2024-09-16T01:55:59.789698+0000","last_fullsized":"2024-09-16T01:55:59.789698+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:32.194897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"49'8","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676214+0000","last_change":"2024-09-16T01:55:56.675767+0000","last_active":"2024-09-16T01:55:58.676214+0000","last_peered":"2024-09-16T01:55:58.676214+0000","last_clean":"2024-09-16T01:55:58.676214+0000","last_became_active":"2024-09-16T01:55:56.672849+0000","last_became_peered":"2024-09-16T01:55:56.672849+0000","last_unstale":"2024-09-16T01:55:58.676214+0000","last_undegraded":"2024-09-16T01:55:58.676214+0000","last_fullsized":"2024-09-16T01:55:58.676214+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:39.260833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676142+0000","last_change":"2024-09-16T01:55:57.690086+0000","last_active":"2024-09-16T01:55:58.676142+0000","last_peered":"2024-09-16T01:55:58.676142+0000","last_clean":"2024-09-16T01:55:58.676142+0000","last_became_active":"2024-09-16T01:55:57.688685+0000","last_became_peered":"2024-09-16T01:55:57.688685+0000","last_unstale":"2024-09-16T01:55:58.676142+0000","last_undegraded":"2024-09-16T01:55:58.676142+0000","last_fullsized":"2024-09-16T01:55:58.676142+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:42.660593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789783+0000","last_change":"2024-09-16T01:55:56.676685+0000","last_active":"2024-09-16T01:55:59.789783+0000","last_peered":"2024-09-16T01:55:59.789783+0000","last_clean":"2024-09-16T01:55:59.789783+0000","last_became_active":"2024-09-16T01:55:56.676301+0000","last_became_peered":"2024-09-16T01:55:56.676301+0000","last_unstale":"2024-09-16T01:55:59.789783+0000","last_undegraded":"2024-09-16T01:55:59.789783+0000","last_fullsized":"2024-09-16T01:55:59.789783+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:48.780338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555214+0000","last_change":"2024-09-16T01:55:57.674603+0000","last_active":"2024-09-16T01:55:59.555214+0000","last_peered":"2024-09-16T01:55:59.555214+0000","last_clean":"2024-09-16T01:55:59.555214+0000","last_became_active":"2024-09-16T01:55:57.674322+0000","last_became_peered":"2024-09-16T01:55:57.674322+0000","last_unstale":"2024-09-16T01:55:59.555214+0000","last_undegraded":"2024-09-16T01:55:59.555214+0000","last_fullsized":"2024-09-16T01:55:59.555214+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:05.061419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.815543+0000","last_change":"2024-09-16T01:55:56.671401+0000","last_active":"2024-09-16T01:55:58.815543+0000","last_peered":"2024-09-16T01:55:58.815543+0000","last_clean":"2024-09-16T01:55:58.815543+0000","last_became_active":"2024-09-16T01:55:56.671110+0000","last_became_peered":"2024-09-16T01:55:56.671110+0000","last_unstale":"2024-09-16T01:55:58.815543+0000","last_undegraded":"2024-09-16T01:55:58.815543+0000","last_fullsized":"2024-09-16T01:55:58.815543+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:16.031337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.682821+0000","last_change":"2024-09-16T01:55:57.680615+0000","last_active":"2024-09-16T01:55:58.682821+0000","last_peered":"2024-09-16T01:55:58.682821+0000","last_clean":"2024-09-16T01:55:58.682821+0000","last_became_active":"2024-09-16T01:55:57.680359+0000","last_became_peered":"2024-09-16T01:55:57.680359+0000","last_unstale":"2024-09-16T01:55:58.682821+0000","last_undegraded":"2024-09-16T01:55:58.682821+0000","last_fullsized":"2024-09-16T01:55:58.682821+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:34:54.794706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789308+0000","last_change":"2024-09-16T01:55:56.680336+0000","last_active":"2024-09-16T01:55:59.789308+0000","last_peered":"2024-09-16T01:55:59.789308+0000","last_clean":"2024-09-16T01:55:59.789308+0000","last_became_active":"2024-09-16T01:55:56.680069+0000","last_became_peered":"2024-09-16T01:55:56.680069+0000","last_unstale":"2024-09-16T01:55:59.789308+0000","last_undegraded":"2024-09-16T01:55:59.789308+0000","last_fullsized":"2024-09-16T01:55:59.789308+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:33.700427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555346+0000","last_change":"2024-09-16T01:55:57.681942+0000","last_active":"2024-09-16T01:55:59.555346+0000","last_peered":"2024-09-16T01:55:59.555346+0000","last_clean":"2024-09-16T01:55:59.555346+0000","last_became_active":"2024-09-16T01:55:57.681609+0000","last_became_peered":"2024-09-16T01:55:57.681609+0000","last_unstale":"2024-09-16T01:55:59.555346+0000","last_undegraded":"2024-09-16T01:55:59.555346+0000","last_fullsized":"2024-09-16T01:55:59.555346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:33.641641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789691+0000","last_change":"2024-09-16T01:55:56.678997+0000","last_active":"2024-09-16T01:55:59.789691+0000","last_peered":"2024-09-16T01:55:59.789691+0000","last_clean":"2024-09-16T01:55:59.789691+0000","last_became_active":"2024-09-16T01:55:56.678693+0000","last_became_peered":"2024-09-16T01:55:56.678693+0000","last_unstale":"2024-09-16T01:55:59.789691+0000","last_undegraded":"2024-09-16T01:55:59.789691+0000","last_fullsized":"2024-09-16T01:55:59.789691+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:04.062859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789374+0000","last_change":"2024-09-16T01:55:57.682960+0000","last_active":"2024-09-16T01:55:59.789374+0000","last_peered":"2024-09-16T01:55:59.789374+0000","last_clean":"2024-09-16T01:55:59.789374+0000","last_became_active":"2024-09-16T01:55:57.682672+0000","last_became_peered":"2024-09-16T01:55:57.682672+0000","last_unstale":"2024-09-16T01:55:59.789374+0000","last_undegraded":"2024-09-16T01:55:59.789374+0000","last_fullsized":"2024-09-16T01:55:59.789374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:41:23.550514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555425+0000","last_change":"2024-09-16T01:55:56.673670+0000","last_active":"2024-09-16T01:55:59.555425+0000","last_peered":"2024-09-16T01:55:59.555425+0000","last_clean":"2024-09-16T01:55:59.555425+0000","last_became_active":"2024-09-16T01:55:56.673383+0000","last_became_peered":"2024-09-16T01:55:56.673383+0000","last_unstale":"2024-09-16T01:55:59.555425+0000","last_undegraded":"2024-09-16T01:55:59.555425+0000","last_fullsized":"2024-09-16T01:55:59.555425+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:03.802559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789066+0000","last_change":"2024-09-16T01:55:57.672140+0000","last_active":"2024-09-16T01:55:59.789066+0000","last_peered":"2024-09-16T01:55:59.789066+0000","last_clean":"2024-09-16T01:55:59.789066+0000","last_became_active":"2024-09-16T01:55:57.669310+0000","last_became_peered":"2024-09-16T01:55:57.669310+0000","last_unstale":"2024-09-16T01:55:59.789066+0000","last_undegraded":"2024-09-16T01:55:59.789066+0000","last_fullsized":"2024-09-16T01:55:59.789066+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:32.736531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676001+0000","last_change":"2024-09-16T01:55:56.675899+0000","last_active":"2024-09-16T01:55:58.676001+0000","last_peered":"2024-09-16T01:55:58.676001+0000","last_clean":"2024-09-16T01:55:58.676001+0000","last_became_active":"2024-09-16T01:55:56.672947+0000","last_became_peered":"2024-09-16T01:55:56.672947+0000","last_unstale":"2024-09-16T01:55:58.676001+0000","last_undegraded":"2024-09-16T01:55:58.676001+0000","last_fullsized":"2024-09-16T01:55:58.676001+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:47.360759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789562+0000","last_change":"2024-09-16T01:55:57.676130+0000","last_active":"2024-09-16T01:55:59.789562+0000","last_peered":"2024-09-16T01:55:59.789562+0000","last_clean":"2024-09-16T01:55:59.789562+0000","last_became_active":"2024-09-16T01:55:57.675769+0000","last_became_peered":"2024-09-16T01:55:57.675769+0000","last_unstale":"2024-09-16T01:55:59.789562+0000","last_undegraded":"2024-09-16T01:55:59.789562+0000","last_fullsized":"2024-09-16T01:55:59.789562+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:49.414955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.788997+0000","last_change":"2024-09-16T01:55:56.679277+0000","last_active":"2024-09-16T01:55:59.788997+0000","last_peered":"2024-09-16T01:55:59.788997+0000","last_clean":"2024-09-16T01:55:59.788997+0000","last_became_active":"2024-09-16T01:55:56.678972+0000","last_became_peered":"2024-09-16T01:55:56.678972+0000","last_unstale":"2024-09-16T01:55:59.788997+0000","last_undegraded":"2024-09-16T01:55:59.788997+0000","last_fullsized":"2024-09-16T01:55:59.788997+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:38.422711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555581+0000","last_change":"2024-09-16T01:55:57.677927+0000","last_active":"2024-09-16T01:55:59.555581+0000","last_peered":"2024-09-16T01:55:59.555581+0000","last_clean":"2024-09-16T01:55:59.555581+0000","last_became_active":"2024-09-16T01:55:57.677623+0000","last_became_peered":"2024-09-16T01:55:57.677623+0000","last_unstale":"2024-09-16T01:55:59.555581+0000","last_undegraded":"2024-09-16T01:55:59.555581+0000","last_fullsized":"2024-09-16T01:55:59.555581+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:52.221959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.815246+0000","last_change":"2024-09-16T01:55:56.671230+0000","last_active":"2024-09-16T01:55:58.815246+0000","last_peered":"2024-09-16T01:55:58.815246+0000","last_clean":"2024-09-16T01:55:58.815246+0000","last_became_active":"2024-09-16T01:55:56.670928+0000","last_became_peered":"2024-09-16T01:55:56.670928+0000","last_unstale":"2024-09-16T01:55:58.815246+0000","last_undegraded":"2024-09-16T01:55:58.815246+0000","last_fullsized":"2024-09-16T01:55:58.815246+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:49.693033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789964+0000","last_change":"2024-09-16T01:55:57.684772+0000","last_active":"2024-09-16T01:55:59.789964+0000","last_peered":"2024-09-16T01:55:59.789964+0000","last_clean":"2024-09-16T01:55:59.789964+0000","last_became_active":"2024-09-16T01:55:57.684499+0000","last_became_peered":"2024-09-16T01:55:57.684499+0000","last_unstale":"2024-09-16T01:55:59.789964+0000","last_undegraded":"2024-09-16T01:55:59.789964+0000","last_fullsized":"2024-09-16T01:55:59.789964+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:35:58.733753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789474+0000","last_change":"2024-09-16T01:55:56.679050+0000","last_active":"2024-09-16T01:55:59.789474+0000","last_peered":"2024-09-16T01:55:59.789474+0000","last_clean":"2024-09-16T01:55:59.789474+0000","last_became_active":"2024-09-16T01:55:56.678637+0000","last_became_peered":"2024-09-16T01:55:56.678637+0000","last_unstale":"2024-09-16T01:55:59.789474+0000","last_undegraded":"2024-09-16T01:55:59.789474+0000","last_fullsized":"2024-09-16T01:55:59.789474+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:34:58.717994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.555372+0000","last_change":"2024-09-16T01:55:57.671982+0000","last_active":"2024-09-16T01:55:59.555372+0000","last_peered":"2024-09-16T01:55:59.555372+0000","last_clean":"2024-09-16T01:55:59.555372+0000","last_became_active":"2024-09-16T01:55:57.670985+0000","last_became_peered":"2024-09-16T01:55:57.670985+0000","last_unstale":"2024-09-16T01:55:59.555372+0000","last_undegraded":"2024-09-16T01:55:59.555372+0000","last_fullsized":"2024-09-16T01:55:59.555372+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:41:23.550514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789954+0000","last_change":"2024-09-16T01:55:56.675512+0000","last_active":"2024-09-16T01:55:59.789954+0000","last_peered":"2024-09-16T01:55:59.789954+0000","last_clean":"2024-09-16T01:55:59.789954+0000","last_became_active":"2024-09-16T01:55:56.675235+0000","last_became_peered":"2024-09-16T01:55:56.675235+0000","last_unstale":"2024-09-16T01:55:59.789954+0000","last_undegraded":"2024-09-16T01:55:59.789954+0000","last_fullsized":"2024-09-16T01:55:59.789954+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:44.890291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.675994+0000","last_change":"2024-09-16T01:55:57.690892+0000","last_active":"2024-09-16T01:55:58.675994+0000","last_peered":"2024-09-16T01:55:58.675994+0000","last_clean":"2024-09-16T01:55:58.675994+0000","last_became_active":"2024-09-16T01:55:57.690615+0000","last_became_peered":"2024-09-16T01:55:57.690615+0000","last_unstale":"2024-09-16T01:55:58.675994+0000","last_undegraded":"2024-09-16T01:55:58.675994+0000","last_fullsized":"2024-09-16T01:55:58.675994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:39.585327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789347+0000","last_change":"2024-09-16T01:55:56.677151+0000","last_active":"2024-09-16T01:55:59.789347+0000","last_peered":"2024-09-16T01:55:59.789347+0000","last_clean":"2024-09-16T01:55:59.789347+0000","last_became_active":"2024-09-16T01:55:56.676885+0000","last_became_peered":"2024-09-16T01:55:56.676885+0000","last_unstale":"2024-09-16T01:55:59.789347+0000","last_undegraded":"2024-09-16T01:55:59.789347+0000","last_fullsized":"2024-09-16T01:55:59.789347+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:10.765195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789369+0000","last_change":"2024-09-16T01:55:57.689814+0000","last_active":"2024-09-16T01:55:59.789369+0000","last_peered":"2024-09-16T01:55:59.789369+0000","last_clean":"2024-09-16T01:55:59.789369+0000","last_became_active":"2024-09-16T01:55:57.689520+0000","last_became_peered":"2024-09-16T01:55:57.689520+0000","last_unstale":"2024-09-16T01:55:59.789369+0000","last_undegraded":"2024-09-16T01:55:59.789369+0000","last_fullsized":"2024-09-16T01:55:59.789369+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:08.564330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676050+0000","last_change":"2024-09-16T01:55:56.676143+0000","last_active":"2024-09-16T01:55:58.676050+0000","last_peered":"2024-09-16T01:55:58.676050+0000","last_clean":"2024-09-16T01:55:58.676050+0000","last_became_active":"2024-09-16T01:55:56.675431+0000","last_became_peered":"2024-09-16T01:55:56.675431+0000","last_unstale":"2024-09-16T01:55:58.676050+0000","last_undegraded":"2024-09-16T01:55:58.676050+0000","last_fullsized":"2024-09-16T01:55:58.676050+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:06.727433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789313+0000","last_change":"2024-09-16T01:55:57.680377+0000","last_active":"2024-09-16T01:55:59.789313+0000","last_peered":"2024-09-16T01:55:59.789313+0000","last_clean":"2024-09-16T01:55:59.789313+0000","last_became_active":"2024-09-16T01:55:57.680099+0000","last_became_peered":"2024-09-16T01:55:57.680099+0000","last_unstale":"2024-09-16T01:55:59.789313+0000","last_undegraded":"2024-09-16T01:55:59.789313+0000","last_fullsized":"2024-09-16T01:55:59.789313+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:44.757223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676134+0000","last_change":"2024-09-16T01:55:56.677559+0000","last_active":"2024-09-16T01:55:58.676134+0000","last_peered":"2024-09-16T01:55:58.676134+0000","last_clean":"2024-09-16T01:55:58.676134+0000","last_became_active":"2024-09-16T01:55:56.677238+0000","last_became_peered":"2024-09-16T01:55:56.677238+0000","last_unstale":"2024-09-16T01:55:58.676134+0000","last_undegraded":"2024-09-16T01:55:58.676134+0000","last_fullsized":"2024-09-16T01:55:58.676134+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:04.054016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789493+0000","last_change":"2024-09-16T01:55:57.683257+0000","last_active":"2024-09-16T01:55:59.789493+0000","last_peered":"2024-09-16T01:55:59.789493+0000","last_clean":"2024-09-16T01:55:59.789493+0000","last_became_active":"2024-09-16T01:55:57.681357+0000","last_became_peered":"2024-09-16T01:55:57.681357+0000","last_unstale":"2024-09-16T01:55:59.789493+0000","last_undegraded":"2024-09-16T01:55:59.789493+0000","last_fullsized":"2024-09-16T01:55:59.789493+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:51.634020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.682554+0000","last_change":"2024-09-16T01:55:56.677669+0000","last_active":"2024-09-16T01:55:58.682554+0000","last_peered":"2024-09-16T01:55:58.682554+0000","last_clean":"2024-09-16T01:55:58.682554+0000","last_became_active":"2024-09-16T01:55:56.677374+0000","last_became_peered":"2024-09-16T01:55:56.677374+0000","last_unstale":"2024-09-16T01:55:58.682554+0000","last_undegraded":"2024-09-16T01:55:58.682554+0000","last_fullsized":"2024-09-16T01:55:58.682554+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:33.700427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:58.676455+0000","last_change":"2024-09-16T01:55:57.690161+0000","last_active":"2024-09-16T01:55:58.676455+0000","last_peered":"2024-09-16T01:55:58.676455+0000","last_clean":"2024-09-16T01:55:58.676455+0000","last_became_active":"2024-09-16T01:55:57.689746+0000","last_became_peered":"2024-09-16T01:55:57.689746+0000","last_unstale":"2024-09-16T01:55:58.676455+0000","last_undegraded":"2024-09-16T01:55:58.676455+0000","last_fullsized":"2024-09-16T01:55:58.676455+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:50.883878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.790057+0000","last_change":"2024-09-16T01:55:56.669731+0000","last_active":"2024-09-16T01:55:59.790057+0000","last_peered":"2024-09-16T01:55:59.790057+0000","last_clean":"2024-09-16T01:55:59.790057+0000","last_became_active":"2024-09-16T01:55:56.669401+0000","last_became_peered":"2024-09-16T01:55:56.669401+0000","last_unstale":"2024-09-16T01:55:59.790057+0000","last_undegraded":"2024-09-16T01:55:59.790057+0000","last_fullsized":"2024-09-16T01:55:59.790057+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:22.839850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789632+0000","last_change":"2024-09-16T01:55:57.682245+0000","last_active":"2024-09-16T01:55:59.789632+0000","last_peered":"2024-09-16T01:55:59.789632+0000","last_clean":"2024-09-16T01:55:59.789632+0000","last_became_active":"2024-09-16T01:55:57.681943+0000","last_became_peered":"2024-09-16T01:55:57.681943+0000","last_unstale":"2024-09-16T01:55:59.789632+0000","last_undegraded":"2024-09-16T01:55:59.789632+0000","last_fullsized":"2024-09-16T01:55:59.789632+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:56.650152+0000","last_clean_scrub_stamp":"2024-09-16T01:55:56.650152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:07.734836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789658+0000","last_change":"2024-09-16T01:55:56.680303+0000","last_active":"2024-09-16T01:55:59.789658+0000","last_peered":"2024-09-16T01:55:59.789658+0000","last_clean":"2024-09-16T01:55:59.789658+0000","last_became_active":"2024-09-16T01:55:56.680031+0000","last_became_peered":"2024-09-16T01:55:56.680031+0000","last_unstale":"2024-09-16T01:55:59.789658+0000","last_undegraded":"2024-09-16T01:55:59.789658+0000","last_fullsized":"2024-09-16T01:55:59.789658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:55:55.642749+0000","last_clean_scrub_stamp":"2024-09-16T01:55:55.642749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:22.839850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T01:55:59.789055+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:55:59.789055+0000","last_peered":"2024-09-16T01:55:59.789055+0000","last_clean":"2024-09-16T01:55:59.789055+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:55:59.789055+0000","last_undegraded":"2024-09-16T01:55:59.789055+0000","last_fullsized":"2024-09-16T01:55:59.789055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":259171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":258519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":259101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":602112,"data_stored":260153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":593920,"data_stored":258679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1175552,"data_stored":842251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1187840,"data_stored":849011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":598016,"data_stored":260131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:56:05.576 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:56:05.577 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:56:05.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.724+0000 7f4c705fd640 1 Processor -- start 2024-09-16T01:56:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.724+0000 7f4c705fd640 1 -- start start 2024-09-16T01:56:05.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c705fd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c680d15f0 0x7f4c680cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c705fd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4c680cf160 0x7f4c6806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c705fd640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c680cf980 con 0x7f4c68161a20 2024-09-16T01:56:05.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c705fd640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f4c68161e00 con 0x7f4c680cf160 2024-09-16T01:56:05.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c705fd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6806d050 con 0x7f4c680d15f0 2024-09-16T01:56:05.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c6e399640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4c68161a20 0x7f4c680d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52792/0 (socket says 172.21.15.42:52792) 2024-09-16T01:56:05.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c6e399640 1 -- 172.21.15.42:0/3432386959 learned_addr learned my addr 172.21.15.42:0/3432386959 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:05.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80015656 0 0) 0x7f4c680cf980 con 0x7f4c68161a20 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c54003520 con 0x7f4c68161a20 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c6eb9a640 1 --2- 172.21.15.42:0/3432386959 >> v2:172.21.15.107:3300/0 conn(0x7f4c680cf160 0x7f4c6806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.725+0000 7f4c6db98640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c680d15f0 0x7f4c680cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 167782897 0 0) 0x7f4c54003520 con 0x7f4c68161a20 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c680d15f0 msgr2=0x7f4c680cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c680d15f0 0x7f4c680cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 >> v2:172.21.15.107:3300/0 conn(0x7f4c680cf160 msgr2=0x7f4c6806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 --2- 172.21.15.42:0/3432386959 >> v2:172.21.15.107:3300/0 conn(0x7f4c680cf160 0x7f4c6806d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c680cfc20 con 0x7f4c68161a20 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f4c64001670 con 0x7f4c68161a20 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 >> v1:172.21.15.42:6789/0 conn(0x7f4c68161a20 legacy=0x7f4c680d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 0x7f4c54003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c680d15f0 0x7f4c54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c54004d40 0x7f4c540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4c68161e00 con 0x7f4c540039b0 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6806d050 con 0x7f4c54004d40 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5400b9c0 con 0x7f4c680d15f0 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6e399640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 0x7f4c54003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6db98640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c680d15f0 0x7f4c54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6eb9a640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c54004d40 0x7f4c540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6e399640 1 -- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c680d15f0 msgr2=0x7f4c54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6e399640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c680d15f0 0x7f4c54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6e399640 1 -- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c54004d40 msgr2=0x7f4c540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6e399640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c54004d40 0x7f4c540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6e399640 1 -- 172.21.15.42:0/3432386959 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c54003520 con 0x7f4c540039b0 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.726+0000 7f4c6eb9a640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c54004d40 0x7f4c540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.727+0000 7f4c6e399640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 0x7f4c54003dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4c64001050 tx=0x7f4c54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b798f7db590fc177 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.727+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64007d70 con 0x7f4c540039b0 2024-09-16T01:56:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.727+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64005af0 con 0x7f4c540039b0 2024-09-16T01:56:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.727+0000 7f4c6d397640 1 -- 172.21.15.42:0/3432386959 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64007070 con 0x7f4c540039b0 2024-09-16T01:56:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.728+0000 7f4c705fd640 1 -- 172.21.15.42:0/3432386959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 msgr2=0x7f4c54003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.728+0000 7f4c705fd640 1 --2- 172.21.15.42:0/3432386959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 0x7f4c54003dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4c64001050 tx=0x7f4c54005830 comp rx=0 tx=0).stop 2024-09-16T01:56:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.728+0000 7f4c6eb9a640 1 -- 172.21.15.42:0/3432386959 reap_dead start 2024-09-16T01:56:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.728+0000 7f4c705fd640 1 -- 172.21.15.42:0/3432386959 shutdown_connections 2024-09-16T01:56:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.728+0000 7f4c705fd640 1 -- 172.21.15.42:0/3432386959 >> 172.21.15.42:0/3432386959 conn(0x7f4c6809d850 msgr2=0x7f4c6808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.728+0000 7f4c705fd640 1 -- 172.21.15.42:0/3432386959 shutdown_connections 2024-09-16T01:56:05.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.728+0000 7f4c705fd640 1 -- 172.21.15.42:0/3432386959 wait complete. 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.729+0000 7f4c705fd640 1 Processor -- start 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.729+0000 7f4c705fd640 1 -- start start 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c705fd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 0x7f4c68158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c705fd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c6809fbb0 0x7f4c680ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c705fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c680cad10 0x7f4c6809ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c705fd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4c680b1040 con 0x7f4c540039b0 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c705fd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6806d2f0 con 0x7f4c680cad10 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c705fd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4c680cf5f0 con 0x7f4c6809fbb0 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6e399640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 0x7f4c68158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6e399640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 0x7f4c68158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49284/0 (socket says 172.21.15.42:49284) 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6e399640 1 -- 172.21.15.42:0/1544353153 learned_addr learned my addr 172.21.15.42:0/1544353153 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6db98640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c6809fbb0 0x7f4c680ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6eb9a640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c680cad10 0x7f4c6809ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6e399640 1 -- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c6809fbb0 msgr2=0x7f4c680ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6e399640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c6809fbb0 0x7f4c680ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6e399640 1 -- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c680cad10 msgr2=0x7f4c6809ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6e399640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c680cad10 0x7f4c6809ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6e399640 1 -- 172.21.15.42:0/1544353153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6809eb80 con 0x7f4c540039b0 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6db98640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c6809fbb0 0x7f4c680ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c6e399640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 0x7f4c68158a20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400c300 tx=0x7f4c64000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c5effd640 1 -- 172.21.15.42:0/1544353153 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64042070 con 0x7f4c540039b0 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c5effd640 1 -- 172.21.15.42:0/1544353153 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64007480 con 0x7f4c540039b0 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c705fd640 1 -- 172.21.15.42:0/1544353153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c68158f60 con 0x7f4c540039b0 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.730+0000 7f4c5effd640 1 -- 172.21.15.42:0/1544353153 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64007d50 con 0x7f4c540039b0 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.731+0000 7f4c705fd640 1 -- 172.21.15.42:0/1544353153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6809f100 con 0x7f4c540039b0 2024-09-16T01:56:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.731+0000 7f4c705fd640 1 -- 172.21.15.42:0/1544353153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c680cec20 con 0x7f4c540039b0 2024-09-16T01:56:05.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.732+0000 7f4c5effd640 1 -- 172.21.15.42:0/1544353153 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4c64045070 con 0x7f4c540039b0 2024-09-16T01:56:05.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.732+0000 7f4c5effd640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4c4c06c2b0 0x7f4c4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:05.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.733+0000 7f4c5effd640 1 -- 172.21.15.42:0/1544353153 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f4c640ac150 con 0x7f4c540039b0 2024-09-16T01:56:05.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.733+0000 7f4c6db98640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4c4c06c2b0 0x7f4c4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:05.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.733+0000 7f4c6db98640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4c4c06c2b0 0x7f4c4c06e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4c6815f950 tx=0x7f4c58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:05.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.737+0000 7f4c5effd640 1 -- 172.21.15.42:0/1544353153 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c6404c030 con 0x7f4c540039b0 2024-09-16T01:56:05.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.979+0000 7f4c705fd640 1 -- 172.21.15.42:0/1544353153 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4c6809f7c0 con 0x7f4c540039b0 2024-09-16T01:56:05.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.981+0000 7f4c5effd640 1 -- 172.21.15.42:0/1544353153 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f4c64005ac0 con 0x7f4c540039b0 2024-09-16T01:56:05.982 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-16T01:56:05.982 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCPj+dm96TxJBAAoZCGS2uSu2E2+xtA9fj+5g== 2024-09-16T01:56:05.982 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-16T01:56:05.982 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-16T01:56:05.982 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:56:05.983 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-16T01:56:05.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 -- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4c4c06c2b0 msgr2=0x7f4c4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4c4c06c2b0 0x7f4c4c06e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4c6815f950 tx=0x7f4c58008040 comp rx=0 tx=0).stop 2024-09-16T01:56:05.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 -- 172.21.15.42:0/1544353153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 msgr2=0x7f4c68158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 0x7f4c68158a20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400c300 tx=0x7f4c64000fe0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 -- 172.21.15.42:0/1544353153 shutdown_connections 2024-09-16T01:56:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4c4c06c2b0 0x7f4c4c06e770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c680cad10 0x7f4c6809ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c6809fbb0 0x7f4c680ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 --2- 172.21.15.42:0/1544353153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c540039b0 0x7f4c68158a20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 -- 172.21.15.42:0/1544353153 >> 172.21.15.42:0/1544353153 conn(0x7f4c6809d850 msgr2=0x7f4c680d4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 -- 172.21.15.42:0/1544353153 shutdown_connections 2024-09-16T01:56:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:05.983+0000 7f4c705fd640 1 -- 172.21.15.42:0/1544353153 wait complete. 2024-09-16T01:56:05.995 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:56:06.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.097+0000 7f6b13118640 1 Processor -- start 2024-09-16T01:56:06.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.097+0000 7f6b13118640 1 -- start start 2024-09-16T01:56:06.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b13118640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c15e5f0 0x7f6b0c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b13118640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b0c0b6690 0x7f6b0c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b13118640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0c0d3690 con 0x7f6b0c0d30f0 2024-09-16T01:56:06.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b13118640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0c06d530 con 0x7f6b0c0b6690 2024-09-16T01:56:06.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b13118640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c0d3970 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b10eb4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c15e5f0 0x7f6b0c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b116b5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b0c0b6690 0x7f6b0c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b116b5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6b0c0b6690 0x7f6b0c06d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:49624/0 (socket says 172.21.15.42:49624) 2024-09-16T01:56:06.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b116b5640 1 -- 172.21.15.42:0/1587948416 learned_addr learned my addr 172.21.15.42:0/1587948416 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:06.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b10eb4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c15e5f0 0x7f6b0c0d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:49740/0 (socket says 172.21.15.42:49740) 2024-09-16T01:56:06.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b116b5640 1 -- 172.21.15.42:0/1587948416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c15e5f0 msgr2=0x7f6b0c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b116b5640 1 --2- 172.21.15.42:0/1587948416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c15e5f0 0x7f6b0c0d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b116b5640 1 -- 172.21.15.42:0/1587948416 >> v1:172.21.15.107:6789/0 conn(0x7f6b0c0d30f0 legacy=0x7f6b0c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.098+0000 7f6b116b5640 1 -- 172.21.15.42:0/1587948416 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c06cee0 con 0x7f6b0c0b6690 2024-09-16T01:56:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.099+0000 7f6b116b5640 1 --2- 172.21.15.42:0/1587948416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b0c0b6690 0x7f6b0c06d9c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009e50 tx=0x7f6b0402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b1acbecac1aadf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.099+0000 7f6b037fe640 1 -- 172.21.15.42:0/1587948416 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04036070 con 0x7f6b0c0b6690 2024-09-16T01:56:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.099+0000 7f6b037fe640 1 -- 172.21.15.42:0/1587948416 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b04031600 con 0x7f6b0c0b6690 2024-09-16T01:56:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.099+0000 7f6b037fe640 1 -- 172.21.15.42:0/1587948416 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b040319d0 con 0x7f6b0c0b6690 2024-09-16T01:56:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.100+0000 7f6b13118640 1 -- 172.21.15.42:0/1587948416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b0c0b6690 msgr2=0x7f6b0c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.100+0000 7f6b13118640 1 --2- 172.21.15.42:0/1587948416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b0c0b6690 0x7f6b0c06d9c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009e50 tx=0x7f6b0402a710 comp rx=0 tx=0).stop 2024-09-16T01:56:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.100+0000 7f6b13118640 1 -- 172.21.15.42:0/1587948416 shutdown_connections 2024-09-16T01:56:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.100+0000 7f6b13118640 1 --2- 172.21.15.42:0/1587948416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b0c0b6690 0x7f6b0c06d9c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.100+0000 7f6b13118640 1 --2- 172.21.15.42:0/1587948416 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c15e5f0 0x7f6b0c0d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.100+0000 7f6b13118640 1 -- 172.21.15.42:0/1587948416 >> 172.21.15.42:0/1587948416 conn(0x7f6b0c08bfc0 msgr2=0x7f6b0c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:06.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.100+0000 7f6b13118640 1 -- 172.21.15.42:0/1587948416 shutdown_connections 2024-09-16T01:56:06.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.100+0000 7f6b13118640 1 -- 172.21.15.42:0/1587948416 wait complete. 2024-09-16T01:56:06.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.101+0000 7f6b13118640 1 Processor -- start 2024-09-16T01:56:06.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.101+0000 7f6b13118640 1 -- start start 2024-09-16T01:56:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b13118640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c0b6690 0x7f6b0c15daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b13118640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b0c0d30f0 0x7f6b0c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b13118640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b0c15e5f0 0x7f6b0c160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b13118640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0d5310 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b13118640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c15e9d0 con 0x7f6b0c0d30f0 2024-09-16T01:56:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b13118640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c06df00 con 0x7f6b0c0b6690 2024-09-16T01:56:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b116b5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b0c15e5f0 0x7f6b0c160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b116b5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b0c15e5f0 0x7f6b0c160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49286/0 (socket says 172.21.15.42:49286) 2024-09-16T01:56:06.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b116b5640 1 -- 172.21.15.42:0/4272551893 learned_addr learned my addr 172.21.15.42:0/4272551893 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b10eb4640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c0b6690 0x7f6b0c15daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b03fff640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b0c0d30f0 0x7f6b0c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b116b5640 1 -- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c0b6690 msgr2=0x7f6b0c15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b116b5640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c0b6690 0x7f6b0c15daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b116b5640 1 -- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b0c0d30f0 msgr2=0x7f6b0c0c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b116b5640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b0c0d30f0 0x7f6b0c0c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.102+0000 7f6b116b5640 1 -- 172.21.15.42:0/4272551893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c09edb0 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.103+0000 7f6b116b5640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b0c15e5f0 0x7f6b0c160d20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009e50 tx=0x7f6b04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.103+0000 7f6b017fa640 1 -- 172.21.15.42:0/4272551893 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04036050 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.103+0000 7f6b017fa640 1 -- 172.21.15.42:0/4272551893 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b04042070 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.103+0000 7f6b13118640 1 -- 172.21.15.42:0/4272551893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c0a0dd0 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.103+0000 7f6b017fa640 1 -- 172.21.15.42:0/4272551893 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04009510 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.103+0000 7f6b13118640 1 -- 172.21.15.42:0/4272551893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c0a1390 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.104+0000 7f6b13118640 1 -- 172.21.15.42:0/4272551893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c06d9c0 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.104+0000 7f6b017fa640 1 -- 172.21.15.42:0/4272551893 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6b04007bf0 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.105+0000 7f6b017fa640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6af806c2e0 0x7f6af806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.105+0000 7f6b017fa640 1 -- 172.21.15.42:0/4272551893 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f6b040ac250 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.105+0000 7f6b10eb4640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6af806c2e0 0x7f6af806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.106+0000 7f6b10eb4640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6af806c2e0 0x7f6af806e7a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c161870 tx=0x7f6b08009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:06.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.109+0000 7f6b017fa640 1 -- 172.21.15.42:0/4272551893 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b0407a1f0 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.318+0000 7f6b13118640 1 -- 172.21.15.42:0/4272551893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b0c0b2b30 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.318+0000 7f6b017fa640 1 -- 172.21.15.42:0/4272551893 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5225 (secure 0 0 0) 0x7f6b0407e4f0 con 0x7f6b0c15e5f0 2024-09-16T01:56:06.320 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:06.320 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-09-16T01:55:59:851792+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3210303754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3210303754},{"type":"v1","addr":"172.21.15.42:6833","nonce":3210303754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/628179225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":628179225},{"type":"v1","addr":"172.21.15.107:6837","nonce":628179225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3586378815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3586378815},{"type":"v1","addr":"172.21.15.42:6835","nonce":3586378815}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:57.021180+0000","modified":"2024-09-16T01:55:59.200652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34817":{"gid":34817,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6836/19167184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":19167184},{"type":"v1","addr":"172.21.15.107:6836","nonce":19167184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34817,"qdb_cluster":[34817]},"id":3}]} 2024-09-16T01:56:06.320 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 -- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6af806c2e0 msgr2=0x7f6af806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6af806c2e0 0x7f6af806e7a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c161870 tx=0x7f6b08009190 comp rx=0 tx=0).stop 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 -- 172.21.15.42:0/4272551893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b0c15e5f0 msgr2=0x7f6b0c160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b0c15e5f0 0x7f6b0c160d20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009e50 tx=0x7f6b04004a40 comp rx=0 tx=0).stop 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 -- 172.21.15.42:0/4272551893 shutdown_connections 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f6af806c2e0 0x7f6af806e7a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b0c15e5f0 0x7f6b0c160d20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b0c0d30f0 0x7f6b0c0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 --2- 172.21.15.42:0/4272551893 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b0c0b6690 0x7f6b0c15daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 -- 172.21.15.42:0/4272551893 >> 172.21.15.42:0/4272551893 conn(0x7f6b0c08bfc0 msgr2=0x7f6b0c0b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 -- 172.21.15.42:0/4272551893 shutdown_connections 2024-09-16T01:56:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.320+0000 7f6b13118640 1 -- 172.21.15.42:0/4272551893 wait complete. 2024-09-16T01:56:06.735 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:55:57.021180+0000', 'modified': '2024-09-16T01:55:59.200652+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34817}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34817': {'gid': 34817, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.107:6836/19167184', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6834', 'nonce': 19167184}, {'type': 'v1', 'addr': '172.21.15.107:6836', 'nonce': 19167184}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34817, 'qdb_cluster': [34817]} 2024-09-16T01:56:06.736 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:56:06.736 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-16T01:56:06.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.843+0000 7fd29bb96640 1 Processor -- start 2024-09-16T01:56:06.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.843+0000 7fd29bb96640 1 -- start start 2024-09-16T01:56:06.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.844+0000 7fd29bb96640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd29415e740 0x7fd2940d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.844+0000 7fd29bb96640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd29409b690 0x7fd29406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.844+0000 7fd29bb96640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2940d0780 con 0x7fd29406d4c0 2024-09-16T01:56:06.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.844+0000 7fd29bb96640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd29415eb20 con 0x7fd29409b690 2024-09-16T01:56:06.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.844+0000 7fd29bb96640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd29406d260 con 0x7fd29415e740 2024-09-16T01:56:06.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.844+0000 7fd299131640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd29409b690 0x7fd29406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.844+0000 7fd299131640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd29409b690 0x7fd29406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49288/0 (socket says 172.21.15.42:49288) 2024-09-16T01:56:06.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.844+0000 7fd299131640 1 -- 172.21.15.42:0/3809357231 learned_addr learned my addr 172.21.15.42:0/3809357231 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:06.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.845+0000 7fd299932640 1 --2- 172.21.15.42:0/3809357231 >> v2:172.21.15.107:3300/0 conn(0x7fd29415e740 0x7fd2940d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.845+0000 7fd299131640 1 -- 172.21.15.42:0/3809357231 >> v2:172.21.15.107:3300/0 conn(0x7fd29415e740 msgr2=0x7fd2940d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.845+0000 7fd299131640 1 --2- 172.21.15.42:0/3809357231 >> v2:172.21.15.107:3300/0 conn(0x7fd29415e740 0x7fd2940d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.845+0000 7fd299131640 1 -- 172.21.15.42:0/3809357231 >> v1:172.21.15.107:6789/0 conn(0x7fd29406d4c0 legacy=0x7fd29406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.845+0000 7fd299131640 1 -- 172.21.15.42:0/3809357231 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2940d0a60 con 0x7fd29409b690 2024-09-16T01:56:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.845+0000 7fd299131640 1 --2- 172.21.15.42:0/3809357231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 0x7fd29406cd20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd294074070 tx=0x7fd28402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb104b1609255724 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd298930640 1 -- 172.21.15.42:0/3809357231 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284037070 con 0x7fd29409b690 2024-09-16T01:56:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd298930640 1 -- 172.21.15.42:0/3809357231 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd284032440 con 0x7fd29409b690 2024-09-16T01:56:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd298930640 1 -- 172.21.15.42:0/3809357231 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284032810 con 0x7fd29409b690 2024-09-16T01:56:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd29bb96640 1 -- 172.21.15.42:0/3809357231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 msgr2=0x7fd29406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd29bb96640 1 --2- 172.21.15.42:0/3809357231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 0x7fd29406cd20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd294074070 tx=0x7fd28402a2c0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd29bb96640 1 -- 172.21.15.42:0/3809357231 shutdown_connections 2024-09-16T01:56:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd29bb96640 1 --2- 172.21.15.42:0/3809357231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 0x7fd29406cd20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd29bb96640 1 --2- 172.21.15.42:0/3809357231 >> v2:172.21.15.107:3300/0 conn(0x7fd29415e740 0x7fd2940d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd29bb96640 1 -- 172.21.15.42:0/3809357231 >> 172.21.15.42:0/3809357231 conn(0x7fd2940d23a0 msgr2=0x7fd2940d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd29bb96640 1 -- 172.21.15.42:0/3809357231 shutdown_connections 2024-09-16T01:56:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.846+0000 7fd29bb96640 1 -- 172.21.15.42:0/3809357231 wait complete. 2024-09-16T01:56:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.847+0000 7fd29bb96640 1 Processor -- start 2024-09-16T01:56:06.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.847+0000 7fd29bb96640 1 -- start start 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd29bb96640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd29406d4c0 0x7fd2941521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd29bb96640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 0x7fd29415aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd29bb96640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd29415e740 0x7fd29415af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd29bb96640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd29409bac0 con 0x7fd29409b690 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd29bb96640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd2940d1020 con 0x7fd29415e740 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd29bb96640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd29406dfe0 con 0x7fd29406d4c0 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd299131640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 0x7fd29415aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd299131640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 0x7fd29415aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49298/0 (socket says 172.21.15.42:49298) 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd299131640 1 -- 172.21.15.42:0/1245359358 learned_addr learned my addr 172.21.15.42:0/1245359358 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd299932640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd29406d4c0 0x7fd2941521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.848+0000 7fd29a133640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd29415e740 0x7fd29415af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd299131640 1 -- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd29406d4c0 msgr2=0x7fd2941521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd299131640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd29406d4c0 0x7fd2941521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd299131640 1 -- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd29415e740 msgr2=0x7fd29415af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd299131640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd29415e740 0x7fd29415af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd299131640 1 -- 172.21.15.42:0/1245359358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2940b7890 con 0x7fd29409b690 2024-09-16T01:56:06.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd29a133640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd29415e740 0x7fd29415af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:06.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd299131640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 0x7fd29415aa40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd284000c00 tx=0x7fd2840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:06.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd28a7fc640 1 -- 172.21.15.42:0/1245359358 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284041020 con 0x7fd29409b690 2024-09-16T01:56:06.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd28a7fc640 1 -- 172.21.15.42:0/1245359358 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2840306c0 con 0x7fd29409b690 2024-09-16T01:56:06.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd28a7fc640 1 -- 172.21.15.42:0/1245359358 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284037040 con 0x7fd29409b690 2024-09-16T01:56:06.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd29bb96640 1 -- 172.21.15.42:0/1245359358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2940cc9d0 con 0x7fd29409b690 2024-09-16T01:56:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.849+0000 7fd29bb96640 1 -- 172.21.15.42:0/1245359358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2940ccf90 con 0x7fd29409b690 2024-09-16T01:56:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.851+0000 7fd28a7fc640 1 -- 172.21.15.42:0/1245359358 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd284044020 con 0x7fd29409b690 2024-09-16T01:56:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.851+0000 7fd28a7fc640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd27806c2b0 0x7fd27806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.851+0000 7fd28a7fc640 1 -- 172.21.15.42:0/1245359358 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fd2840abdc0 con 0x7fd29409b690 2024-09-16T01:56:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.851+0000 7fd299932640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd27806c2b0 0x7fd27806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.852+0000 7fd299932640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd27806c2b0 0x7fd27806e770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd290006fd0 tx=0x7fd290008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.852+0000 7fd29ea08740 1 Processor -- start 2024-09-16T01:56:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.852+0000 7fd29ea08740 1 -- start start 2024-09-16T01:56:06.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f9902c0 0x55ae9f9d5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f98da80 0x55ae9f9906a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f98a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29ea08740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ae9f8f2520 con 0x55ae9f991a50 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29ea08740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ae9f89a3e0 con 0x55ae9f9902c0 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29ea08740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55ae9f8ee4e0 con 0x55ae9f98da80 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29a133640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f98a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29a133640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f98a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49312/0 (socket says 172.21.15.42:49312) 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29a133640 1 -- 172.21.15.42:0/1094162839 learned_addr learned my addr 172.21.15.42:0/1094162839 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd299932640 1 --2- 172.21.15.42:0/1094162839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f9902c0 0x55ae9f9d5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd299131640 1 --2- 172.21.15.42:0/1094162839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f98da80 0x55ae9f9906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29a133640 1 -- 172.21.15.42:0/1094162839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f98da80 msgr2=0x55ae9f9906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29a133640 1 --2- 172.21.15.42:0/1094162839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f98da80 0x55ae9f9906a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29a133640 1 -- 172.21.15.42:0/1094162839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f9902c0 msgr2=0x55ae9f9d5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29a133640 1 --2- 172.21.15.42:0/1094162839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f9902c0 0x55ae9f9d5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.853+0000 7fd29a133640 1 -- 172.21.15.42:0/1094162839 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9f8b52f0 con 0x55ae9f991a50 2024-09-16T01:56:06.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd29a133640 1 --2- 172.21.15.42:0/1094162839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f98a8b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00c430 tx=0x7fd28c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb87b8a728cede8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd2777fe640 1 -- 172.21.15.42:0/1094162839 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c003970 con 0x55ae9f991a50 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd2777fe640 1 -- 172.21.15.42:0/1094162839 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c003b10 con 0x55ae9f991a50 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd2777fe640 1 -- 172.21.15.42:0/1094162839 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c004020 con 0x55ae9f991a50 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd29ea08740 1 -- 172.21.15.42:0/1094162839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 msgr2=0x55ae9f98a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd29ea08740 1 --2- 172.21.15.42:0/1094162839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f98a8b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00c430 tx=0x7fd28c00c8f0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd29ea08740 1 -- 172.21.15.42:0/1094162839 shutdown_connections 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd29ea08740 1 --2- 172.21.15.42:0/1094162839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f98a8b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd29ea08740 1 --2- 172.21.15.42:0/1094162839 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f98da80 0x55ae9f9906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd29ea08740 1 --2- 172.21.15.42:0/1094162839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f9902c0 0x55ae9f9d5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd29ea08740 1 -- 172.21.15.42:0/1094162839 >> 172.21.15.42:0/1094162839 conn(0x55ae9f98ca80 msgr2=0x55ae9f9d4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd29ea08740 1 -- 172.21.15.42:0/1094162839 shutdown_connections 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.854+0000 7fd29ea08740 1 -- 172.21.15.42:0/1094162839 wait complete. 2024-09-16T01:56:06.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.855+0000 7fd29ea08740 1 -- start start 2024-09-16T01:56:06.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.855+0000 7fd29ea08740 1 Processor -- start 2024-09-16T01:56:06.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f9902c0 0x55ae9f9b9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f991a50 0x55ae9f9ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f98a9f0 0x55ae9f9b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd29ea08740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ae9f98bf20 con 0x55ae9f9902c0 2024-09-16T01:56:06.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd29ea08740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ae9f87b450 con 0x55ae9f98a9f0 2024-09-16T01:56:06.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd29ea08740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55ae9f9d6290 con 0x55ae9f991a50 2024-09-16T01:56:06.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd29ea08740 10 client.0 _ll_register_callbacks cb 0x55ae9f604ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:56:06.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd299932640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f9902c0 0x55ae9f9b9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd299932640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f9902c0 0x55ae9f9b9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49314/0 (socket says 172.21.15.42:49314) 2024-09-16T01:56:06.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd299932640 1 -- 172.21.15.42:0/493086528 learned_addr learned my addr 172.21.15.42:0/493086528 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:06.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd299932640 1 -- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f991a50 msgr2=0x55ae9f9ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd299932640 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f991a50 0x55ae9f9ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd29a133640 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f98a9f0 0x55ae9f9b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd299932640 1 -- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f98a9f0 msgr2=0x55ae9f9b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd299932640 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f98a9f0 0x55ae9f9b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.856+0000 7fd299932640 1 -- 172.21.15.42:0/493086528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae9f6052d0 con 0x55ae9f9902c0 2024-09-16T01:56:06.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd299932640 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f9902c0 0x55ae9f9b9560 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd2900167b0 tx=0x7fd290004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807955e83a0adc63 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd274ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd274ff9640 1 -- 172.21.15.42:0/493086528 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290026020 con 0x55ae9f9902c0 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd29ea08740 1 -- 172.21.15.42:0/493086528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd28c003b10 con 0x55ae9f9902c0 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd274ff9640 1 -- 172.21.15.42:0/493086528 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fd2900149b0 con 0x55ae9f9902c0 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd274ff9640 1 -- 172.21.15.42:0/493086528 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd29001c070 con 0x55ae9f9902c0 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd29ea08740 10 client.5430 fetch_fsmap learned FSMap version 23 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd29ea08740 1 -- 172.21.15.42:0/493086528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x55ae9f6cf6b0 con 0x55ae9f9902c0 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd274ff9640 1 -- 172.21.15.42:0/493086528 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c003b10 con 0x55ae9f9902c0 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd274ff9640 1 -- 172.21.15.42:0/493086528 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fd290033080 con 0x55ae9f9902c0 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd29ea08740 10 client.5430 fetch_fsmap finished waiting for FSMap version 23 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd29ea08740 10 client.5430 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd29ea08740 20 client.5430 populate_metadata read hostname 'smithi042' 2024-09-16T01:56:06.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd29ea08740 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:6834/19167184,v1:172.21.15.107:6836/19167184] conn(0x55ae9f989a30 0x55ae9f989e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd29ea08740 4 client.5430 mds_command: new command op to 34817 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.857+0000 7fd29ea08740 1 -- 172.21.15.42:0/493086528 --> [v2:172.21.15.107:6834/19167184,v1:172.21.15.107:6836/19167184] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae9f8ffc50 con 0x55ae9f989a30 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.858+0000 7fd299131640 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:6834/19167184,v1:172.21.15.107:6836/19167184] conn(0x55ae9f989a30 0x55ae9f989e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.858+0000 7fd299131640 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:6834/19167184,v1:172.21.15.107:6836/19167184] conn(0x55ae9f989a30 0x55ae9f989e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17cfc540b3ffa1de server_cookie=bcdc04a02dfa46cf in_seq=0 out_seq=0 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.858+0000 7fd274ff9640 10 client.5430 ms_handle_connect on v2:172.21.15.107:6834/19167184 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd274ff9640 1 -- 172.21.15.42:0/493086528 <== mds.0 v2:172.21.15.107:6834/19167184 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae9f8ffc50 con 0x55ae9f989a30 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd274ff9640 10 client.5430 handle_command_reply: tid=0 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 client.5430 shutdown 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 -- 172.21.15.42:0/493086528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f9902c0 msgr2=0x55ae9f9b9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f9902c0 0x55ae9f9b9560 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd2900167b0 tx=0x7fd290004730 comp rx=0 tx=0).stop 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 -- 172.21.15.42:0/493086528 shutdown_connections 2024-09-16T01:56:06.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:6834/19167184,v1:172.21.15.107:6836/19167184] conn(0x55ae9f989a30 0x55ae9f989e10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f98a9f0 0x55ae9f9b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd274ff9640 0 client.5430 ms_handle_reset on v2:172.21.15.107:6834/19167184 2024-09-16T01:56:06.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f991a50 0x55ae9f9ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 --2- 172.21.15.42:0/493086528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f9902c0 0x55ae9f9b9560 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 -- 172.21.15.42:0/493086528 >> 172.21.15.42:0/493086528 conn(0x55ae9f98da80 msgr2=0x55ae9f9d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:06.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 -- 172.21.15.42:0/493086528 shutdown_connections 2024-09-16T01:56:06.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 1 -- 172.21.15.42:0/493086528 wait complete. 2024-09-16T01:56:06.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.859+0000 7fd29ea08740 20 client.5430 trim_cache size 0 max 16384 2024-09-16T01:56:06.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.877+0000 7fd29ea08740 1 Processor -- start 2024-09-16T01:56:06.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.878+0000 7fd29ea08740 1 -- start start 2024-09-16T01:56:06.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.878+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f98a9f0 0x55ae9f98a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.878+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f9902c0 0x55ae9f9aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.878+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f9aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.878+0000 7fd29ea08740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd294200420 con 0x55ae9f991a50 2024-09-16T01:56:06.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.878+0000 7fd29ea08740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd2940cad60 con 0x55ae9f98a9f0 2024-09-16T01:56:06.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.878+0000 7fd29ea08740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd2940b5b20 con 0x55ae9f9902c0 2024-09-16T01:56:06.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.878+0000 7fd29a133640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f9aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.878+0000 7fd29a133640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f9aa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49324/0 (socket says 172.21.15.42:49324) 2024-09-16T01:56:06.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.878+0000 7fd29a133640 1 -- 172.21.15.42:0/2750917454 learned_addr learned my addr 172.21.15.42:0/2750917454 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:06.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.879+0000 7fd29a133640 1 -- 172.21.15.42:0/2750917454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f9902c0 msgr2=0x55ae9f9aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.879+0000 7fd29a133640 1 --2- 172.21.15.42:0/2750917454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f9902c0 0x55ae9f9aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.879+0000 7fd29a133640 1 -- 172.21.15.42:0/2750917454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f98a9f0 msgr2=0x55ae9f98a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.879+0000 7fd29a133640 1 --2- 172.21.15.42:0/2750917454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f98a9f0 0x55ae9f98a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.879+0000 7fd29a133640 1 -- 172.21.15.42:0/2750917454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9f9868b0 con 0x55ae9f991a50 2024-09-16T01:56:06.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.879+0000 7fd29a133640 1 --2- 172.21.15.42:0/2750917454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f9aa6e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00c930 tx=0x7fd28c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432f9f2dca39972a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:06.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.879+0000 7fd276ffd640 1 -- 172.21.15.42:0/2750917454 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c003970 con 0x55ae9f991a50 2024-09-16T01:56:06.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.879+0000 7fd276ffd640 1 -- 172.21.15.42:0/2750917454 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c026070 con 0x55ae9f991a50 2024-09-16T01:56:06.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.879+0000 7fd276ffd640 1 -- 172.21.15.42:0/2750917454 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c003d30 con 0x55ae9f991a50 2024-09-16T01:56:06.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 -- 172.21.15.42:0/2750917454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 msgr2=0x55ae9f9aa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 --2- 172.21.15.42:0/2750917454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f9aa6e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00c930 tx=0x7fd28c00e000 comp rx=0 tx=0).stop 2024-09-16T01:56:06.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 -- 172.21.15.42:0/2750917454 shutdown_connections 2024-09-16T01:56:06.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 --2- 172.21.15.42:0/2750917454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f991a50 0x55ae9f9aa6e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 --2- 172.21.15.42:0/2750917454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f9902c0 0x55ae9f9aa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 --2- 172.21.15.42:0/2750917454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f98a9f0 0x55ae9f98a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 -- 172.21.15.42:0/2750917454 >> 172.21.15.42:0/2750917454 conn(0x55ae9f98da80 msgr2=0x55ae9f9ba6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:06.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 -- 172.21.15.42:0/2750917454 shutdown_connections 2024-09-16T01:56:06.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 -- 172.21.15.42:0/2750917454 wait complete. 2024-09-16T01:56:06.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 -- start start 2024-09-16T01:56:06.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.880+0000 7fd29ea08740 1 Processor -- start 2024-09-16T01:56:06.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.881+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f98a9f0 0x55ae9f9f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.881+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f9902c0 0x55ae9fa3a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.881+0000 7fd29ea08740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f991a50 0x55ae9f9f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.881+0000 7fd29ea08740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ae9f9ab810 con 0x55ae9f98a9f0 2024-09-16T01:56:06.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.881+0000 7fd29ea08740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55ae9f9b9aa0 con 0x55ae9f991a50 2024-09-16T01:56:06.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.881+0000 7fd29ea08740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55ae9f98ae70 con 0x55ae9f9902c0 2024-09-16T01:56:06.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.881+0000 7fd29ea08740 10 client.0 _ll_register_callbacks cb 0x7fd290007790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:56:06.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.881+0000 7fd299932640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f98a9f0 0x55ae9f9f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.881+0000 7fd299932640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f98a9f0 0x55ae9f9f7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49340/0 (socket says 172.21.15.42:49340) 2024-09-16T01:56:06.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.881+0000 7fd299932640 1 -- 172.21.15.42:0/1921556623 learned_addr learned my addr 172.21.15.42:0/1921556623 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:06.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd299131640 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f9902c0 0x55ae9fa3a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd29a133640 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f991a50 0x55ae9f9f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd299932640 1 -- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f9902c0 msgr2=0x55ae9fa3a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd299932640 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f9902c0 0x55ae9fa3a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd299932640 1 -- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f991a50 msgr2=0x55ae9f9f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:06.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd299932640 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f991a50 0x55ae9f9f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd299932640 1 -- 172.21.15.42:0/1921556623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae9f9f8120 con 0x55ae9f98a9f0 2024-09-16T01:56:06.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd299932640 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f98a9f0 0x55ae9f9f7a80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd290007530 tx=0x7fd2900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc496ff8a189e95e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:06.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd274ff9640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-16T01:56:06.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd274ff9640 1 -- 172.21.15.42:0/1921556623 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290026070 con 0x55ae9f98a9f0 2024-09-16T01:56:06.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd274ff9640 1 -- 172.21.15.42:0/1921556623 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fd290014e00 con 0x55ae9f98a9f0 2024-09-16T01:56:06.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd29ea08740 1 -- 172.21.15.42:0/1921556623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd28c026070 con 0x55ae9f98a9f0 2024-09-16T01:56:06.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd274ff9640 1 -- 172.21.15.42:0/1921556623 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd290004030 con 0x55ae9f98a9f0 2024-09-16T01:56:06.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd29ea08740 10 client.5436 fetch_fsmap learned FSMap version 23 2024-09-16T01:56:06.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd29ea08740 1 -- 172.21.15.42:0/1921556623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x55ae9f9f51f0 con 0x55ae9f98a9f0 2024-09-16T01:56:06.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd274ff9640 1 -- 172.21.15.42:0/1921556623 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28c026070 con 0x55ae9f98a9f0 2024-09-16T01:56:06.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.882+0000 7fd274ff9640 1 -- 172.21.15.42:0/1921556623 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 23) ==== 3502+0+0 (secure 0 0 0) 0x7fd2900041d0 con 0x55ae9f98a9f0 2024-09-16T01:56:06.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd29ea08740 10 client.5436 fetch_fsmap finished waiting for FSMap version 23 2024-09-16T01:56:06.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd29ea08740 10 client.5436 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:56:06.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd29ea08740 20 client.5436 populate_metadata read hostname 'smithi042' 2024-09-16T01:56:06.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd29ea08740 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:6834/19167184,v1:172.21.15.107:6836/19167184] conn(0x55ae9f9aea80 0x55ae9f9f4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:06.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd29ea08740 4 client.5436 mds_command: new command op to 34817 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:56:06.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd29ea08740 1 -- 172.21.15.42:0/1921556623 --> [v2:172.21.15.107:6834/19167184,v1:172.21.15.107:6836/19167184] -- command(tid 0: {"prefix": "status"}) -- 0x55ae9f8f9fa0 con 0x55ae9f9aea80 2024-09-16T01:56:06.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd299131640 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:6834/19167184,v1:172.21.15.107:6836/19167184] conn(0x55ae9f9aea80 0x55ae9f9f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:06.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd299131640 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:6834/19167184,v1:172.21.15.107:6836/19167184] conn(0x55ae9f9aea80 0x55ae9f9f4170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b1f0a2ff9314869 server_cookie=f9e9fa7bf8d3ae54 in_seq=0 out_seq=0 2024-09-16T01:56:06.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd274ff9640 10 client.5436 ms_handle_connect on v2:172.21.15.107:6834/19167184 2024-09-16T01:56:06.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd274ff9640 1 -- 172.21.15.42:0/1921556623 <== mds.0 v2:172.21.15.107:6834/19167184 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ae9f8f9fa0 con 0x55ae9f9aea80 2024-09-16T01:56:06.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd274ff9640 10 client.5436 handle_command_reply: tid=0 2024-09-16T01:56:06.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.883+0000 7fd29ea08740 1 client.5436 shutdown 2024-09-16T01:56:06.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 1 -- 172.21.15.42:0/1921556623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f98a9f0 msgr2=0x55ae9f9f7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f98a9f0 0x55ae9f9f7a80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd290007530 tx=0x7fd2900046c0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 1 -- 172.21.15.42:0/1921556623 shutdown_connections 2024-09-16T01:56:06.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:6834/19167184,v1:172.21.15.107:6836/19167184] conn(0x55ae9f9aea80 0x55ae9f9f4170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ae9f991a50 0x55ae9f9f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55ae9f9902c0 0x55ae9fa3a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 1 --2- 172.21.15.42:0/1921556623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ae9f98a9f0 0x55ae9f9f7a80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd274ff9640 0 client.5436 ms_handle_reset on v2:172.21.15.107:6834/19167184 2024-09-16T01:56:06.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 1 -- 172.21.15.42:0/1921556623 >> 172.21.15.42:0/1921556623 conn(0x55ae9f98da80 msgr2=0x55ae9f98a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:06.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 1 -- 172.21.15.42:0/1921556623 shutdown_connections 2024-09-16T01:56:06.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 1 -- 172.21.15.42:0/1921556623 wait complete. 2024-09-16T01:56:06.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29ea08740 20 client.5436 trim_cache size 0 max 16384 2024-09-16T01:56:06.903 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:56:06.903 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "356ce71f-2ad9-4fe3-af21-266c510b09c8", 2024-09-16T01:56:06.903 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-16T01:56:06.904 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 34817, 2024-09-16T01:56:06.904 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-16T01:56:06.904 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-16T01:56:06.904 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-16T01:56:06.904 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 9.2264261810000008, 2024-09-16T01:56:06.905 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 23, 2024-09-16T01:56:06.905 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 50, 2024-09-16T01:56:06.905 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 50, 2024-09-16T01:56:06.905 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 20.260901691000001 2024-09-16T01:56:06.905 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:56:06.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 -- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd27806c2b0 msgr2=0x7fd27806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd27806c2b0 0x7fd27806e770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd290006fd0 tx=0x7fd290008040 comp rx=0 tx=0).stop 2024-09-16T01:56:06.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 -- 172.21.15.42:0/1245359358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 msgr2=0x7fd29415aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:06.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 0x7fd29415aa40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd284000c00 tx=0x7fd2840046c0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 -- 172.21.15.42:0/1245359358 shutdown_connections 2024-09-16T01:56:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd27806c2b0 0x7fd27806e770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd29415e740 0x7fd29415af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd29409b690 0x7fd29415aa40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 --2- 172.21.15.42:0/1245359358 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd29406d4c0 0x7fd2941521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 -- 172.21.15.42:0/1245359358 >> 172.21.15.42:0/1245359358 conn(0x7fd2940d23a0 msgr2=0x7fd29406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.884+0000 7fd29bb96640 1 -- 172.21.15.42:0/1245359358 shutdown_connections 2024-09-16T01:56:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:06.885+0000 7fd29bb96640 1 -- 172.21.15.42:0/1245359358 wait complete. 2024-09-16T01:56:06.908 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:56:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.010+0000 7f18ca0f1640 1 Processor -- start 2024-09-16T01:56:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.010+0000 7f18ca0f1640 1 -- start start 2024-09-16T01:56:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18ca0f1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18c4072320 0x7f18c40cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18ca0f1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4072de0 0x7f18c406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18ca0f1640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c4146140 con 0x7f18c4072700 2024-09-16T01:56:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18ca0f1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f18c40cd740 con 0x7f18c4072320 2024-09-16T01:56:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18ca0f1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f18c40cda20 con 0x7f18c4072de0 2024-09-16T01:56:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c3fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f18c4072700 0x7f18c406e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52804/0 (socket says 172.21.15.42:52804) 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c3fff640 1 -- 172.21.15.42:0/1450441186 learned_addr learned my addr 172.21.15.42:0/1450441186 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c2ffd640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4072de0 0x7f18c406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c37fe640 1 --2- 172.21.15.42:0/1450441186 >> v2:172.21.15.107:3300/0 conn(0x7f18c4072320 0x7f18c40cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3441716987 0 0) 0x7f18c4146140 con 0x7f18c4072700 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18ac003520 con 0x7f18c4072700 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2001132684 0 0) 0x7f18ac003520 con 0x7f18c4072700 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4072de0 msgr2=0x7f18c406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4072de0 0x7f18c406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 >> v2:172.21.15.107:3300/0 conn(0x7f18c4072320 msgr2=0x7f18c40cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 --2- 172.21.15.42:0/1450441186 >> v2:172.21.15.107:3300/0 conn(0x7f18c4072320 0x7f18c40cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c40cdd00 con 0x7f18c4072700 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f18bc0019f0 con 0x7f18c4072700 2024-09-16T01:56:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c37fe640 1 --2- 172.21.15.42:0/1450441186 >> v2:172.21.15.107:3300/0 conn(0x7f18c4072320 0x7f18c40cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c2ffd640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4072de0 0x7f18c406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 >> v1:172.21.15.42:6789/0 conn(0x7f18c4072700 legacy=0x7f18c406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18ac0039b0 0x7f18ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4072de0 0x7f18ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ac004d40 0x7f18ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f18c40cd740 con 0x7f18ac0039b0 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f18c40cda20 con 0x7f18ac004d40 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f18ac00b9c0 con 0x7f18c4072de0 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.011+0000 7f18c37fe640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18ac0039b0 0x7f18ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.012+0000 7f18c2ffd640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4072de0 0x7f18ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.012+0000 7f18c3fff640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ac004d40 0x7f18ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.012+0000 7f18c37fe640 1 -- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4072de0 msgr2=0x7f18ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.012+0000 7f18c37fe640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4072de0 0x7f18ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.012+0000 7f18c37fe640 1 -- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ac004d40 msgr2=0x7f18ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.012+0000 7f18c37fe640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ac004d40 0x7f18ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.012+0000 7f18c37fe640 1 -- 172.21.15.42:0/1450441186 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ac003520 con 0x7f18ac0039b0 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.012+0000 7f18c2ffd640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4072de0 0x7f18ac004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.012+0000 7f18c3fff640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ac004d40 0x7f18ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.012+0000 7f18c37fe640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18ac0039b0 0x7f18ac003dd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009c90 tx=0x7f18ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b88c11b3059a4d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.013+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4036070 con 0x7f18ac0039b0 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.013+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b4031400 con 0x7f18ac0039b0 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.013+0000 7f18c27fc640 1 -- 172.21.15.42:0/1450441186 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4009860 con 0x7f18ac0039b0 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.013+0000 7f18ca0f1640 1 -- 172.21.15.42:0/1450441186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18ac0039b0 msgr2=0x7f18ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.013+0000 7f18ca0f1640 1 --2- 172.21.15.42:0/1450441186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18ac0039b0 0x7f18ac003dd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009c90 tx=0x7f18ac005830 comp rx=0 tx=0).stop 2024-09-16T01:56:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.013+0000 7f18c3fff640 1 -- 172.21.15.42:0/1450441186 reap_dead start 2024-09-16T01:56:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.013+0000 7f18ca0f1640 1 -- 172.21.15.42:0/1450441186 shutdown_connections 2024-09-16T01:56:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.013+0000 7f18ca0f1640 1 -- 172.21.15.42:0/1450441186 >> 172.21.15.42:0/1450441186 conn(0x7f18c4067d70 msgr2=0x7f18c406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.013+0000 7f18ca0f1640 1 -- 172.21.15.42:0/1450441186 shutdown_connections 2024-09-16T01:56:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.013+0000 7f18ca0f1640 1 -- 172.21.15.42:0/1450441186 wait complete. 2024-09-16T01:56:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.014+0000 7f18ca0f1640 1 Processor -- start 2024-09-16T01:56:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.015+0000 7f18ca0f1640 1 -- start start 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.015+0000 7f18ca0f1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ac0039b0 0x7f18c4141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.015+0000 7f18ca0f1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4144910 0x7f18c4144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.015+0000 7f18ca0f1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c41454c0 0x7f18c40b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.015+0000 7f18ca0f1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f18c40cd520 con 0x7f18c41454c0 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.015+0000 7f18ca0f1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f18c40cd3a0 con 0x7f18ac0039b0 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.015+0000 7f18ca0f1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f18c406ed00 con 0x7f18c4144910 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.015+0000 7f18c3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c41454c0 0x7f18c40b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.015+0000 7f18c3fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c41454c0 0x7f18c40b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49358/0 (socket says 172.21.15.42:49358) 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.015+0000 7f18c3fff640 1 -- 172.21.15.42:0/2493798623 learned_addr learned my addr 172.21.15.42:0/2493798623 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18c2ffd640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4144910 0x7f18c4144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18c37fe640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ac0039b0 0x7f18c4141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18c3fff640 1 -- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4144910 msgr2=0x7f18c4144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18c3fff640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4144910 0x7f18c4144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18c3fff640 1 -- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ac0039b0 msgr2=0x7f18c4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18c3fff640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ac0039b0 0x7f18c4141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18c3fff640 1 -- 172.21.15.42:0/2493798623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c41438b0 con 0x7f18c41454c0 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18c3fff640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c41454c0 0x7f18c40b43e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f18c40731c0 tx=0x7f18bc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18abfff640 1 -- 172.21.15.42:0/2493798623 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc00eda0 con 0x7f18c41454c0 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18abfff640 1 -- 172.21.15.42:0/2493798623 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18bc018070 con 0x7f18c41454c0 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18ca0f1640 1 -- 172.21.15.42:0/2493798623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c4143b50 con 0x7f18c41454c0 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18abfff640 1 -- 172.21.15.42:0/2493798623 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc013620 con 0x7f18c41454c0 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.016+0000 7f18ca0f1640 1 -- 172.21.15.42:0/2493798623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c4144110 con 0x7f18c41454c0 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.017+0000 7f18ca0f1640 1 -- 172.21.15.42:0/2493798623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c40cce60 con 0x7f18c41454c0 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.018+0000 7f18abfff640 1 -- 172.21.15.42:0/2493798623 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f18bc0137c0 con 0x7f18c41454c0 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.018+0000 7f18abfff640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f18b006c2e0 0x7f18b006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:07.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.018+0000 7f18abfff640 1 -- 172.21.15.42:0/2493798623 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f18bc08b950 con 0x7f18c41454c0 2024-09-16T01:56:07.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.018+0000 7f18c37fe640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f18b006c2e0 0x7f18b006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:07.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.019+0000 7f18c37fe640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f18b006c2e0 0x7f18b006e7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18b4033000 tx=0x7f18b4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:07.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.023+0000 7f18abfff640 1 -- 172.21.15.42:0/2493798623 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18bc059f30 con 0x7f18c41454c0 2024-09-16T01:56:07.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.236+0000 7f18ca0f1640 1 -- 172.21.15.42:0/2493798623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f18c41e42a0 con 0x7f18c41454c0 2024-09-16T01:56:07.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.236+0000 7f18abfff640 1 -- 172.21.15.42:0/2493798623 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7f18bc059830 con 0x7f18c41454c0 2024-09-16T01:56:07.238 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:56:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.238+0000 7f18ca0f1640 1 -- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f18b006c2e0 msgr2=0x7f18b006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.238+0000 7f18ca0f1640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f18b006c2e0 0x7f18b006e7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18b4033000 tx=0x7f18b4008030 comp rx=0 tx=0).stop 2024-09-16T01:56:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.238+0000 7f18ca0f1640 1 -- 172.21.15.42:0/2493798623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c41454c0 msgr2=0x7f18c40b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.238+0000 7f18ca0f1640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c41454c0 0x7f18c40b43e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f18c40731c0 tx=0x7f18bc00e530 comp rx=0 tx=0).stop 2024-09-16T01:56:07.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.238+0000 7f18ca0f1640 1 -- 172.21.15.42:0/2493798623 shutdown_connections 2024-09-16T01:56:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.238+0000 7f18ca0f1640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f18b006c2e0 0x7f18b006e7a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.238+0000 7f18ca0f1640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18c41454c0 0x7f18c40b43e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.238+0000 7f18ca0f1640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f18c4144910 0x7f18c4144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.238+0000 7f18ca0f1640 1 --2- 172.21.15.42:0/2493798623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18ac0039b0 0x7f18c4141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.238+0000 7f18ca0f1640 1 -- 172.21.15.42:0/2493798623 >> 172.21.15.42:0/2493798623 conn(0x7f18c4067d70 msgr2=0x7f18c41e4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.239+0000 7f18ca0f1640 1 -- 172.21.15.42:0/2493798623 shutdown_connections 2024-09-16T01:56:07.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07.239+0000 7f18ca0f1640 1 -- 172.21.15.42:0/2493798623 wait complete. 2024-09-16T01:56:07.251 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:56:07.251 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:56:07.252 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-16T01:56:07.252 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:56:07.252 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:56:07.252 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:56:07.252 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:56:07.253 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:56:07.253 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:56:07.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:07.253 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-16T01:56:07.273 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:56:07.273 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:56:07.273 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:56:07.273 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:56:07.273 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-16T01:56:07.273 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:56:07.274 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:56:07.274 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-16T01:56:07.274 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-16T01:56:07.274 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:56:07.274 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-16T01:56:07.274 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-16T01:56:07.274 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:56:07.274 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:56:07.274 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-16T01:56:07.275 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-16T01:56:07.275 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42687sec preferred_lft 42687sec 2024-09-16T01:56:07.275 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-16T01:56:07.275 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:56:07.275 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:56:07.275 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:56:07.275 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 5e:ba:0a:2b:0d:4d brd ff:ff:ff:ff:ff:ff 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::9414:18ff:fe6a:9503/64 scope link 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 5e:ba:0a:2b:0d:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::5cba:aff:fe2b:d4d/64 scope link 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 72:25:74:79:3d:69 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:56:07.276 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::7025:74ff:fe79:3d69/64 scope link 2024-09-16T01:56:07.277 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:56:07.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:07.277 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:56:07.338 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-16T01:56:07.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:07.339 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-16T01:56:07.396 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-16T01:56:07.396 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:56:07.396 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-16T01:56:07.396 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-16T01:56:07.396 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:56:07.397 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:56:07.397 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-16T01:56:07.397 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-16T01:56:07.397 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-16T01:56:07.397 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-16T01:56:07.397 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-16T01:56:07.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:56:07.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:56:07.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:07.525 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-16T01:56:07.541 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:56:07.541 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:56:07.542 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:56:07.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:07.542 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-16T01:56:07.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:56:07.607 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:56:07.663 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:56:07.663 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:56:07.664 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:56:07.719 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:56:07.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:07.719 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:56:07.803 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:56:07.804 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:56:07.804 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:56:07.813 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:56:07.813 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:56:07.813 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:56:07.813 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:56:07.813 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:56:07.818 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:56:07.818 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:56:07.818 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-16T01:56:07.818 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.107:3300,172.21.15.107:3301" 2024-09-16T01:56:07.818 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:56:07.818 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790" 2024-09-16T01:56:07.819 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.107:6789,172.21.15.107:6790:/ 2024-09-16T01:56:07.819 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=356ce71f-2ad9-4fe3-af21-266c510b09c8" will pass to kernel 2024-09-16T01:56:07.819 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:56:07.819 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:56:07.819 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:56:07.819 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:56:07.819 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:56:07.821 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:56:07.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:07.821 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:56:07.888 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:56:07.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:56:07.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:56:07.993 INFO:teuthology.orchestra.run.smithi042.stdout:client5445 2024-09-16T01:56:07.994 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:56:07.994 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:56:08.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:08.011 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-09-16T01:56:08.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:08.073 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-09-16T01:56:08.131 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-16T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-16T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-16T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-16T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-09-16T01:56:08.132 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-16T01:56:08.240 INFO:teuthology.orchestra.run.smithi042.stdout:1099511627777 2024-09-16T01:56:08.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:56:08.248 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:56:08.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.389+0000 7f7981a5e640 1 Processor -- start 2024-09-16T01:56:08.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.389+0000 7f7981a5e640 1 -- start start 2024-09-16T01:56:08.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.390+0000 7f7981a5e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f797c072d30 0x7f797c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.390+0000 7f7981a5e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f797c06fae0 con 0x7f797c15b300 2024-09-16T01:56:08.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.390+0000 7f7981a5e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f797c0cdbe0 con 0x7f797c06f700 2024-09-16T01:56:08.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.390+0000 7f7981a5e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f797c0728a0 con 0x7f797c072d30 2024-09-16T01:56:08.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.390+0000 7f797a7fc640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f797c072d30 0x7f797c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.390+0000 7f797a7fc640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f797c072d30 0x7f797c06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47508/0 (socket says 172.21.15.42:47508) 2024-09-16T01:56:08.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.390+0000 7f797a7fc640 1 -- 172.21.15.42:0/2351175556 learned_addr learned my addr 172.21.15.42:0/2351175556 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:08.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.390+0000 7f797a7fc640 1 -- 172.21.15.42:0/2351175556 >> v1:172.21.15.107:6789/0 conn(0x7f797c06f700 legacy=0x7f797c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:08.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.390+0000 7f797a7fc640 1 -- 172.21.15.42:0/2351175556 >> v1:172.21.15.42:6789/0 conn(0x7f797c15b300 legacy=0x7f797c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.391+0000 7f7979ffb640 1 -- 172.21.15.42:0/2351175556 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3447732946 0 0) 0x7f797c06fae0 con 0x7f797c15b300 2024-09-16T01:56:08.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.391+0000 7f797a7fc640 1 -- 172.21.15.42:0/2351175556 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c0cd900 con 0x7f797c072d30 2024-09-16T01:56:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.391+0000 7f797a7fc640 1 --2- 172.21.15.42:0/2351175556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 0x7f797c06f1c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f796400bb10 tx=0x7f796402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407fda7011bdbd22 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:08.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.391+0000 7f7979ffb640 1 -- 172.21.15.42:0/2351175556 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964032790 con 0x7f797c072d30 2024-09-16T01:56:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.391+0000 7f7979ffb640 1 -- 172.21.15.42:0/2351175556 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7964038070 con 0x7f797c072d30 2024-09-16T01:56:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.391+0000 7f7979ffb640 1 -- 172.21.15.42:0/2351175556 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964032b50 con 0x7f797c072d30 2024-09-16T01:56:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.392+0000 7f7981a5e640 1 -- 172.21.15.42:0/2351175556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 msgr2=0x7f797c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.392+0000 7f7981a5e640 1 --2- 172.21.15.42:0/2351175556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 0x7f797c06f1c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f796400bb10 tx=0x7f796402c8d0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.392+0000 7f7981a5e640 1 -- 172.21.15.42:0/2351175556 shutdown_connections 2024-09-16T01:56:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.392+0000 7f7981a5e640 1 --2- 172.21.15.42:0/2351175556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 0x7f797c06f1c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.392+0000 7f7981a5e640 1 -- 172.21.15.42:0/2351175556 >> 172.21.15.42:0/2351175556 conn(0x7f797c067d70 msgr2=0x7f797c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.392+0000 7f7981a5e640 1 -- 172.21.15.42:0/2351175556 shutdown_connections 2024-09-16T01:56:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.392+0000 7f7981a5e640 1 -- 172.21.15.42:0/2351175556 wait complete. 2024-09-16T01:56:08.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.393+0000 7f7981a5e640 1 Processor -- start 2024-09-16T01:56:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.393+0000 7f7981a5e640 1 -- start start 2024-09-16T01:56:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f7981a5e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f797c06f700 0x7f797c156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f7981a5e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 0x7f797c1f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f7981a5e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f797c15b300 0x7f797c14f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f7981a5e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f797c0cd5c0 con 0x7f797c072d30 2024-09-16T01:56:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f7981a5e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f797c072530 con 0x7f797c15b300 2024-09-16T01:56:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f7981a5e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f797c0cffe0 con 0x7f797c06f700 2024-09-16T01:56:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f797a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 0x7f797c1f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f797a7fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 0x7f797c1f4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47514/0 (socket says 172.21.15.42:47514) 2024-09-16T01:56:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f797a7fc640 1 -- 172.21.15.42:0/4235725023 learned_addr learned my addr 172.21.15.42:0/4235725023 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f797b7fe640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f797c15b300 0x7f797c14f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.394+0000 7f797affd640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f797c06f700 0x7f797c156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f797a7fc640 1 -- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f797c06f700 msgr2=0x7f797c156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f797a7fc640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f797c06f700 0x7f797c156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f797a7fc640 1 -- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f797c15b300 msgr2=0x7f797c14f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f797a7fc640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f797c15b300 0x7f797c14f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f797a7fc640 1 -- 172.21.15.42:0/4235725023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c1f45a0 con 0x7f797c072d30 2024-09-16T01:56:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f797b7fe640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f797c15b300 0x7f797c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f797a7fc640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 0x7f797c1f4060 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f796400bb10 tx=0x7f79640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f7973fff640 1 -- 172.21.15.42:0/4235725023 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964004030 con 0x7f797c072d30 2024-09-16T01:56:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f7973fff640 1 -- 172.21.15.42:0/4235725023 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79640041d0 con 0x7f797c072d30 2024-09-16T01:56:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f7981a5e640 1 -- 172.21.15.42:0/4235725023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797c155880 con 0x7f797c072d30 2024-09-16T01:56:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f7973fff640 1 -- 172.21.15.42:0/4235725023 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964003610 con 0x7f797c072d30 2024-09-16T01:56:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.395+0000 7f7981a5e640 1 -- 172.21.15.42:0/4235725023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797c155e40 con 0x7f797c072d30 2024-09-16T01:56:08.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.396+0000 7f7981a5e640 1 -- 172.21.15.42:0/4235725023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f797c158ec0 con 0x7f797c072d30 2024-09-16T01:56:08.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.396+0000 7f7973fff640 1 -- 172.21.15.42:0/4235725023 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f796404d060 con 0x7f797c072d30 2024-09-16T01:56:08.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.397+0000 7f7973fff640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f795c06c2b0 0x7f795c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.397+0000 7f7973fff640 1 -- 172.21.15.42:0/4235725023 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f79640ae040 con 0x7f797c072d30 2024-09-16T01:56:08.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.397+0000 7f797affd640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f795c06c2b0 0x7f795c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.398+0000 7f797affd640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f795c06c2b0 0x7f795c06e770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f796c007fd0 tx=0x7f796c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:08.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.401+0000 7f7973fff640 1 -- 172.21.15.42:0/4235725023 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7964041070 con 0x7f797c072d30 2024-09-16T01:56:08.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.611+0000 7f7981a5e640 1 -- 172.21.15.42:0/4235725023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f797c158be0 con 0x7f797c072d30 2024-09-16T01:56:08.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.612+0000 7f7973fff640 1 -- 172.21.15.42:0/4235725023 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5225 (secure 0 0 0) 0x7f796407c620 con 0x7f797c072d30 2024-09-16T01:56:08.613 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:08.614 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-09-16T01:55:59:851792+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3210303754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3210303754},{"type":"v1","addr":"172.21.15.42:6833","nonce":3210303754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/628179225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":628179225},{"type":"v1","addr":"172.21.15.107:6837","nonce":628179225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3586378815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3586378815},{"type":"v1","addr":"172.21.15.42:6835","nonce":3586378815}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:57.021180+0000","modified":"2024-09-16T01:55:59.200652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34817":{"gid":34817,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6836/19167184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":19167184},{"type":"v1","addr":"172.21.15.107:6836","nonce":19167184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34817,"qdb_cluster":[34817]},"id":3}]} 2024-09-16T01:56:08.614 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-09-16T01:56:08.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 -- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f795c06c2b0 msgr2=0x7f795c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f795c06c2b0 0x7f795c06e770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f796c007fd0 tx=0x7f796c009040 comp rx=0 tx=0).stop 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 -- 172.21.15.42:0/4235725023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 msgr2=0x7f797c1f4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 0x7f797c1f4060 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f796400bb10 tx=0x7f79640046c0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 -- 172.21.15.42:0/4235725023 shutdown_connections 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f795c06c2b0 0x7f795c06e770 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f797c15b300 0x7f797c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f797c072d30 0x7f797c1f4060 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 --2- 172.21.15.42:0/4235725023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f797c06f700 0x7f797c156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 -- 172.21.15.42:0/4235725023 >> 172.21.15.42:0/4235725023 conn(0x7f797c067d70 msgr2=0x7f797c15d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 -- 172.21.15.42:0/4235725023 shutdown_connections 2024-09-16T01:56:08.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.614+0000 7f7981a5e640 1 -- 172.21.15.42:0/4235725023 wait complete. 2024-09-16T01:56:08.627 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-16T01:56:08.760 INFO:teuthology.orchestra.run.smithi107.stdout:{"message":"","return_code":0} 2024-09-16T01:56:08.760 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-16T01:56:08.761 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-16T01:56:08.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.805+0000 7f217b598f40 1 Processor -- start 2024-09-16T01:56:08.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.805+0000 7f217b598f40 1 -- start start 2024-09-16T01:56:08.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217b598f40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21680022a0 0x555728b5b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217b598f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728a96780 0x555728b63cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217b598f40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555728b5b6e0 0x555728b64210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217b598f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555728abf100 con 0x555728a96780 2024-09-16T01:56:08.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217b598f40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5557289e6510 con 0x555728b5b6e0 2024-09-16T01:56:08.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217b598f40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x555728ac2720 con 0x7f21680022a0 2024-09-16T01:56:08.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217888f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728a96780 0x555728b63cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217888f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728a96780 0x555728b63cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47540/0 (socket says 172.21.15.42:47540) 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217888f640 1 -- 172.21.15.42:0/3119816535 learned_addr learned my addr 172.21.15.42:0/3119816535 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f2179891640 1 --2- 172.21.15.42:0/3119816535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555728b5b6e0 0x555728b64210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f2179090640 1 --2- 172.21.15.42:0/3119816535 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21680022a0 0x555728b5b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217888f640 1 -- 172.21.15.42:0/3119816535 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21680022a0 msgr2=0x555728b5b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217888f640 1 --2- 172.21.15.42:0/3119816535 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21680022a0 0x555728b5b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217888f640 1 -- 172.21.15.42:0/3119816535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555728b5b6e0 msgr2=0x555728b64210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217888f640 1 --2- 172.21.15.42:0/3119816535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555728b5b6e0 0x555728b64210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217888f640 1 -- 172.21.15.42:0/3119816535 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555728ac0e90 con 0x555728a96780 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f2179891640 1 --2- 172.21.15.42:0/3119816535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555728b5b6e0 0x555728b64210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f217888f640 1 --2- 172.21.15.42:0/3119816535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728a96780 0x555728b63cd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2164000fb0 tx=0x7f2164009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20361930fe87bddb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f21737fe640 1 -- 172.21.15.42:0/3119816535 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216400e930 con 0x555728a96780 2024-09-16T01:56:08.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f21737fe640 1 -- 172.21.15.42:0/3119816535 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2164013030 con 0x555728a96780 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.806+0000 7f21737fe640 1 -- 172.21.15.42:0/3119816535 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216400ed10 con 0x555728a96780 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.807+0000 7f217b598f40 1 -- 172.21.15.42:0/3119816535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728a96780 msgr2=0x555728b63cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.807+0000 7f217b598f40 1 --2- 172.21.15.42:0/3119816535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728a96780 0x555728b63cd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2164000fb0 tx=0x7f2164009b70 comp rx=0 tx=0).stop 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.807+0000 7f217b598f40 1 -- 172.21.15.42:0/3119816535 shutdown_connections 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.807+0000 7f217b598f40 1 --2- 172.21.15.42:0/3119816535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555728b5b6e0 0x555728b64210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.807+0000 7f217b598f40 1 --2- 172.21.15.42:0/3119816535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728a96780 0x555728b63cd0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.807+0000 7f217b598f40 1 --2- 172.21.15.42:0/3119816535 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21680022a0 0x555728b5b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.807+0000 7f217b598f40 1 -- 172.21.15.42:0/3119816535 >> 172.21.15.42:0/3119816535 conn(0x555728a961d0 msgr2=0x555728addfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.807+0000 7f217b598f40 1 -- 172.21.15.42:0/3119816535 shutdown_connections 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.807+0000 7f217b598f40 1 -- 172.21.15.42:0/3119816535 wait complete. 2024-09-16T01:56:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.807+0000 7f217b598f40 1 Processor -- start 2024-09-16T01:56:08.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f217b598f40 1 -- start start 2024-09-16T01:56:08.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f217b598f40 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x555728a96780 0x555728b66cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f217b598f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728b5b6e0 0x555728abf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f217b598f40 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21680022a0 0x555728abf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f217b598f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555728b6bfc0 con 0x555728b5b6e0 2024-09-16T01:56:08.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f217b598f40 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555728ac5460 con 0x7f21680022a0 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f217b598f40 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x555728b6c2a0 con 0x555728a96780 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f217888f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728b5b6e0 0x555728abf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f217888f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728b5b6e0 0x555728abf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47550/0 (socket says 172.21.15.42:47550) 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f217888f640 1 -- 172.21.15.42:0/974285838 learned_addr learned my addr 172.21.15.42:0/974285838 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f2179090640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x555728a96780 0x555728b66cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.808+0000 7f2179891640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21680022a0 0x555728abf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f217888f640 1 -- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x555728a96780 msgr2=0x555728b66cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f217888f640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x555728a96780 0x555728b66cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f217888f640 1 -- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21680022a0 msgr2=0x555728abf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f217888f640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21680022a0 0x555728abf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f217888f640 1 -- 172.21.15.42:0/974285838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555728bfd8d0 con 0x555728b5b6e0 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f2179891640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21680022a0 0x555728abf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:56:08.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f217888f640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728b5b6e0 0x555728abf280 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2164000c00 tx=0x7f2164001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f21727fc640 1 -- 172.21.15.42:0/974285838 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216401d030 con 0x555728b5b6e0 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f21727fc640 1 -- 172.21.15.42:0/974285838 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f216400f450 con 0x555728b5b6e0 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f217b598f40 1 -- 172.21.15.42:0/974285838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555728bfdbb0 con 0x555728b5b6e0 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f21727fc640 1 -- 172.21.15.42:0/974285838 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216400f820 con 0x555728b5b6e0 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.809+0000 7f217b598f40 1 -- 172.21.15.42:0/974285838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555728bfad60 con 0x555728b5b6e0 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.810+0000 7f21727fc640 1 -- 172.21.15.42:0/974285838 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2164024030 con 0x555728b5b6e0 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.811+0000 7f21727fc640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f215c06ac90 0x7f215c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.811+0000 7f21727fc640 1 -- 172.21.15.42:0/974285838 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f216408bfe0 con 0x555728b5b6e0 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.811+0000 7f217b598f40 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x555728bfba70 0x555728b59a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.811+0000 7f2179090640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f215c06ac90 0x7f215c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.811+0000 7f217b598f40 1 -- 172.21.15.42:0/974285838 --> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x555728b67200 con 0x555728bfba70 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.811+0000 7f2179891640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x555728bfba70 0x555728b59a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:08.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f2179891640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x555728bfba70 0x555728b59a70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:08.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f2179090640 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f215c06ac90 0x7f215c06d150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f216c058000 tx=0x7f216c053000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:08.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f2179891640 1 -- 172.21.15.42:0/974285838 <== osd.1 v2:172.21.15.42:6824/2370128537 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f21740097d0 con 0x555728bfba70 2024-09-16T01:56:08.817 INFO:teuthology.orchestra.run.smithi042.stdout:Yalphaparent_a 2024-09-16T01:56:08.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f217b598f40 1 -- 172.21.15.42:0/974285838 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x555728bfba70 msgr2=0x555728b59a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f217b598f40 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x555728bfba70 0x555728b59a70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:08.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f217b598f40 1 -- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f215c06ac90 msgr2=0x7f215c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f217b598f40 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f215c06ac90 0x7f215c06d150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f216c058000 tx=0x7f216c053000 comp rx=0 tx=0).stop 2024-09-16T01:56:08.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f217b598f40 1 -- 172.21.15.42:0/974285838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728b5b6e0 msgr2=0x555728abf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:08.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f217b598f40 1 --2- 172.21.15.42:0/974285838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555728b5b6e0 0x555728abf280 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2164000c00 tx=0x7f2164001a40 comp rx=0 tx=0).stop 2024-09-16T01:56:08.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f2179891640 1 -- 172.21.15.42:0/974285838 reap_dead start 2024-09-16T01:56:08.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f217b598f40 1 -- 172.21.15.42:0/974285838 shutdown_connections 2024-09-16T01:56:08.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f217b598f40 1 -- 172.21.15.42:0/974285838 >> 172.21.15.42:0/974285838 conn(0x555728a961d0 msgr2=0x555728add780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:08.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f217b598f40 1 -- 172.21.15.42:0/974285838 shutdown_connections 2024-09-16T01:56:08.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:08.812+0000 7f217b598f40 1 -- 172.21.15.42:0/974285838 wait complete. 2024-09-16T01:56:08.820 DEBUG:teuthology.orchestra.run.smithi042:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-16T01:56:08.925 INFO:teuthology.orchestra.run.smithi042.stderr:error: stray data at end of buffer, offset 95 2024-09-16T01:56:08.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:56:08.934 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:56:08.934 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:56:08.978 DEBUG:teuthology.orchestra.run.smithi107:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:56:09.013 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:56:09.014 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:56:09.014 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:56:09.014 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:56:09.034 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:56:09.034 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:56:09.091 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:56:09.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.233+0000 7f5ac33b9640 1 Processor -- start 2024-09-16T01:56:09.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.233+0000 7f5ac33b9640 1 -- start start 2024-09-16T01:56:09.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ac33b9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5abc15e740 0x7f5abc0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ac33b9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc06e040 con 0x7f5abc06dbd0 2024-09-16T01:56:09.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ac33b9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc0d0780 con 0x7f5abc09b690 2024-09-16T01:56:09.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ac33b9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5abc15eb20 con 0x7f5abc15e740 2024-09-16T01:56:09.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ac1956640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5abc06dbd0 0x7f5abc070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54298/0 (socket says 172.21.15.42:54298) 2024-09-16T01:56:09.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ac1956640 1 -- 172.21.15.42:0/2023283144 learned_addr learned my addr 172.21.15.42:0/2023283144 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:09.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ac1155640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5abc15e740 0x7f5abc0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782494247 0 0) 0x7f5abc06e040 con 0x7f5abc06dbd0 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa8003520 con 0x7f5abc06dbd0 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3616219649 0 0) 0x7f5aa8003520 con 0x7f5abc06dbd0 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5abc15e740 msgr2=0x7f5abc0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5abc15e740 0x7f5abc0d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 >> v1:172.21.15.107:6789/0 conn(0x7f5abc09b690 legacy=0x7f5abc06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc0d0a60 con 0x7f5abc06dbd0 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f5ab40019f0 con 0x7f5abc06dbd0 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 >> v1:172.21.15.42:6789/0 conn(0x7f5abc06dbd0 legacy=0x7f5abc070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5aa80039e0 0x7f5aa8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5abc15e740 0x7f5aa8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5aa8004d40 0x7f5aa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc15eb20 con 0x7f5aa8004d40 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa800b9c0 con 0x7f5aa80039e0 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.234+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa800bbc0 con 0x7f5abc15e740 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.235+0000 7f5ac1956640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5aa8004d40 0x7f5aa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.235+0000 7f5ac1155640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5aa80039e0 0x7f5aa8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.235+0000 7f5ac0954640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5abc15e740 0x7f5aa8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.235+0000 7f5ac1956640 1 -- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5abc15e740 msgr2=0x7f5aa8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.235+0000 7f5ac1956640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5abc15e740 0x7f5aa8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.235+0000 7f5ac1956640 1 -- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5aa80039e0 msgr2=0x7f5aa8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.235+0000 7f5ac1956640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5aa80039e0 0x7f5aa8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.235+0000 7f5ac1956640 1 -- 172.21.15.42:0/2023283144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa8003520 con 0x7f5aa8004d40 2024-09-16T01:56:09.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ac1956640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5aa8004d40 0x7f5aa80051c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400a920 tx=0x7f5aa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a8e18bf63c8480 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:09.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab400a4c0 con 0x7f5aa8004d40 2024-09-16T01:56:09.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab402f070 con 0x7f5aa8004d40 2024-09-16T01:56:09.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ab3fff640 1 -- 172.21.15.42:0/2023283144 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab402bce0 con 0x7f5aa8004d40 2024-09-16T01:56:09.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ac33b9640 1 -- 172.21.15.42:0/2023283144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5aa8004d40 msgr2=0x7f5aa80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ac33b9640 1 --2- 172.21.15.42:0/2023283144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5aa8004d40 0x7f5aa80051c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400a920 tx=0x7f5aa8005830 comp rx=0 tx=0).stop 2024-09-16T01:56:09.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ac1956640 1 -- 172.21.15.42:0/2023283144 reap_dead start 2024-09-16T01:56:09.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ac33b9640 1 -- 172.21.15.42:0/2023283144 shutdown_connections 2024-09-16T01:56:09.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ac33b9640 1 -- 172.21.15.42:0/2023283144 >> 172.21.15.42:0/2023283144 conn(0x7f5abc0d23a0 msgr2=0x7f5abc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:09.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ac33b9640 1 -- 172.21.15.42:0/2023283144 shutdown_connections 2024-09-16T01:56:09.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.236+0000 7f5ac33b9640 1 -- 172.21.15.42:0/2023283144 wait complete. 2024-09-16T01:56:09.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac33b9640 1 Processor -- start 2024-09-16T01:56:09.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac33b9640 1 -- start start 2024-09-16T01:56:09.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac33b9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5aa8004d40 0x7f5abc14b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac33b9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5abc155810 0x7f5abc0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac33b9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5abc155d60 0x7f5abc0b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac33b9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc09ba90 con 0x7f5abc155d60 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac33b9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc0d1020 con 0x7f5abc155810 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac33b9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5abc0d1540 con 0x7f5aa8004d40 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac1956640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5abc155d60 0x7f5abc0b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac1956640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5abc155d60 0x7f5abc0b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47564/0 (socket says 172.21.15.42:47564) 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.238+0000 7f5ac1956640 1 -- 172.21.15.42:0/3012252046 learned_addr learned my addr 172.21.15.42:0/3012252046 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ac1155640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5aa8004d40 0x7f5abc14b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ac0954640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5abc155810 0x7f5abc0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ac1956640 1 -- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5aa8004d40 msgr2=0x7f5abc14b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ac1956640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5aa8004d40 0x7f5abc14b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ac1956640 1 -- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5abc155810 msgr2=0x7f5abc0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ac1956640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5abc155810 0x7f5abc0b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ac1956640 1 -- 172.21.15.42:0/3012252046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc0cb7c0 con 0x7f5abc155d60 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ac1956640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5abc155d60 0x7f5abc0b3270 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400aa40 tx=0x7f5ab4001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ab1ffb640 1 -- 172.21.15.42:0/3012252046 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab400a4c0 con 0x7f5abc155d60 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ab1ffb640 1 -- 172.21.15.42:0/3012252046 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab402cb40 con 0x7f5abc155d60 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ac33b9640 1 -- 172.21.15.42:0/3012252046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5abc0cbaa0 con 0x7f5abc155d60 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ab1ffb640 1 -- 172.21.15.42:0/3012252046 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4034470 con 0x7f5abc155d60 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.239+0000 7f5ac33b9640 1 -- 172.21.15.42:0/3012252046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5abc0cb450 con 0x7f5abc155d60 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.240+0000 7f5ac33b9640 1 -- 172.21.15.42:0/3012252046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5abc0d0780 con 0x7f5abc155d60 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.241+0000 7f5ab1ffb640 1 -- 172.21.15.42:0/3012252046 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5ab4046060 con 0x7f5abc155d60 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.241+0000 7f5ab1ffb640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5aa006c2b0 0x7f5aa006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.241+0000 7f5ab1ffb640 1 -- 172.21.15.42:0/3012252046 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f5ab40ab3a0 con 0x7f5abc155d60 2024-09-16T01:56:09.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.241+0000 7f5ac1155640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5aa006c2b0 0x7f5aa006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.242+0000 7f5ac1155640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5aa006c2b0 0x7f5aa006e770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009bc0 tx=0x7f5ab8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:09.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.246+0000 7f5ab1ffb640 1 -- 172.21.15.42:0/3012252046 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ab4079910 con 0x7f5abc155d60 2024-09-16T01:56:09.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.435+0000 7f5ac33b9640 1 -- 172.21.15.42:0/3012252046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5abc0d1cb0 con 0x7f5abc155d60 2024-09-16T01:56:09.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.435+0000 7f5ab1ffb640 1 -- 172.21.15.42:0/3012252046 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) ==== 80+0+0 (secure 0 0 0) 0x7f5ab4079210 con 0x7f5abc155d60 2024-09-16T01:56:09.436 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-16T01:56:09.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 -- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5aa006c2b0 msgr2=0x7f5aa006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5aa006c2b0 0x7f5aa006e770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009bc0 tx=0x7f5ab8009190 comp rx=0 tx=0).stop 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 -- 172.21.15.42:0/3012252046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5abc155d60 msgr2=0x7f5abc0b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5abc155d60 0x7f5abc0b3270 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400aa40 tx=0x7f5ab4001dc0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 -- 172.21.15.42:0/3012252046 shutdown_connections 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5aa006c2b0 0x7f5aa006e770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5abc155d60 0x7f5abc0b3270 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5abc155810 0x7f5abc0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 --2- 172.21.15.42:0/3012252046 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5aa8004d40 0x7f5abc14b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 -- 172.21.15.42:0/3012252046 >> 172.21.15.42:0/3012252046 conn(0x7f5abc0d23a0 msgr2=0x7f5abc0ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 -- 172.21.15.42:0/3012252046 shutdown_connections 2024-09-16T01:56:09.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.437+0000 7f5ac33b9640 1 -- 172.21.15.42:0/3012252046 wait complete. 2024-09-16T01:56:09.449 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:56:09.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:09.450 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:56:09.500 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:56:09.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:09.501 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:56:09.532 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:56:09.532 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:56:09.532 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:56:09.550 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:56:09.550 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:56:09.550 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:56:09.550 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:56:09.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=159 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:56:09.586 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:56:09.586 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:56:09.586 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:56:09.606 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:56:09.606 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:56:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.727+0000 7f0e20e82640 1 Processor -- start 2024-09-16T01:56:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.727+0000 7f0e20e82640 1 -- start start 2024-09-16T01:56:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e20e82640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0e1c0d30f0 0x7f0e1c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e20e82640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0e1c0b64c0 0x7f0e1c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e20e82640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c0d3690 con 0x7f0e1c15e5f0 2024-09-16T01:56:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e20e82640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1c06d530 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e20e82640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1c0d3970 con 0x7f0e1c0d30f0 2024-09-16T01:56:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e1ad9d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0e1c0b64c0 0x7f0e1c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e1a59c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0e1c15e5f0 0x7f0e1c0d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54302/0 (socket says 172.21.15.42:54302) 2024-09-16T01:56:09.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e1a59c640 1 -- 172.21.15.42:0/2695254746 learned_addr learned my addr 172.21.15.42:0/2695254746 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:09.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e11d9b640 1 --2- 172.21.15.42:0/2695254746 >> v2:172.21.15.107:3300/0 conn(0x7f0e1c0d30f0 0x7f0e1c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e1ad9d640 1 -- 172.21.15.42:0/2695254746 >> v2:172.21.15.107:3300/0 conn(0x7f0e1c0d30f0 msgr2=0x7f0e1c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:09.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e1ad9d640 1 --2- 172.21.15.42:0/2695254746 >> v2:172.21.15.107:3300/0 conn(0x7f0e1c0d30f0 0x7f0e1c0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e1ad9d640 1 -- 172.21.15.42:0/2695254746 >> v1:172.21.15.42:6789/0 conn(0x7f0e1c15e5f0 legacy=0x7f0e1c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.728+0000 7f0e1ad9d640 1 -- 172.21.15.42:0/2695254746 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c06cee0 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.729+0000 7f0e1ad9d640 1 --2- 172.21.15.42:0/2695254746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 0x7f0e1c06d9c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c08e520 tx=0x7f0e1402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66e2d997d32795f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.729+0000 7f0e19d9b640 1 -- 172.21.15.42:0/2695254746 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14007740 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.729+0000 7f0e19d9b640 1 -- 172.21.15.42:0/2695254746 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e140078e0 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.729+0000 7f0e19d9b640 1 -- 172.21.15.42:0/2695254746 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14007cb0 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.730+0000 7f0e20e82640 1 -- 172.21.15.42:0/2695254746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 msgr2=0x7f0e1c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.730+0000 7f0e20e82640 1 --2- 172.21.15.42:0/2695254746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 0x7f0e1c06d9c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c08e520 tx=0x7f0e1402a680 comp rx=0 tx=0).stop 2024-09-16T01:56:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.730+0000 7f0e20e82640 1 -- 172.21.15.42:0/2695254746 shutdown_connections 2024-09-16T01:56:09.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.730+0000 7f0e20e82640 1 --2- 172.21.15.42:0/2695254746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 0x7f0e1c06d9c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.730+0000 7f0e20e82640 1 --2- 172.21.15.42:0/2695254746 >> v2:172.21.15.107:3300/0 conn(0x7f0e1c0d30f0 0x7f0e1c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.730+0000 7f0e20e82640 1 -- 172.21.15.42:0/2695254746 >> 172.21.15.42:0/2695254746 conn(0x7f0e1c08bfc0 msgr2=0x7f0e1c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:09.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.730+0000 7f0e20e82640 1 -- 172.21.15.42:0/2695254746 shutdown_connections 2024-09-16T01:56:09.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.730+0000 7f0e20e82640 1 -- 172.21.15.42:0/2695254746 wait complete. 2024-09-16T01:56:09.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.731+0000 7f0e20e82640 1 Processor -- start 2024-09-16T01:56:09.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.731+0000 7f0e20e82640 1 -- start start 2024-09-16T01:56:09.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e20e82640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 0x7f0e1c151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e20e82640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e1c0d30f0 0x7f0e1c0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e20e82640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e1c15e5f0 0x7f0e1c160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e20e82640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c06df00 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e20e82640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c15e9d0 con 0x7f0e1c15e5f0 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e20e82640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c06e080 con 0x7f0e1c0d30f0 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e1a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 0x7f0e1c151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e1a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 0x7f0e1c151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47580/0 (socket says 172.21.15.42:47580) 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e1a59c640 1 -- 172.21.15.42:0/3038566128 learned_addr learned my addr 172.21.15.42:0/3038566128 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e11d9b640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e1c0d30f0 0x7f0e1c0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e1ad9d640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e1c15e5f0 0x7f0e1c160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e1a59c640 1 -- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e1c0d30f0 msgr2=0x7f0e1c0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e1a59c640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e1c0d30f0 0x7f0e1c0c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e1a59c640 1 -- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e1c15e5f0 msgr2=0x7f0e1c160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e1a59c640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e1c15e5f0 0x7f0e1c160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.732+0000 7f0e1a59c640 1 -- 172.21.15.42:0/3038566128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c0c9c10 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.733+0000 7f0e1a59c640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 0x7f0e1c151900 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00c3f0 tx=0x7f0e0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.733+0000 7f0e137fe640 1 -- 172.21.15.42:0/3038566128 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c017070 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.733+0000 7f0e137fe640 1 -- 172.21.15.42:0/3038566128 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c005ce0 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.733+0000 7f0e20e82640 1 -- 172.21.15.42:0/3038566128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c0c9ef0 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.733+0000 7f0e137fe640 1 -- 172.21.15.42:0/3038566128 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0072f0 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.733+0000 7f0e20e82640 1 -- 172.21.15.42:0/3038566128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1c0ca4b0 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.734+0000 7f0e20e82640 1 -- 172.21.15.42:0/3038566128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c06d9c0 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.734+0000 7f0e137fe640 1 -- 172.21.15.42:0/3038566128 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0e0c01a070 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.735+0000 7f0e137fe640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0dfc06c2b0 0x7f0dfc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.735+0000 7f0e137fe640 1 -- 172.21.15.42:0/3038566128 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f0e0c08a920 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.735+0000 7f0e11d9b640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0dfc06c2b0 0x7f0dfc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.735+0000 7f0e11d9b640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0dfc06c2b0 0x7f0dfc06e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0b2b20 tx=0x7f0e04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:09.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.739+0000 7f0e137fe640 1 -- 172.21.15.42:0/3038566128 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e0c058f00 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.951+0000 7f0e20e82640 1 -- 172.21.15.42:0/3038566128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e1c0b5d00 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.952+0000 7f0e137fe640 1 -- 172.21.15.42:0/3038566128 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5225 (secure 0 0 0) 0x7f0e0c05f0d0 con 0x7f0e1c0b64c0 2024-09-16T01:56:09.954 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:09.954 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-09-16T01:55:59:851792+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3210303754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3210303754},{"type":"v1","addr":"172.21.15.42:6833","nonce":3210303754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/628179225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":628179225},{"type":"v1","addr":"172.21.15.107:6837","nonce":628179225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3586378815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3586378815},{"type":"v1","addr":"172.21.15.42:6835","nonce":3586378815}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:57.021180+0000","modified":"2024-09-16T01:55:59.200652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34817":{"gid":34817,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6836/19167184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":19167184},{"type":"v1","addr":"172.21.15.107:6836","nonce":19167184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34817,"qdb_cluster":[34817]},"id":3}]} 2024-09-16T01:56:09.954 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-09-16T01:56:09.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 -- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0dfc06c2b0 msgr2=0x7f0dfc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0dfc06c2b0 0x7f0dfc06e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0b2b20 tx=0x7f0e04008040 comp rx=0 tx=0).stop 2024-09-16T01:56:09.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 -- 172.21.15.42:0/3038566128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 msgr2=0x7f0e1c151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:09.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 0x7f0e1c151900 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00c3f0 tx=0x7f0e0c00c8b0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 -- 172.21.15.42:0/3038566128 shutdown_connections 2024-09-16T01:56:09.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0dfc06c2b0 0x7f0dfc06e770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e1c15e5f0 0x7f0e1c160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e1c0d30f0 0x7f0e1c0c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 --2- 172.21.15.42:0/3038566128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e1c0b64c0 0x7f0e1c151900 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:09.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 -- 172.21.15.42:0/3038566128 >> 172.21.15.42:0/3038566128 conn(0x7f0e1c08bfc0 msgr2=0x7f0e1c0b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:09.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 -- 172.21.15.42:0/3038566128 shutdown_connections 2024-09-16T01:56:09.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:09.954+0000 7f0e20e82640 1 -- 172.21.15.42:0/3038566128 wait complete. 2024-09-16T01:56:09.966 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:56:10.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.068+0000 7fba0bc82640 1 Processor -- start 2024-09-16T01:56:10.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.068+0000 7fba0bc82640 1 -- start start 2024-09-16T01:56:10.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0bc82640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 0x7fba0406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0bc82640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fba040d4fd0 0x7fba040d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0bc82640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba040d2700 con 0x7fba0415e760 2024-09-16T01:56:10.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0bc82640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fba040cedb0 con 0x7fba040d4fd0 2024-09-16T01:56:10.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0bc82640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fba040cf090 con 0x7fba040cfcc0 2024-09-16T01:56:10.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0921d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 0x7fba0406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0a21f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fba040d4fd0 0x7fba040d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0921d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 0x7fba0406cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:54608/0 (socket says 172.21.15.42:54608) 2024-09-16T01:56:10.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0921d640 1 -- 172.21.15.42:0/1499293520 learned_addr learned my addr 172.21.15.42:0/1499293520 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:10.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0921d640 1 -- 172.21.15.42:0/1499293520 >> v2:172.21.15.107:3300/0 conn(0x7fba040d4fd0 msgr2=0x7fba040d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:10.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0921d640 1 --2- 172.21.15.42:0/1499293520 >> v2:172.21.15.107:3300/0 conn(0x7fba040d4fd0 0x7fba040d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0921d640 1 -- 172.21.15.42:0/1499293520 >> v1:172.21.15.107:6789/0 conn(0x7fba0415e760 legacy=0x7fba040cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0921d640 1 -- 172.21.15.42:0/1499293520 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba040b3c80 con 0x7fba040cfcc0 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.069+0000 7fba0a21f640 1 --2- 172.21.15.42:0/1499293520 >> v2:172.21.15.107:3300/0 conn(0x7fba040d4fd0 0x7fba040d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.070+0000 7fba0921d640 1 --2- 172.21.15.42:0/1499293520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 0x7fba0406cdd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009850 tx=0x7fb9f402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28fba79b1f837124 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.070+0000 7fba08a1c640 1 -- 172.21.15.42:0/1499293520 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4004030 con 0x7fba040cfcc0 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.070+0000 7fba08a1c640 1 -- 172.21.15.42:0/1499293520 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f40041d0 con 0x7fba040cfcc0 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.070+0000 7fba08a1c640 1 -- 172.21.15.42:0/1499293520 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4003610 con 0x7fba040cfcc0 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.071+0000 7fba0bc82640 1 -- 172.21.15.42:0/1499293520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 msgr2=0x7fba0406cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.071+0000 7fba0bc82640 1 --2- 172.21.15.42:0/1499293520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 0x7fba0406cdd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009850 tx=0x7fb9f402a230 comp rx=0 tx=0).stop 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.071+0000 7fba0bc82640 1 -- 172.21.15.42:0/1499293520 shutdown_connections 2024-09-16T01:56:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.071+0000 7fba0bc82640 1 --2- 172.21.15.42:0/1499293520 >> v2:172.21.15.107:3300/0 conn(0x7fba040d4fd0 0x7fba040d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.071+0000 7fba0bc82640 1 --2- 172.21.15.42:0/1499293520 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 0x7fba0406cdd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.071+0000 7fba0bc82640 1 -- 172.21.15.42:0/1499293520 >> 172.21.15.42:0/1499293520 conn(0x7fba0408bfc0 msgr2=0x7fba040d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:10.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.071+0000 7fba0bc82640 1 -- 172.21.15.42:0/1499293520 shutdown_connections 2024-09-16T01:56:10.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.071+0000 7fba0bc82640 1 -- 172.21.15.42:0/1499293520 wait complete. 2024-09-16T01:56:10.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.072+0000 7fba0bc82640 1 Processor -- start 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.072+0000 7fba0bc82640 1 -- start start 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0bc82640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 0x7fba041f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0bc82640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba040d4fd0 0x7fba040cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0bc82640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba0415e760 0x7fba04155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0bc82640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fba040d33e0 con 0x7fba0415e760 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0bc82640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fba040b38a0 con 0x7fba040d4fd0 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0bc82640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fba040d3560 con 0x7fba040cfcc0 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0a21f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba0415e760 0x7fba04155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0a21f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba0415e760 0x7fba04155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47582/0 (socket says 172.21.15.42:47582) 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0a21f640 1 -- 172.21.15.42:0/4102650823 learned_addr learned my addr 172.21.15.42:0/4102650823 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba09a1e640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 0x7fba041f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0921d640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba040d4fd0 0x7fba040cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0a21f640 1 -- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 msgr2=0x7fba041f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0a21f640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 0x7fba041f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0a21f640 1 -- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba040d4fd0 msgr2=0x7fba040cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0a21f640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba040d4fd0 0x7fba040cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0a21f640 1 -- 172.21.15.42:0/4102650823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba040b8030 con 0x7fba0415e760 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.073+0000 7fba0921d640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba040d4fd0 0x7fba040cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.074+0000 7fba0a21f640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba0415e760 0x7fba04155340 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00efc0 tx=0x7fb9fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.074+0000 7fb9fa7fc640 1 -- 172.21.15.42:0/4102650823 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc018030 con 0x7fba0415e760 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.074+0000 7fb9fa7fc640 1 -- 172.21.15.42:0/4102650823 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00ccd0 con 0x7fba0415e760 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.074+0000 7fba0bc82640 1 -- 172.21.15.42:0/4102650823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba040b8370 con 0x7fba0415e760 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.074+0000 7fb9fa7fc640 1 -- 172.21.15.42:0/4102650823 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc003bb0 con 0x7fba0415e760 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.074+0000 7fba0bc82640 1 -- 172.21.15.42:0/4102650823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba040b8bb0 con 0x7fba0415e760 2024-09-16T01:56:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.075+0000 7fba0bc82640 1 -- 172.21.15.42:0/4102650823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba040d3890 con 0x7fba0415e760 2024-09-16T01:56:10.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.075+0000 7fb9fa7fc640 1 -- 172.21.15.42:0/4102650823 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb9fc005d10 con 0x7fba0415e760 2024-09-16T01:56:10.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.076+0000 7fb9fa7fc640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb9e806c2b0 0x7fb9e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.076+0000 7fb9fa7fc640 1 -- 172.21.15.42:0/4102650823 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fb9fc08be40 con 0x7fba0415e760 2024-09-16T01:56:10.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.076+0000 7fba09a1e640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb9e806c2b0 0x7fb9e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.077+0000 7fba09a1e640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb9e806c2b0 0x7fb9e806e770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba000016e0 tx=0x7fba00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:10.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.080+0000 7fb9fa7fc640 1 -- 172.21.15.42:0/4102650823 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9fc022070 con 0x7fba0415e760 2024-09-16T01:56:10.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.291+0000 7fba0bc82640 1 -- 172.21.15.42:0/4102650823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba040b6d20 con 0x7fba0415e760 2024-09-16T01:56:10.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.292+0000 7fb9fa7fc640 1 -- 172.21.15.42:0/4102650823 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5225 (secure 0 0 0) 0x7fba040b8370 con 0x7fba0415e760 2024-09-16T01:56:10.294 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:10.294 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-09-16T01:55:59:851792+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3210303754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3210303754},{"type":"v1","addr":"172.21.15.42:6833","nonce":3210303754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/628179225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":628179225},{"type":"v1","addr":"172.21.15.107:6837","nonce":628179225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3586378815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3586378815},{"type":"v1","addr":"172.21.15.42:6835","nonce":3586378815}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:57.021180+0000","modified":"2024-09-16T01:55:59.200652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34817":{"gid":34817,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6836/19167184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":19167184},{"type":"v1","addr":"172.21.15.107:6836","nonce":19167184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34817,"qdb_cluster":[34817]},"id":3}]} 2024-09-16T01:56:10.294 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-09-16T01:56:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 -- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb9e806c2b0 msgr2=0x7fb9e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb9e806c2b0 0x7fb9e806e770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba000016e0 tx=0x7fba00009040 comp rx=0 tx=0).stop 2024-09-16T01:56:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 -- 172.21.15.42:0/4102650823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba0415e760 msgr2=0x7fba04155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba0415e760 0x7fba04155340 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00efc0 tx=0x7fb9fc00c490 comp rx=0 tx=0).stop 2024-09-16T01:56:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 -- 172.21.15.42:0/4102650823 shutdown_connections 2024-09-16T01:56:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb9e806c2b0 0x7fb9e806e770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba0415e760 0x7fba04155340 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba040d4fd0 0x7fba040cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 --2- 172.21.15.42:0/4102650823 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fba040cfcc0 0x7fba041f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 -- 172.21.15.42:0/4102650823 >> 172.21.15.42:0/4102650823 conn(0x7fba0408bfc0 msgr2=0x7fba040b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 -- 172.21.15.42:0/4102650823 shutdown_connections 2024-09-16T01:56:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.294+0000 7fba0bc82640 1 -- 172.21.15.42:0/4102650823 wait complete. 2024-09-16T01:56:10.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:56:10.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.408+0000 7fae76ee4640 1 Processor -- start 2024-09-16T01:56:10.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.408+0000 7fae76ee4640 1 -- start start 2024-09-16T01:56:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.408+0000 7fae76ee4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fae70161c80 0x7fae7006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.408+0000 7fae76ee4640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7006e870 con 0x7fae700b6680 2024-09-16T01:56:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.408+0000 7fae76ee4640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7006d9f0 con 0x7fae70162060 2024-09-16T01:56:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.408+0000 7fae76ee4640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fae7006dcd0 con 0x7fae70161c80 2024-09-16T01:56:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae75481640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fae700b6680 0x7fae700cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54316/0 (socket says 172.21.15.42:54316) 2024-09-16T01:56:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae75481640 1 -- 172.21.15.42:0/2005097589 learned_addr learned my addr 172.21.15.42:0/2005097589 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315363692 0 0) 0x7fae68001490 con 0x7fae700b6680 2024-09-16T01:56:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae60003520 con 0x7fae700b6680 2024-09-16T01:56:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae74c80640 1 --2- 172.21.15.42:0/2005097589 >> v2:172.21.15.107:3300/0 conn(0x7fae70161c80 0x7fae7006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1465046713 0 0) 0x7fae60003520 con 0x7fae700b6680 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 >> v2:172.21.15.107:3300/0 conn(0x7fae70161c80 msgr2=0x7fae7006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 --2- 172.21.15.42:0/2005097589 >> v2:172.21.15.107:3300/0 conn(0x7fae70161c80 0x7fae7006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 >> v1:172.21.15.107:6789/0 conn(0x7fae70162060 legacy=0x7fae700b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7006dfb0 con 0x7fae700b6680 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7fae68001bc0 con 0x7fae700b6680 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 >> v1:172.21.15.42:6789/0 conn(0x7fae700b6680 legacy=0x7fae700cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae600039b0 0x7fae60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae600051c0 0x7fae6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fae7006dcd0 con 0x7fae60004800 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae6000c060 con 0x7fae600051c0 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fae6000c260 con 0x7fae600039b0 2024-09-16T01:56:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae6ffff640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae74c80640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae600039b0 0x7fae60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.409+0000 7fae75481640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae600051c0 0x7fae6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.410+0000 7fae6ffff640 1 -- 172.21.15.42:0/2005097589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae600039b0 msgr2=0x7fae60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.410+0000 7fae6ffff640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae600039b0 0x7fae60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.410+0000 7fae6ffff640 1 -- 172.21.15.42:0/2005097589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae600051c0 msgr2=0x7fae6000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.410+0000 7fae6ffff640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae600051c0 0x7fae6000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.410+0000 7fae75481640 1 -- 172.21.15.42:0/2005097589 reap_dead start 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.410+0000 7fae6ffff640 1 -- 172.21.15.42:0/2005097589 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae60003520 con 0x7fae60004800 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.410+0000 7fae6ffff640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae60004c80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fae5c001720 tx=0x7fae60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27c172a77bc25a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.411+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c001370 con 0x7fae60004800 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.411+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae5c0052d0 con 0x7fae60004800 2024-09-16T01:56:10.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.411+0000 7fae6f7fe640 1 -- 172.21.15.42:0/2005097589 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c02ab90 con 0x7fae60004800 2024-09-16T01:56:10.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.411+0000 7fae76ee4640 1 -- 172.21.15.42:0/2005097589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 msgr2=0x7fae60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.411+0000 7fae76ee4640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae60004c80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fae5c001720 tx=0x7fae60005830 comp rx=0 tx=0).stop 2024-09-16T01:56:10.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.411+0000 7fae76ee4640 1 -- 172.21.15.42:0/2005097589 shutdown_connections 2024-09-16T01:56:10.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.411+0000 7fae76ee4640 1 --2- 172.21.15.42:0/2005097589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae60004c80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.411+0000 7fae76ee4640 1 -- 172.21.15.42:0/2005097589 >> 172.21.15.42:0/2005097589 conn(0x7fae700d44f0 msgr2=0x7fae700d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:10.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.411+0000 7fae76ee4640 1 -- 172.21.15.42:0/2005097589 shutdown_connections 2024-09-16T01:56:10.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.411+0000 7fae76ee4640 1 -- 172.21.15.42:0/2005097589 wait complete. 2024-09-16T01:56:10.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.412+0000 7fae76ee4640 1 Processor -- start 2024-09-16T01:56:10.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.412+0000 7fae76ee4640 1 -- start start 2024-09-16T01:56:10.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.413+0000 7fae76ee4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae70154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.413+0000 7fae76ee4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae70155ce0 0x7fae700b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.413+0000 7fae76ee4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae70155720 0x7fae700b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.413+0000 7fae76ee4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fae700b6b30 con 0x7fae60004800 2024-09-16T01:56:10.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.413+0000 7fae76ee4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fae700d2aa0 con 0x7fae70155720 2024-09-16T01:56:10.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.413+0000 7fae76ee4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fae700b6cb0 con 0x7fae70155ce0 2024-09-16T01:56:10.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.413+0000 7fae74c80640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae70154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.413+0000 7fae74c80640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae70154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47592/0 (socket says 172.21.15.42:47592) 2024-09-16T01:56:10.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae74c80640 1 -- 172.21.15.42:0/553231877 learned_addr learned my addr 172.21.15.42:0/553231877 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae6ffff640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae70155ce0 0x7fae700b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae75481640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae70155720 0x7fae700b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae74c80640 1 -- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae70155ce0 msgr2=0x7fae700b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae74c80640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae70155ce0 0x7fae700b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae74c80640 1 -- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae70155720 msgr2=0x7fae700b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae74c80640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae70155720 0x7fae700b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae74c80640 1 -- 172.21.15.42:0/553231877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae700cc5a0 con 0x7fae60004800 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae75481640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae70155720 0x7fae700b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae6ffff640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae70155ce0 0x7fae700b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae74c80640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae70154e70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fae64011aa0 tx=0x7fae64011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae6d7fa640 1 -- 172.21.15.42:0/553231877 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6400fb80 con 0x7fae60004800 2024-09-16T01:56:10.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae6d7fa640 1 -- 172.21.15.42:0/553231877 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae6400fd20 con 0x7fae60004800 2024-09-16T01:56:10.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae6d7fa640 1 -- 172.21.15.42:0/553231877 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64014660 con 0x7fae60004800 2024-09-16T01:56:10.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae76ee4640 1 -- 172.21.15.42:0/553231877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae700cc880 con 0x7fae60004800 2024-09-16T01:56:10.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.414+0000 7fae76ee4640 1 -- 172.21.15.42:0/553231877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae700b8920 con 0x7fae60004800 2024-09-16T01:56:10.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.415+0000 7fae76ee4640 1 -- 172.21.15.42:0/553231877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7006e330 con 0x7fae60004800 2024-09-16T01:56:10.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.416+0000 7fae6d7fa640 1 -- 172.21.15.42:0/553231877 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fae64012040 con 0x7fae60004800 2024-09-16T01:56:10.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.416+0000 7fae6d7fa640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fae5406c2b0 0x7fae5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.416+0000 7fae6d7fa640 1 -- 172.21.15.42:0/553231877 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fae6408bd90 con 0x7fae60004800 2024-09-16T01:56:10.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.417+0000 7fae6ffff640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fae5406c2b0 0x7fae5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.417+0000 7fae6ffff640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fae5406c2b0 0x7fae5406e770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fae5c032000 tx=0x7fae5c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:10.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.421+0000 7fae6d7fa640 1 -- 172.21.15.42:0/553231877 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae64019030 con 0x7fae60004800 2024-09-16T01:56:10.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.599+0000 7fae76ee4640 1 -- 172.21.15.42:0/553231877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae700ba470 con 0x7fae60004800 2024-09-16T01:56:10.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.601+0000 7fae6d7fa640 1 -- 172.21.15.42:0/553231877 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16990 (secure 0 0 0) 0x7fae6405a360 con 0x7fae60004800 2024-09-16T01:56:10.602 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:10.602 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":50,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:58.669116+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:55:54.676980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-16T01:55:56.007224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:56:10.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 -- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fae5406c2b0 msgr2=0x7fae5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fae5406c2b0 0x7fae5406e770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fae5c032000 tx=0x7fae5c02e000 comp rx=0 tx=0).stop 2024-09-16T01:56:10.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 -- 172.21.15.42:0/553231877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 msgr2=0x7fae70154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae70154e70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fae64011aa0 tx=0x7fae64011f60 comp rx=0 tx=0).stop 2024-09-16T01:56:10.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 -- 172.21.15.42:0/553231877 shutdown_connections 2024-09-16T01:56:10.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fae5406c2b0 0x7fae5406e770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae70155720 0x7fae700b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fae70155ce0 0x7fae700b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 --2- 172.21.15.42:0/553231877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae60004800 0x7fae70154e70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 -- 172.21.15.42:0/553231877 >> 172.21.15.42:0/553231877 conn(0x7fae700d44f0 msgr2=0x7fae700cf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:10.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 -- 172.21.15.42:0/553231877 shutdown_connections 2024-09-16T01:56:10.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.603+0000 7fae76ee4640 1 -- 172.21.15.42:0/553231877 wait complete. 2024-09-16T01:56:10.616 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:56:10.616 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:56:10.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.718+0000 7f6559d31640 1 Processor -- start 2024-09-16T01:56:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.718+0000 7f6559d31640 1 -- start start 2024-09-16T01:56:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.718+0000 7f6559d31640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65540b6680 0x7f6554169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.718+0000 7f6559d31640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f655406d9f0 con 0x7f6554162060 2024-09-16T01:56:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.718+0000 7f6559d31640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f655406dcd0 con 0x7f6554161c80 2024-09-16T01:56:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.718+0000 7f6559d31640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f655406dfb0 con 0x7f65540b6680 2024-09-16T01:56:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f6552ffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6554162060 0x7f65540b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54332/0 (socket says 172.21.15.42:54332) 2024-09-16T01:56:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f6552ffd640 1 -- 172.21.15.42:0/3916220296 learned_addr learned my addr 172.21.15.42:0/3916220296 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:10.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284811946 0 0) 0x7f655406d9f0 con 0x7f6554162060 2024-09-16T01:56:10.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f653c003520 con 0x7f6554162060 2024-09-16T01:56:10.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f6553fff640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65540b6680 0x7f6554169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3862629325 0 0) 0x7f653c003520 con 0x7f6554162060 2024-09-16T01:56:10.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65540b6680 msgr2=0x7f6554169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:10.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65540b6680 0x7f6554169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 >> v1:172.21.15.107:6789/0 conn(0x7f6554161c80 legacy=0x7f655406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65540d01f0 con 0x7f6554162060 2024-09-16T01:56:10.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f6548001670 con 0x7f6554162060 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 >> v1:172.21.15.42:6789/0 conn(0x7f6554162060 legacy=0x7f65540b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65540b6680 0x7f653c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 0x7f653c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f653c004d40 0x7f653c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f655406dfb0 con 0x7f653c003f60 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f653c00baa0 con 0x7f653c004d40 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f653c00bca0 con 0x7f65540b6680 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f6552ffd640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 0x7f653c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f65537fe640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65540b6680 0x7f653c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.719+0000 7f6553fff640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f653c004d40 0x7f653c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.720+0000 7f6552ffd640 1 -- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65540b6680 msgr2=0x7f653c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.720+0000 7f6552ffd640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f65540b6680 0x7f653c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.720+0000 7f6552ffd640 1 -- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f653c004d40 msgr2=0x7f653c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.720+0000 7f6552ffd640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f653c004d40 0x7f653c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.720+0000 7f6552ffd640 1 -- 172.21.15.42:0/3916220296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c003520 con 0x7f653c003f60 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.720+0000 7f6553fff640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f653c004d40 0x7f653c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.720+0000 7f6552ffd640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 0x7f653c004800 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6554162460 tx=0x7f653c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fc38ceb3fac58e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.721+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548007d30 con 0x7f653c003f60 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.721+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65480058d0 con 0x7f653c003f60 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.721+0000 7f65527fc640 1 -- 172.21.15.42:0/3916220296 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548005d20 con 0x7f653c003f60 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.721+0000 7f6559d31640 1 -- 172.21.15.42:0/3916220296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 msgr2=0x7f653c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.721+0000 7f6559d31640 1 --2- 172.21.15.42:0/3916220296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 0x7f653c004800 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6554162460 tx=0x7f653c005830 comp rx=0 tx=0).stop 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.721+0000 7f6553fff640 1 -- 172.21.15.42:0/3916220296 reap_dead start 2024-09-16T01:56:10.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.721+0000 7f6559d31640 1 -- 172.21.15.42:0/3916220296 shutdown_connections 2024-09-16T01:56:10.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.721+0000 7f6559d31640 1 -- 172.21.15.42:0/3916220296 >> 172.21.15.42:0/3916220296 conn(0x7f65540d44f0 msgr2=0x7f65540d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:10.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.721+0000 7f6559d31640 1 -- 172.21.15.42:0/3916220296 shutdown_connections 2024-09-16T01:56:10.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.721+0000 7f6559d31640 1 -- 172.21.15.42:0/3916220296 wait complete. 2024-09-16T01:56:10.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.722+0000 7f6559d31640 1 Processor -- start 2024-09-16T01:56:10.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f6559d31640 1 -- start start 2024-09-16T01:56:10.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f6559d31640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 0x7f65541f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f6559d31640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6554159b70 0x7f65540a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f6559d31640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f655409e2e0 0x7f655409e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f6559d31640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f65540b6b30 con 0x7f653c003f60 2024-09-16T01:56:10.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f6559d31640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f65540d2aa0 con 0x7f6554159b70 2024-09-16T01:56:10.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f6559d31640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f65540b6cb0 con 0x7f655409e2e0 2024-09-16T01:56:10.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f65537fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 0x7f65541f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f65537fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 0x7f65541f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47608/0 (socket says 172.21.15.42:47608) 2024-09-16T01:56:10.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f65537fe640 1 -- 172.21.15.42:0/550982336 learned_addr learned my addr 172.21.15.42:0/550982336 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:10.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.723+0000 7f6553fff640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f655409e2e0 0x7f655409e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f6552ffd640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6554159b70 0x7f65540a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f65537fe640 1 -- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f655409e2e0 msgr2=0x7f655409e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f65537fe640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f655409e2e0 0x7f655409e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f65537fe640 1 -- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6554159b70 msgr2=0x7f65540a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f65537fe640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6554159b70 0x7f65540a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f65537fe640 1 -- 172.21.15.42:0/550982336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65540a0a70 con 0x7f653c003f60 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f6552ffd640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6554159b70 0x7f65540a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f65537fe640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 0x7f65541f4660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f654400f820 tx=0x7f654400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f653bfff640 1 -- 172.21.15.42:0/550982336 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65440050d0 con 0x7f653c003f60 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f653bfff640 1 -- 172.21.15.42:0/550982336 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6544018070 con 0x7f653c003f60 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f653bfff640 1 -- 172.21.15.42:0/550982336 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6544005490 con 0x7f653c003f60 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f6559d31640 1 -- 172.21.15.42:0/550982336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65540a0d50 con 0x7f653c003f60 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.724+0000 7f6559d31640 1 -- 172.21.15.42:0/550982336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65540a1310 con 0x7f653c003f60 2024-09-16T01:56:10.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.725+0000 7f6559d31640 1 -- 172.21.15.42:0/550982336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f655406d9f0 con 0x7f653c003f60 2024-09-16T01:56:10.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.726+0000 7f653bfff640 1 -- 172.21.15.42:0/550982336 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f654400d6d0 con 0x7f653c003f60 2024-09-16T01:56:10.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.726+0000 7f653bfff640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f654006c2b0 0x7f654006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:10.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.726+0000 7f653bfff640 1 -- 172.21.15.42:0/550982336 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f654408b310 con 0x7f653c003f60 2024-09-16T01:56:10.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.726+0000 7f6552ffd640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f654006c2b0 0x7f654006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:10.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.727+0000 7f6552ffd640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f654006c2b0 0x7f654006e770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6548033000 tx=0x7f654802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:10.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.730+0000 7f653bfff640 1 -- 172.21.15.42:0/550982336 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65440598f0 con 0x7f653c003f60 2024-09-16T01:56:10.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.942+0000 7f6559d31640 1 -- 172.21.15.42:0/550982336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65540b3cb0 con 0x7f653c003f60 2024-09-16T01:56:10.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.942+0000 7f653bfff640 1 -- 172.21.15.42:0/550982336 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5225 (secure 0 0 0) 0x7f65440591f0 con 0x7f653c003f60 2024-09-16T01:56:10.944 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:10.944 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-09-16T01:55:59:851792+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3210303754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3210303754},{"type":"v1","addr":"172.21.15.42:6833","nonce":3210303754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/628179225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":628179225},{"type":"v1","addr":"172.21.15.107:6837","nonce":628179225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3586378815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3586378815},{"type":"v1","addr":"172.21.15.42:6835","nonce":3586378815}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:57.021180+0000","modified":"2024-09-16T01:55:59.200652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34817":{"gid":34817,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6836/19167184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":19167184},{"type":"v1","addr":"172.21.15.107:6836","nonce":19167184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34817,"qdb_cluster":[34817]},"id":3}]} 2024-09-16T01:56:10.944 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-09-16T01:56:10.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.944+0000 7f6559d31640 1 -- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f654006c2b0 msgr2=0x7f654006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.944+0000 7f6559d31640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f654006c2b0 0x7f654006e770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6548033000 tx=0x7f654802e000 comp rx=0 tx=0).stop 2024-09-16T01:56:10.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.944+0000 7f6559d31640 1 -- 172.21.15.42:0/550982336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 msgr2=0x7f65541f4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:10.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.944+0000 7f6559d31640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 0x7f65541f4660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f654400f820 tx=0x7f654400fce0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.944+0000 7f6559d31640 1 -- 172.21.15.42:0/550982336 shutdown_connections 2024-09-16T01:56:10.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.944+0000 7f6559d31640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f654006c2b0 0x7f654006e770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.944+0000 7f6559d31640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f655409e2e0 0x7f655409e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.944+0000 7f6559d31640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6554159b70 0x7f65540a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.944+0000 7f6559d31640 1 --2- 172.21.15.42:0/550982336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c003f60 0x7f65541f4660 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:10.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.944+0000 7f6559d31640 1 -- 172.21.15.42:0/550982336 >> 172.21.15.42:0/550982336 conn(0x7f65540d44f0 msgr2=0x7f65540b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:10.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.945+0000 7f6559d31640 1 -- 172.21.15.42:0/550982336 shutdown_connections 2024-09-16T01:56:10.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:10.945+0000 7f6559d31640 1 -- 172.21.15.42:0/550982336 wait complete. 2024-09-16T01:56:10.957 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:56:11.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.060+0000 7f6378096640 1 Processor -- start 2024-09-16T01:56:11.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.060+0000 7f6378096640 1 -- start start 2024-09-16T01:56:11.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6378096640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f637015e760 0x7f637006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6378096640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f63700d4fd0 0x7f63700cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6378096640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63700d2700 con 0x7f63700b3650 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6378096640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f63700cedb0 con 0x7f63700d4fd0 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6378096640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f63700cf090 con 0x7f637015e760 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6375631640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f63700d4fd0 0x7f63700cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6375e32640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f637015e760 0x7f637006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6375631640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f63700d4fd0 0x7f63700cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.42:49428/0 (socket says 172.21.15.42:49428) 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6375e32640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f637015e760 0x7f637006cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.42:54646/0 (socket says 172.21.15.42:54646) 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6375631640 1 -- 172.21.15.42:0/1835754398 learned_addr learned my addr 172.21.15.42:0/1835754398 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.061+0000 7f6376633640 1 --1- 172.21.15.42:0/1835754398 >> v1:172.21.15.107:6789/0 conn(0x7f63700b3650 0x7f63700d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:54328/0 (socket says 172.21.15.42:54328) 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.062+0000 7f6375e32640 1 -- 172.21.15.42:0/1835754398 >> v2:172.21.15.107:3300/0 conn(0x7f63700d4fd0 msgr2=0x7f63700cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.062+0000 7f6375e32640 1 --2- 172.21.15.42:0/1835754398 >> v2:172.21.15.107:3300/0 conn(0x7f63700d4fd0 0x7f63700cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.062+0000 7f6375e32640 1 -- 172.21.15.42:0/1835754398 >> v1:172.21.15.107:6789/0 conn(0x7f63700b3650 legacy=0x7f63700d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.062+0000 7f6375e32640 1 -- 172.21.15.42:0/1835754398 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63700b3c80 con 0x7f637015e760 2024-09-16T01:56:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.062+0000 7f6375631640 1 --2- 172.21.15.42:0/1835754398 >> v2:172.21.15.107:3300/0 conn(0x7f63700d4fd0 0x7f63700cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:56:11.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.062+0000 7f6375e32640 1 --2- 172.21.15.42:0/1835754398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f637015e760 0x7f637006cdd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f636c0097a0 tx=0x7f636c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf6ee94917ab89a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:11.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6374e30640 1 -- 172.21.15.42:0/1835754398 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c037070 con 0x7f637015e760 2024-09-16T01:56:11.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6374e30640 1 -- 172.21.15.42:0/1835754398 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636c02ae50 con 0x7f637015e760 2024-09-16T01:56:11.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6374e30640 1 -- 172.21.15.42:0/1835754398 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c032660 con 0x7f637015e760 2024-09-16T01:56:11.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6378096640 1 -- 172.21.15.42:0/1835754398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f637015e760 msgr2=0x7f637006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6378096640 1 --2- 172.21.15.42:0/1835754398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f637015e760 0x7f637006cdd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f636c0097a0 tx=0x7f636c02a100 comp rx=0 tx=0).stop 2024-09-16T01:56:11.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6378096640 1 -- 172.21.15.42:0/1835754398 shutdown_connections 2024-09-16T01:56:11.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6378096640 1 --2- 172.21.15.42:0/1835754398 >> v2:172.21.15.107:3300/0 conn(0x7f63700d4fd0 0x7f63700cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6378096640 1 --2- 172.21.15.42:0/1835754398 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f637015e760 0x7f637006cdd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6378096640 1 -- 172.21.15.42:0/1835754398 >> 172.21.15.42:0/1835754398 conn(0x7f637008bfc0 msgr2=0x7f63700d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:11.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6378096640 1 -- 172.21.15.42:0/1835754398 shutdown_connections 2024-09-16T01:56:11.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.063+0000 7f6378096640 1 -- 172.21.15.42:0/1835754398 wait complete. 2024-09-16T01:56:11.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.064+0000 7f6378096640 1 Processor -- start 2024-09-16T01:56:11.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6378096640 1 -- start start 2024-09-16T01:56:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6378096640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63700b3650 0x7f6370156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6378096640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63700d4fd0 0x7f6370155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6378096640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637015e760 0x7f63700cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6378096640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f63700cfe80 con 0x7f637015e760 2024-09-16T01:56:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6378096640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f63700cfd00 con 0x7f63700d4fd0 2024-09-16T01:56:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6378096640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f63700d35b0 con 0x7f63700b3650 2024-09-16T01:56:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6376633640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637015e760 0x7f63700cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6376633640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637015e760 0x7f63700cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47616/0 (socket says 172.21.15.42:47616) 2024-09-16T01:56:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6376633640 1 -- 172.21.15.42:0/3947305435 learned_addr learned my addr 172.21.15.42:0/3947305435 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6375e32640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63700b3650 0x7f6370156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.065+0000 7f6375631640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63700d4fd0 0x7f6370155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f6376633640 1 -- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63700b3650 msgr2=0x7f6370156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f6376633640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63700b3650 0x7f6370156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f6376633640 1 -- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63700d4fd0 msgr2=0x7f6370155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f6376633640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63700d4fd0 0x7f6370155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f6376633640 1 -- 172.21.15.42:0/3947305435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6370156360 con 0x7f637015e760 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f6376633640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637015e760 0x7f63700cdb20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f636800c6b0 tx=0x7f636800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f63667fc640 1 -- 172.21.15.42:0/3947305435 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6368018070 con 0x7f637015e760 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f63667fc640 1 -- 172.21.15.42:0/3947305435 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6368004d60 con 0x7f637015e760 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f63667fc640 1 -- 172.21.15.42:0/3947305435 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636800a860 con 0x7f637015e760 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f6378096640 1 -- 172.21.15.42:0/3947305435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63700ce370 con 0x7f637015e760 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.066+0000 7f6378096640 1 -- 172.21.15.42:0/3947305435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63700b8070 con 0x7f637015e760 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.067+0000 7f6378096640 1 -- 172.21.15.42:0/3947305435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63700d3980 con 0x7f637015e760 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.067+0000 7f63667fc640 1 -- 172.21.15.42:0/3947305435 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f636801b070 con 0x7f637015e760 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.068+0000 7f63667fc640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f635406c2b0 0x7f635406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.068+0000 7f63667fc640 1 -- 172.21.15.42:0/3947305435 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f636808a9c0 con 0x7f637015e760 2024-09-16T01:56:11.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.068+0000 7f6375e32640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f635406c2b0 0x7f635406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.069+0000 7f6375e32640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f635406c2b0 0x7f635406e770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f636c034000 tx=0x7f636c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:11.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.072+0000 7f63667fc640 1 -- 172.21.15.42:0/3947305435 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f636808ce20 con 0x7f637015e760 2024-09-16T01:56:11.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.281+0000 7f6378096640 1 -- 172.21.15.42:0/3947305435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63700b6d20 con 0x7f637015e760 2024-09-16T01:56:11.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.282+0000 7f63667fc640 1 -- 172.21.15.42:0/3947305435 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5225 (secure 0 0 0) 0x7f63700d2700 con 0x7f637015e760 2024-09-16T01:56:11.283 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:11.283 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"btime":"2024-09-16T01:55:59:851792+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3210303754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3210303754},{"type":"v1","addr":"172.21.15.42:6833","nonce":3210303754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/628179225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":628179225},{"type":"v1","addr":"172.21.15.107:6837","nonce":628179225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3586378815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3586378815},{"type":"v1","addr":"172.21.15.42:6835","nonce":3586378815}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:55:57.021180+0000","modified":"2024-09-16T01:55:59.200652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34817":{"gid":34817,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6836/19167184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":19167184},{"type":"v1","addr":"172.21.15.107:6836","nonce":19167184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34817,"qdb_cluster":[34817]},"id":3}]} 2024-09-16T01:56:11.284 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-09-16T01:56:11.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.283+0000 7f6378096640 1 -- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f635406c2b0 msgr2=0x7f635406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.283+0000 7f6378096640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f635406c2b0 0x7f635406e770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f636c034000 tx=0x7f636c02e000 comp rx=0 tx=0).stop 2024-09-16T01:56:11.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.283+0000 7f6378096640 1 -- 172.21.15.42:0/3947305435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637015e760 msgr2=0x7f63700cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.283+0000 7f6378096640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637015e760 0x7f63700cdb20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f636800c6b0 tx=0x7f636800cb70 comp rx=0 tx=0).stop 2024-09-16T01:56:11.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.284+0000 7f6378096640 1 -- 172.21.15.42:0/3947305435 shutdown_connections 2024-09-16T01:56:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.284+0000 7f6378096640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f635406c2b0 0x7f635406e770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.284+0000 7f6378096640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f637015e760 0x7f63700cdb20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.284+0000 7f6378096640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63700d4fd0 0x7f6370155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.284+0000 7f6378096640 1 --2- 172.21.15.42:0/3947305435 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63700b3650 0x7f6370156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.284+0000 7f6378096640 1 -- 172.21.15.42:0/3947305435 >> 172.21.15.42:0/3947305435 conn(0x7f637008bfc0 msgr2=0x7f63700b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.284+0000 7f6378096640 1 -- 172.21.15.42:0/3947305435 shutdown_connections 2024-09-16T01:56:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.284+0000 7f6378096640 1 -- 172.21.15.42:0/3947305435 wait complete. 2024-09-16T01:56:11.296 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:56:11.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.396+0000 7f1bb7edd640 1 Processor -- start 2024-09-16T01:56:11.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.397+0000 7f1bb7edd640 1 -- start start 2024-09-16T01:56:11.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.397+0000 7f1bb7edd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1bb015e990 0x7f1bb00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.397+0000 7f1bb7edd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb00ae140 0x7f1bb00ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.397+0000 7f1bb7edd640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb00aeb10 con 0x7f1bb015e5b0 2024-09-16T01:56:11.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.397+0000 7f1bb7edd640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb00b2c30 con 0x7f1bb015e990 2024-09-16T01:56:11.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.397+0000 7f1bb7edd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb00b17f0 con 0x7f1bb00ae140 2024-09-16T01:56:11.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.397+0000 7f1bb5c79640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1bb015e5b0 0x7f1bb00b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54336/0 (socket says 172.21.15.42:54336) 2024-09-16T01:56:11.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb5c79640 1 -- 172.21.15.42:0/1054868336 learned_addr learned my addr 172.21.15.42:0/1054868336 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:11.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1889180898 0 0) 0x7f1bb00aeb10 con 0x7f1bb015e5b0 2024-09-16T01:56:11.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb5478640 1 --2- 172.21.15.42:0/1054868336 >> v2:172.21.15.107:3300/0 conn(0x7f1bb015e990 0x7f1bb00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb647a640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb00ae140 0x7f1bb00ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b98003520 con 0x7f1bb015e5b0 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4287022004 0 0) 0x7f1b98003520 con 0x7f1bb015e5b0 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb00ae140 msgr2=0x7f1bb00ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb00ae140 0x7f1bb00ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 >> v2:172.21.15.107:3300/0 conn(0x7f1bb015e990 msgr2=0x7f1bb00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 --2- 172.21.15.42:0/1054868336 >> v2:172.21.15.107:3300/0 conn(0x7f1bb015e990 0x7f1bb00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb00b6520 con 0x7f1bb015e5b0 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f1ba8001670 con 0x7f1bb015e5b0 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 >> v1:172.21.15.42:6789/0 conn(0x7f1bb015e5b0 legacy=0x7f1bb00b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b980039b0 0x7f1b98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb00ae140 0x7f1b98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b98004d40 0x7f1b980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb00b2c30 con 0x7f1b98004d40 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb00b17f0 con 0x7f1b980039b0 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9800b9c0 con 0x7f1bb00ae140 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb647a640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b98004d40 0x7f1b980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb5c79640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b980039b0 0x7f1b98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.398+0000 7f1bb5478640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb00ae140 0x7f1b98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.399+0000 7f1bb647a640 1 -- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb00ae140 msgr2=0x7f1b98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.399+0000 7f1bb647a640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb00ae140 0x7f1b98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.399+0000 7f1bb647a640 1 -- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b980039b0 msgr2=0x7f1b98003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.399+0000 7f1bb647a640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b980039b0 0x7f1b98003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.399+0000 7f1bb647a640 1 -- 172.21.15.42:0/1054868336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b98003520 con 0x7f1b98004d40 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.399+0000 7f1bb5478640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb00ae140 0x7f1b98004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.399+0000 7f1bb647a640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b98004d40 0x7f1b980051c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000e170 tx=0x7f1b98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a3a228bb4af780 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:11.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.399+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0034020 con 0x7f1b98004d40 2024-09-16T01:56:11.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.399+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba00305f0 con 0x7f1b98004d40 2024-09-16T01:56:11.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.399+0000 7f1bb4c77640 1 -- 172.21.15.42:0/1054868336 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0009c10 con 0x7f1b98004d40 2024-09-16T01:56:11.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.400+0000 7f1bb7edd640 1 -- 172.21.15.42:0/1054868336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b98004d40 msgr2=0x7f1b980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.400+0000 7f1bb7edd640 1 --2- 172.21.15.42:0/1054868336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b98004d40 0x7f1b980051c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000e170 tx=0x7f1b98005830 comp rx=0 tx=0).stop 2024-09-16T01:56:11.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.400+0000 7f1bb647a640 1 -- 172.21.15.42:0/1054868336 reap_dead start 2024-09-16T01:56:11.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.400+0000 7f1bb7edd640 1 -- 172.21.15.42:0/1054868336 shutdown_connections 2024-09-16T01:56:11.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.400+0000 7f1bb7edd640 1 -- 172.21.15.42:0/1054868336 >> 172.21.15.42:0/1054868336 conn(0x7f1bb0073490 msgr2=0x7f1bb00b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:11.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.400+0000 7f1bb7edd640 1 -- 172.21.15.42:0/1054868336 shutdown_connections 2024-09-16T01:56:11.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.400+0000 7f1bb7edd640 1 -- 172.21.15.42:0/1054868336 wait complete. 2024-09-16T01:56:11.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.401+0000 7f1bb7edd640 1 Processor -- start 2024-09-16T01:56:11.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.401+0000 7f1bb7edd640 1 -- start start 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb7edd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b98004d40 0x7f1bb006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb7edd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb01f48a0 0x7f1bb0151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb7edd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb01f4d20 0x7f1bb0151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb7edd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb00b2000 con 0x7f1bb01f48a0 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb7edd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb00b1d20 con 0x7f1b98004d40 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb7edd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb00b0490 con 0x7f1bb01f4d20 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb5478640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb01f48a0 0x7f1bb0151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb5478640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb01f48a0 0x7f1bb0151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47632/0 (socket says 172.21.15.42:47632) 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb5478640 1 -- 172.21.15.42:0/3403675735 learned_addr learned my addr 172.21.15.42:0/3403675735 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb5c79640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b98004d40 0x7f1bb006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.402+0000 7f1bb647a640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb01f4d20 0x7f1bb0151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bb5478640 1 -- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb01f4d20 msgr2=0x7f1bb0151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bb5478640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb01f4d20 0x7f1bb0151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bb5478640 1 -- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b98004d40 msgr2=0x7f1bb006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bb5478640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b98004d40 0x7f1bb006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bb5478640 1 -- 172.21.15.42:0/3403675735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb0151ea0 con 0x7f1bb01f48a0 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bb5478640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb01f48a0 0x7f1bb0151420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40116d0 tx=0x7f1ba4011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bae7fc640 1 -- 172.21.15.42:0/3403675735 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400f9c0 con 0x7f1bb01f48a0 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bae7fc640 1 -- 172.21.15.42:0/3403675735 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba400fb60 con 0x7f1bb01f48a0 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bb7edd640 1 -- 172.21.15.42:0/3403675735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb0160390 con 0x7f1bb01f48a0 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bae7fc640 1 -- 172.21.15.42:0/3403675735 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4015460 con 0x7f1bb01f48a0 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.403+0000 7f1bb7edd640 1 -- 172.21.15.42:0/3403675735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb0160950 con 0x7f1bb01f48a0 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.404+0000 7f1bb7edd640 1 -- 172.21.15.42:0/3403675735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb00b5f40 con 0x7f1bb01f48a0 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.404+0000 7f1bae7fc640 1 -- 172.21.15.42:0/3403675735 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1ba4015600 con 0x7f1bb01f48a0 2024-09-16T01:56:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.405+0000 7f1bae7fc640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b9c06c2b0 0x7f1b9c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.405+0000 7f1bae7fc640 1 -- 172.21.15.42:0/3403675735 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f1ba408be00 con 0x7f1bb01f48a0 2024-09-16T01:56:11.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.405+0000 7f1bb5c79640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b9c06c2b0 0x7f1b9c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.406+0000 7f1bb5c79640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b9c06c2b0 0x7f1b9c06e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0070940 tx=0x7f1ba8007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:11.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.409+0000 7f1bae7fc640 1 -- 172.21.15.42:0/3403675735 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ba4019030 con 0x7f1bb01f48a0 2024-09-16T01:56:11.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.583+0000 7f1bb7edd640 1 -- 172.21.15.42:0/3403675735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bb00aeaa0 con 0x7f1bb01f48a0 2024-09-16T01:56:11.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.585+0000 7f1bae7fc640 1 -- 172.21.15.42:0/3403675735 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16990 (secure 0 0 0) 0x7f1ba4059d90 con 0x7f1bb01f48a0 2024-09-16T01:56:11.586 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:11.586 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":50,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:55:58.669116+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:55:54.676980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-16T01:55:56.007224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:56:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.586+0000 7f1bb7edd640 1 -- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b9c06c2b0 msgr2=0x7f1b9c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.586+0000 7f1bb7edd640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b9c06c2b0 0x7f1b9c06e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0070940 tx=0x7f1ba8007970 comp rx=0 tx=0).stop 2024-09-16T01:56:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.586+0000 7f1bb7edd640 1 -- 172.21.15.42:0/3403675735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb01f48a0 msgr2=0x7f1bb0151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.586+0000 7f1bb7edd640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb01f48a0 0x7f1bb0151420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40116d0 tx=0x7f1ba4011b90 comp rx=0 tx=0).stop 2024-09-16T01:56:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.587+0000 7f1bb7edd640 1 -- 172.21.15.42:0/3403675735 shutdown_connections 2024-09-16T01:56:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.587+0000 7f1bb7edd640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f1b9c06c2b0 0x7f1b9c06e770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.587+0000 7f1bb7edd640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1bb01f4d20 0x7f1bb0151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.587+0000 7f1bb7edd640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb01f48a0 0x7f1bb0151420 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.587+0000 7f1bb7edd640 1 --2- 172.21.15.42:0/3403675735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1b98004d40 0x7f1bb006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.587+0000 7f1bb7edd640 1 -- 172.21.15.42:0/3403675735 >> 172.21.15.42:0/3403675735 conn(0x7f1bb0073490 msgr2=0x7f1bb00b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.587+0000 7f1bb7edd640 1 -- 172.21.15.42:0/3403675735 shutdown_connections 2024-09-16T01:56:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.587+0000 7f1bb7edd640 1 -- 172.21.15.42:0/3403675735 wait complete. 2024-09-16T01:56:11.599 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:56:11.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.700+0000 7ff11eea5640 1 Processor -- start 2024-09-16T01:56:11.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.700+0000 7ff11eea5640 1 -- start start 2024-09-16T01:56:11.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.701+0000 7ff11eea5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff118161c80 0x7ff11806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.701+0000 7ff11eea5640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11806e870 con 0x7ff118162060 2024-09-16T01:56:11.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.701+0000 7ff11eea5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11806d9f0 con 0x7ff1180b6680 2024-09-16T01:56:11.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.701+0000 7ff11eea5640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff11806dcd0 con 0x7ff118161c80 2024-09-16T01:56:11.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.701+0000 7ff11cc41640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff118161c80 0x7ff11806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.701+0000 7ff117fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff118162060 0x7ff1180b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54352/0 (socket says 172.21.15.42:54352) 2024-09-16T01:56:11.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.701+0000 7ff11cc41640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff118161c80 0x7ff11806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47640/0 (socket says 172.21.15.42:47640) 2024-09-16T01:56:11.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.701+0000 7ff117fff640 1 -- 172.21.15.42:0/3208824921 learned_addr learned my addr 172.21.15.42:0/3208824921 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:11.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.702+0000 7ff11cc41640 1 -- 172.21.15.42:0/3208824921 >> v1:172.21.15.107:6789/0 conn(0x7ff1180b6680 legacy=0x7ff1180cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:11.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.702+0000 7ff11cc41640 1 -- 172.21.15.42:0/3208824921 >> v1:172.21.15.42:6789/0 conn(0x7ff118162060 legacy=0x7ff1180b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.702+0000 7ff11cc41640 1 -- 172.21.15.42:0/3208824921 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11806dfb0 con 0x7ff118161c80 2024-09-16T01:56:11.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.702+0000 7ff11cc41640 1 --2- 172.21.15.42:0/3208824921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118161c80 0x7ff11806e330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff110009d90 tx=0x7ff11002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378937f3c54cc4cc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:11.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.703+0000 7ff1177fe640 1 -- 172.21.15.42:0/3208824921 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110007740 con 0x7ff118161c80 2024-09-16T01:56:11.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.703+0000 7ff1177fe640 1 -- 172.21.15.42:0/3208824921 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1100078e0 con 0x7ff118161c80 2024-09-16T01:56:11.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.703+0000 7ff1177fe640 1 -- 172.21.15.42:0/3208824921 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110007cb0 con 0x7ff118161c80 2024-09-16T01:56:11.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.703+0000 7ff11eea5640 1 -- 172.21.15.42:0/3208824921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118161c80 msgr2=0x7ff11806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.703+0000 7ff11eea5640 1 --2- 172.21.15.42:0/3208824921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118161c80 0x7ff11806e330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff110009d90 tx=0x7ff11002a6a0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.703+0000 7ff11eea5640 1 -- 172.21.15.42:0/3208824921 shutdown_connections 2024-09-16T01:56:11.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.703+0000 7ff11eea5640 1 --2- 172.21.15.42:0/3208824921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118161c80 0x7ff11806e330 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.703+0000 7ff11eea5640 1 -- 172.21.15.42:0/3208824921 >> 172.21.15.42:0/3208824921 conn(0x7ff1180d44f0 msgr2=0x7ff1180d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:11.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.703+0000 7ff11eea5640 1 -- 172.21.15.42:0/3208824921 shutdown_connections 2024-09-16T01:56:11.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.703+0000 7ff11eea5640 1 -- 172.21.15.42:0/3208824921 wait complete. 2024-09-16T01:56:11.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.704+0000 7ff11eea5640 1 Processor -- start 2024-09-16T01:56:11.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.704+0000 7ff11eea5640 1 -- start start 2024-09-16T01:56:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.705+0000 7ff11eea5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180b6680 0x7ff1180ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.705+0000 7ff11eea5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff118161c80 0x7ff11815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.705+0000 7ff11eea5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118162060 0x7ff1180b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.705+0000 7ff11eea5640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1180b6b30 con 0x7ff118162060 2024-09-16T01:56:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.705+0000 7ff11eea5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff1180d2aa0 con 0x7ff1180b6680 2024-09-16T01:56:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.705+0000 7ff11eea5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff1180b6cb0 con 0x7ff118161c80 2024-09-16T01:56:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.705+0000 7ff11d442640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118162060 0x7ff1180b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.705+0000 7ff11d442640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118162060 0x7ff1180b9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47646/0 (socket says 172.21.15.42:47646) 2024-09-16T01:56:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.705+0000 7ff11d442640 1 -- 172.21.15.42:0/2742842896 learned_addr learned my addr 172.21.15.42:0/2742842896 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:11.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff117fff640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff118161c80 0x7ff11815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff11cc41640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180b6680 0x7ff1180ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff11d442640 1 -- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff118161c80 msgr2=0x7ff11815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff11d442640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff118161c80 0x7ff11815c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff11d442640 1 -- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180b6680 msgr2=0x7ff1180ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff11d442640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180b6680 0x7ff1180ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff11d442640 1 -- 172.21.15.42:0/2742842896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11815cae0 con 0x7ff118162060 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff11d442640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118162060 0x7ff1180b9c00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff10800b410 tx=0x7ff10800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff1157fa640 1 -- 172.21.15.42:0/2742842896 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108015030 con 0x7ff118162060 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff1157fa640 1 -- 172.21.15.42:0/2742842896 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff108004020 con 0x7ff118162060 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff11eea5640 1 -- 172.21.15.42:0/2742842896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1180b8b60 con 0x7ff118162060 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff1157fa640 1 -- 172.21.15.42:0/2742842896 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108004410 con 0x7ff118162060 2024-09-16T01:56:11.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.706+0000 7ff11eea5640 1 -- 172.21.15.42:0/2742842896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1180b9120 con 0x7ff118162060 2024-09-16T01:56:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.707+0000 7ff11eea5640 1 -- 172.21.15.42:0/2742842896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11806e330 con 0x7ff118162060 2024-09-16T01:56:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.708+0000 7ff1157fa640 1 -- 172.21.15.42:0/2742842896 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff108018070 con 0x7ff118162060 2024-09-16T01:56:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.708+0000 7ff1157fa640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff10406c2b0 0x7ff10406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.708+0000 7ff1157fa640 1 -- 172.21.15.42:0/2742842896 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7ff10808afb0 con 0x7ff118162060 2024-09-16T01:56:11.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.708+0000 7ff11cc41640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff10406c2b0 0x7ff10406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.709+0000 7ff11cc41640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff10406c2b0 0x7ff10406e770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff110034000 tx=0x7ff11002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.712+0000 7ff1157fa640 1 -- 172.21.15.42:0/2742842896 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff108058eb0 con 0x7ff118162060 2024-09-16T01:56:11.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.924+0000 7ff11eea5640 1 -- 172.21.15.42:0/2742842896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff1180d2cf0 con 0x7ff118162060 2024-09-16T01:56:11.926 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-16T01:56:11.925+0000 7fafb4c25640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:56:11.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.926+0000 7ff1157fa640 1 -- 172.21.15.42:0/2742842896 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) ==== 161+0+0 (secure 0 0 0) 0x7ff10805d1b0 con 0x7ff118162060 2024-09-16T01:56:11.927 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:56:11.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 -- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff10406c2b0 msgr2=0x7ff10406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff10406c2b0 0x7ff10406e770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff110034000 tx=0x7ff11002f000 comp rx=0 tx=0).stop 2024-09-16T01:56:11.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 -- 172.21.15.42:0/2742842896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118162060 msgr2=0x7ff1180b9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:11.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118162060 0x7ff1180b9c00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff10800b410 tx=0x7ff10800b8d0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 -- 172.21.15.42:0/2742842896 shutdown_connections 2024-09-16T01:56:11.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff10406c2b0 0x7ff10406e770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff118162060 0x7ff1180b9c00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff118161c80 0x7ff11815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 --2- 172.21.15.42:0/2742842896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1180b6680 0x7ff1180ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:11.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 -- 172.21.15.42:0/2742842896 >> 172.21.15.42:0/2742842896 conn(0x7ff1180d44f0 msgr2=0x7ff1180b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:11.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 -- 172.21.15.42:0/2742842896 shutdown_connections 2024-09-16T01:56:11.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:11.929+0000 7ff11eea5640 1 -- 172.21.15.42:0/2742842896 wait complete. 2024-09-16T01:56:11.934 INFO:tasks.ceph.mds.b.smithi107.stderr: -4191> 2024-09-16T01:56:02.621+0000 7f1192f5a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:56:11.942 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:56:11.965 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-09-16T01:56:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.046+0000 7f444b253640 1 Processor -- start 2024-09-16T01:56:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.046+0000 7f444b253640 1 -- start start 2024-09-16T01:56:12.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.047+0000 7f444b253640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f444415e640 0x7f44440d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:12.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.047+0000 7f444b253640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f44441621b0 0x7f4444162620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:12.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.047+0000 7f444b253640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44440d0110 con 0x7f44440d5100 2024-09-16T01:56:12.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.047+0000 7f444b253640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f4444162b60 con 0x7f44441621b0 2024-09-16T01:56:12.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.047+0000 7f444b253640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f44440d3a60 con 0x7f444415e640 2024-09-16T01:56:12.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.047+0000 7f44497f0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f44441621b0 0x7f4444162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:12.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.047+0000 7f4443fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f44440d5100 0x7f44440cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54358/0 (socket says 172.21.15.42:54358) 2024-09-16T01:56:12.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.047+0000 7f4443fff640 1 -- 172.21.15.42:0/553519407 learned_addr learned my addr 172.21.15.42:0/553519407 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:12.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.047+0000 7f4448fef640 1 --2- 172.21.15.42:0/553519407 >> v2:172.21.15.107:3300/0 conn(0x7f444415e640 0x7f44440d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:12.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.048+0000 7f44497f0640 1 -- 172.21.15.42:0/553519407 >> v2:172.21.15.107:3300/0 conn(0x7f444415e640 msgr2=0x7f44440d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:12.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.048+0000 7f44497f0640 1 --2- 172.21.15.42:0/553519407 >> v2:172.21.15.107:3300/0 conn(0x7f444415e640 0x7f44440d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:12.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.048+0000 7f44497f0640 1 -- 172.21.15.42:0/553519407 >> v1:172.21.15.42:6789/0 conn(0x7f44440d5100 legacy=0x7f44440cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:12.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.048+0000 7f44497f0640 1 -- 172.21.15.42:0/553519407 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44440cec40 con 0x7f44441621b0 2024-09-16T01:56:12.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.048+0000 7f4448fef640 1 --2- 172.21.15.42:0/553519407 >> v2:172.21.15.107:3300/0 conn(0x7f444415e640 0x7f44440d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:56:12.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.048+0000 7f44497f0640 1 --2- 172.21.15.42:0/553519407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 0x7f4444162620 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f444408c6f0 tx=0x7f443c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be80736dcc357865 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:12.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.048+0000 7f44437fe640 1 -- 172.21.15.42:0/553519407 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c007740 con 0x7f44441621b0 2024-09-16T01:56:12.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.048+0000 7f44437fe640 1 -- 172.21.15.42:0/553519407 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443c0078e0 con 0x7f44441621b0 2024-09-16T01:56:12.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.048+0000 7f44437fe640 1 -- 172.21.15.42:0/553519407 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c007cb0 con 0x7f44441621b0 2024-09-16T01:56:12.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.049+0000 7f444b253640 1 -- 172.21.15.42:0/553519407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 msgr2=0x7f4444162620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.049+0000 7f444b253640 1 --2- 172.21.15.42:0/553519407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 0x7f4444162620 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f444408c6f0 tx=0x7f443c02a710 comp rx=0 tx=0).stop 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.049+0000 7f444b253640 1 -- 172.21.15.42:0/553519407 shutdown_connections 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.049+0000 7f444b253640 1 --2- 172.21.15.42:0/553519407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 0x7f4444162620 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.049+0000 7f444b253640 1 --2- 172.21.15.42:0/553519407 >> v2:172.21.15.107:3300/0 conn(0x7f444415e640 0x7f44440d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.049+0000 7f444b253640 1 -- 172.21.15.42:0/553519407 >> 172.21.15.42:0/553519407 conn(0x7f444408bfc0 msgr2=0x7f44440d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.049+0000 7f444b253640 1 -- 172.21.15.42:0/553519407 shutdown_connections 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.049+0000 7f444b253640 1 -- 172.21.15.42:0/553519407 wait complete. 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.050+0000 7f444b253640 1 Processor -- start 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.050+0000 7f444b253640 1 -- start start 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f444b253640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44440d5100 0x7f44441f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f444b253640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f444415e640 0x7f444415d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f444b253640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 0x7f44440b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:12.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f444b253640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44440cf4e0 con 0x7f44441621b0 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f444b253640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f44440cf200 con 0x7f44440d5100 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f444b253640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f444415ea20 con 0x7f444415e640 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f44497f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 0x7f44440b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f44497f0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 0x7f44440b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47664/0 (socket says 172.21.15.42:47664) 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f44497f0640 1 -- 172.21.15.42:0/2339494717 learned_addr learned my addr 172.21.15.42:0/2339494717 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f4448fef640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44440d5100 0x7f44441f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f4443fff640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f444415e640 0x7f444415d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f44497f0640 1 -- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f444415e640 msgr2=0x7f444415d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f44497f0640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f444415e640 0x7f444415d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f44497f0640 1 -- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44440d5100 msgr2=0x7f44441f84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.051+0000 7f44497f0640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44440d5100 0x7f44441f84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.052+0000 7f44497f0640 1 -- 172.21.15.42:0/2339494717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44441f8a10 con 0x7f44441621b0 2024-09-16T01:56:12.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.052+0000 7f44497f0640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 0x7f44440b5270 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f443c02ad00 tx=0x7f443c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:12.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.052+0000 7f44417fa640 1 -- 172.21.15.42:0/2339494717 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c040070 con 0x7f44441621b0 2024-09-16T01:56:12.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.052+0000 7f44417fa640 1 -- 172.21.15.42:0/2339494717 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443c031c90 con 0x7f44441621b0 2024-09-16T01:56:12.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.052+0000 7f444b253640 1 -- 172.21.15.42:0/2339494717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44440cd190 con 0x7f44441621b0 2024-09-16T01:56:12.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.052+0000 7f44417fa640 1 -- 172.21.15.42:0/2339494717 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c045680 con 0x7f44441621b0 2024-09-16T01:56:12.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.052+0000 7f444b253640 1 -- 172.21.15.42:0/2339494717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44440cd750 con 0x7f44441621b0 2024-09-16T01:56:12.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.053+0000 7f444b253640 1 -- 172.21.15.42:0/2339494717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4444162620 con 0x7f44441621b0 2024-09-16T01:56:12.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.053+0000 7f44417fa640 1 -- 172.21.15.42:0/2339494717 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f443c039040 con 0x7f44441621b0 2024-09-16T01:56:12.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.054+0000 7f44417fa640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f443006c2e0 0x7f443006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:12.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.054+0000 7f44417fa640 1 -- 172.21.15.42:0/2339494717 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6187+0+0 (secure 0 0 0) 0x7f443c0acfb0 con 0x7f44441621b0 2024-09-16T01:56:12.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.054+0000 7f4448fef640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f443006c2e0 0x7f443006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:12.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.055+0000 7f4448fef640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f443006c2e0 0x7f443006e7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f443400a950 tx=0x7f4434008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:12.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.058+0000 7f44417fa640 1 -- 172.21.15.42:0/2339494717 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44441f8a10 con 0x7f44441621b0 2024-09-16T01:56:12.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.269+0000 7f444b253640 1 -- 172.21.15.42:0/2339494717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f444408c4d0 con 0x7f44441621b0 2024-09-16T01:56:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.928+0000 7f44417fa640 1 -- 172.21.15.42:0/2339494717 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f443c043360 con 0x7f44441621b0 2024-09-16T01:56:12.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.930+0000 7f444b253640 1 -- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f443006c2e0 msgr2=0x7f443006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:12.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.930+0000 7f444b253640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f443006c2e0 0x7f443006e7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f443400a950 tx=0x7f4434008040 comp rx=0 tx=0).stop 2024-09-16T01:56:12.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.930+0000 7f444b253640 1 -- 172.21.15.42:0/2339494717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 msgr2=0x7f44440b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:12.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.930+0000 7f444b253640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 0x7f44440b5270 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f443c02ad00 tx=0x7f443c004a40 comp rx=0 tx=0).stop 2024-09-16T01:56:12.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.930+0000 7f444b253640 1 -- 172.21.15.42:0/2339494717 shutdown_connections 2024-09-16T01:56:12.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.930+0000 7f444b253640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f443006c2e0 0x7f443006e7a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:12.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.930+0000 7f444b253640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44441621b0 0x7f44440b5270 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:12.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.930+0000 7f444b253640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f444415e640 0x7f444415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:12.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.930+0000 7f444b253640 1 --2- 172.21.15.42:0/2339494717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44440d5100 0x7f44441f84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:12.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.931+0000 7f444b253640 1 -- 172.21.15.42:0/2339494717 >> 172.21.15.42:0/2339494717 conn(0x7f444408bfc0 msgr2=0x7f44440b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:12.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.931+0000 7f444b253640 1 -- 172.21.15.42:0/2339494717 shutdown_connections 2024-09-16T01:56:12.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:12.931+0000 7f444b253640 1 -- 172.21.15.42:0/2339494717 wait complete. 2024-09-16T01:56:12.946 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:56:13.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.061+0000 7febde7cf640 1 Processor -- start 2024-09-16T01:56:13.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.061+0000 7febde7cf640 1 -- start start 2024-09-16T01:56:13.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.061+0000 7febde7cf640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd8072760 0x7febd80b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:13.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.061+0000 7febde7cf640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febd80b4620 con 0x7febd80b4020 2024-09-16T01:56:13.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.061+0000 7febde7cf640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febd80ce100 con 0x7febd815e900 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.061+0000 7febde7cf640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7febd80b4f60 con 0x7febd8072760 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd77fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7febd80b4020 0x7febd8072050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54374/0 (socket says 172.21.15.42:54374) 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd77fe640 1 -- 172.21.15.42:0/3741447486 learned_addr learned my addr 172.21.15.42:0/3741447486 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febdcd6c640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd8072760 0x7febd80b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453273424 0 0) 0x7febd80b4620 con 0x7febd80b4020 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febc0003520 con 0x7febd80b4020 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911850735 0 0) 0x7febd80ce100 con 0x7febd815e900 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febd80b4620 con 0x7febd815e900 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2314503846 0 0) 0x7febc0003520 con 0x7febd80b4020 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd8072760 msgr2=0x7febd80b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd8072760 0x7febd80b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 >> v1:172.21.15.107:6789/0 conn(0x7febd815e900 legacy=0x7febd80ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:13.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd80ce3a0 con 0x7febd80b4020 2024-09-16T01:56:13.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7febcc001670 con 0x7febd80b4020 2024-09-16T01:56:13.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febdcd6c640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd8072760 0x7febd80b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:56:13.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 >> v1:172.21.15.42:6789/0 conn(0x7febd80b4020 legacy=0x7febd8072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:13.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febc0003b70 0x7febc0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:13.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd8072760 0x7febc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:13.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 0x7febc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:13.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7febd80b4f60 con 0x7febc0004d40 2024-09-16T01:56:13.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7febc000bad0 con 0x7febc0003b70 2024-09-16T01:56:13.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7febc000bcd0 con 0x7febd8072760 2024-09-16T01:56:13.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febdcd6c640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 0x7febc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd77fe640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd8072760 0x7febc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.062+0000 7febd7fff640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febc0003b70 0x7febc0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.063+0000 7febdcd6c640 1 -- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd8072760 msgr2=0x7febc0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.063+0000 7febdcd6c640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd8072760 0x7febc0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.063+0000 7febdcd6c640 1 -- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febc0003b70 msgr2=0x7febc0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.063+0000 7febdcd6c640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febc0003b70 0x7febc0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.063+0000 7febdcd6c640 1 -- 172.21.15.42:0/3741447486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc0003520 con 0x7febc0004d40 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.063+0000 7febdcd6c640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 0x7febc00051c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7febd8071df0 tx=0x7febc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9544bc2d522b8f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.064+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0033070 con 0x7febc0004d40 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.064+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd0003b90 con 0x7febc0004d40 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.064+0000 7febd6ffd640 1 -- 172.21.15.42:0/3741447486 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0009de0 con 0x7febc0004d40 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.064+0000 7febde7cf640 1 -- 172.21.15.42:0/3741447486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 msgr2=0x7febc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:13.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.064+0000 7febde7cf640 1 --2- 172.21.15.42:0/3741447486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 0x7febc00051c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7febd8071df0 tx=0x7febc0005830 comp rx=0 tx=0).stop 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.064+0000 7febdcd6c640 1 -- 172.21.15.42:0/3741447486 reap_dead start 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.064+0000 7febde7cf640 1 -- 172.21.15.42:0/3741447486 shutdown_connections 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.064+0000 7febde7cf640 1 -- 172.21.15.42:0/3741447486 >> 172.21.15.42:0/3741447486 conn(0x7febd806bdf0 msgr2=0x7febd806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.064+0000 7febde7cf640 1 -- 172.21.15.42:0/3741447486 shutdown_connections 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.064+0000 7febde7cf640 1 -- 172.21.15.42:0/3741447486 wait complete. 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.065+0000 7febde7cf640 1 Processor -- start 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.066+0000 7febde7cf640 1 -- start start 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.066+0000 7febde7cf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 0x7febd80b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.066+0000 7febde7cf640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd81541d0 0x7febd809d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.066+0000 7febde7cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd81575a0 0x7febd8157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.066+0000 7febde7cf640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7febd80b4a20 con 0x7febc0004d40 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.066+0000 7febde7cf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7febd80ce960 con 0x7febd81575a0 2024-09-16T01:56:13.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.066+0000 7febde7cf640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7febd80b4ba0 con 0x7febd81541d0 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 0x7febd80b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd7fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 0x7febd80b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47682/0 (socket says 172.21.15.42:47682) 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd7fff640 1 -- 172.21.15.42:0/4011523299 learned_addr learned my addr 172.21.15.42:0/4011523299 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd77fe640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd81541d0 0x7febd809d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febdcd6c640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd81575a0 0x7febd8157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd7fff640 1 -- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd81541d0 msgr2=0x7febd809d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd7fff640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd81541d0 0x7febd809d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd7fff640 1 -- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd81575a0 msgr2=0x7febd8157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd7fff640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd81575a0 0x7febd8157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd7fff640 1 -- 172.21.15.42:0/4011523299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd809dc00 con 0x7febc0004d40 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd7fff640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 0x7febd80b2880 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7febc800f7a0 tx=0x7febc800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd4ff9640 1 -- 172.21.15.42:0/4011523299 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc800fe50 con 0x7febc0004d40 2024-09-16T01:56:13.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd4ff9640 1 -- 172.21.15.42:0/4011523299 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc8018070 con 0x7febc0004d40 2024-09-16T01:56:13.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febde7cf640 1 -- 172.21.15.42:0/4011523299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd809dee0 con 0x7febc0004d40 2024-09-16T01:56:13.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febd4ff9640 1 -- 172.21.15.42:0/4011523299 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc800d6b0 con 0x7febc0004d40 2024-09-16T01:56:13.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.067+0000 7febde7cf640 1 -- 172.21.15.42:0/4011523299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd809a600 con 0x7febc0004d40 2024-09-16T01:56:13.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.068+0000 7febde7cf640 1 -- 172.21.15.42:0/4011523299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd8072050 con 0x7febc0004d40 2024-09-16T01:56:13.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.069+0000 7febd4ff9640 1 -- 172.21.15.42:0/4011523299 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7febc800d850 con 0x7febc0004d40 2024-09-16T01:56:13.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.069+0000 7febd4ff9640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febc406c2b0 0x7febc406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:13.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.069+0000 7febd4ff9640 1 -- 172.21.15.42:0/4011523299 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6187+0+0 (secure 0 0 0) 0x7febc808b370 con 0x7febc0004d40 2024-09-16T01:56:13.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.070+0000 7febd77fe640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febc406c2b0 0x7febc406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:13.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.070+0000 7febd77fe640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febc406c2b0 0x7febc406e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7febcc0011e0 tx=0x7febcc0010d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:13.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.074+0000 7febd4ff9640 1 -- 172.21.15.42:0/4011523299 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7febc8059340 con 0x7febc0004d40 2024-09-16T01:56:13.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:13.251+0000 7febde7cf640 1 -- 172.21.15.42:0/4011523299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7febd809e0b0 con 0x7febc0004d40 2024-09-16T01:56:14.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.004+0000 7febd4ff9640 1 -- 172.21.15.42:0/4011523299 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) ==== 181+0+0 (secure 0 0 0) 0x7febc805d640 con 0x7febc0004d40 2024-09-16T01:56:14.006 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:56:14.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.008+0000 7febde7cf640 1 -- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febc406c2b0 msgr2=0x7febc406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:14.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.008+0000 7febde7cf640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febc406c2b0 0x7febc406e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7febcc0011e0 tx=0x7febcc0010d0 comp rx=0 tx=0).stop 2024-09-16T01:56:14.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.008+0000 7febde7cf640 1 -- 172.21.15.42:0/4011523299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 msgr2=0x7febd80b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:14.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.008+0000 7febde7cf640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 0x7febd80b2880 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7febc800f7a0 tx=0x7febc800fc60 comp rx=0 tx=0).stop 2024-09-16T01:56:14.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.009+0000 7febde7cf640 1 -- 172.21.15.42:0/4011523299 shutdown_connections 2024-09-16T01:56:14.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.009+0000 7febde7cf640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7febc406c2b0 0x7febc406e770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:14.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.009+0000 7febde7cf640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febd81575a0 0x7febd8157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:14.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.009+0000 7febde7cf640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7febd81541d0 0x7febd809d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:14.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.009+0000 7febde7cf640 1 --2- 172.21.15.42:0/4011523299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc0004d40 0x7febd80b2880 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:14.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.009+0000 7febde7cf640 1 -- 172.21.15.42:0/4011523299 >> 172.21.15.42:0/4011523299 conn(0x7febd806bdf0 msgr2=0x7febd806f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:14.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.009+0000 7febde7cf640 1 -- 172.21.15.42:0/4011523299 shutdown_connections 2024-09-16T01:56:14.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.009+0000 7febde7cf640 1 -- 172.21.15.42:0/4011523299 wait complete. 2024-09-16T01:56:14.025 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:56:14.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.141+0000 7f32e7a7b640 1 Processor -- start 2024-09-16T01:56:14.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.142+0000 7f32e7a7b640 1 -- start start 2024-09-16T01:56:14.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.142+0000 7f32e7a7b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32e0162340 0x7f32e006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:14.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.142+0000 7f32e7a7b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e00cf280 0x7f32e0162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:14.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.142+0000 7f32e7a7b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e015ff70 con 0x7f32e0162c60 2024-09-16T01:56:14.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.142+0000 7f32e7a7b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f32e006de90 con 0x7f32e0162340 2024-09-16T01:56:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.142+0000 7f32e7a7b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f32e00d4d10 con 0x7f32e00cf280 2024-09-16T01:56:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.143+0000 7f32e5817640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32e0162340 0x7f32e006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.143+0000 7f32e6018640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f32e0162c60 0x7f32e00d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54390/0 (socket says 172.21.15.42:54390) 2024-09-16T01:56:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.143+0000 7f32e6018640 1 -- 172.21.15.42:0/2440213925 learned_addr learned my addr 172.21.15.42:0/2440213925 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.143+0000 7f32e5817640 1 -- 172.21.15.42:0/2440213925 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e00cf280 msgr2=0x7f32e0162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.143+0000 7f32e5817640 1 --2- 172.21.15.42:0/2440213925 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e00cf280 0x7f32e0162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.143+0000 7f32e5817640 1 -- 172.21.15.42:0/2440213925 >> v1:172.21.15.42:6789/0 conn(0x7f32e0162c60 legacy=0x7f32e00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.143+0000 7f32e4815640 1 -- 172.21.15.42:0/2440213925 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479199478 0 0) 0x7f32e015ff70 con 0x7f32e0162c60 2024-09-16T01:56:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.143+0000 7f32e5817640 1 -- 172.21.15.42:0/2440213925 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e00d4ff0 con 0x7f32e0162340 2024-09-16T01:56:14.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.144+0000 7f32e5817640 1 --2- 172.21.15.42:0/2440213925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162340 0x7f32e006d740 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0097a0 tx=0x7f32dc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c0448de0abf941 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.144+0000 7f32e4815640 1 -- 172.21.15.42:0/2440213925 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc037070 con 0x7f32e0162340 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.144+0000 7f32e4815640 1 -- 172.21.15.42:0/2440213925 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc02ae50 con 0x7f32e0162340 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.144+0000 7f32e4815640 1 -- 172.21.15.42:0/2440213925 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc032660 con 0x7f32e0162340 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.144+0000 7f32e7a7b640 1 -- 172.21.15.42:0/2440213925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162340 msgr2=0x7f32e006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.144+0000 7f32e7a7b640 1 --2- 172.21.15.42:0/2440213925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162340 0x7f32e006d740 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0097a0 tx=0x7f32dc02a100 comp rx=0 tx=0).stop 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.144+0000 7f32e7a7b640 1 -- 172.21.15.42:0/2440213925 shutdown_connections 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.144+0000 7f32e7a7b640 1 --2- 172.21.15.42:0/2440213925 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e00cf280 0x7f32e0162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.144+0000 7f32e7a7b640 1 --2- 172.21.15.42:0/2440213925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162340 0x7f32e006d740 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.144+0000 7f32e7a7b640 1 -- 172.21.15.42:0/2440213925 >> 172.21.15.42:0/2440213925 conn(0x7f32e008bfc0 msgr2=0x7f32e00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.145+0000 7f32e7a7b640 1 -- 172.21.15.42:0/2440213925 shutdown_connections 2024-09-16T01:56:14.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.145+0000 7f32e7a7b640 1 -- 172.21.15.42:0/2440213925 wait complete. 2024-09-16T01:56:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.146+0000 7f32e7a7b640 1 Processor -- start 2024-09-16T01:56:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.146+0000 7f32e7a7b640 1 -- start start 2024-09-16T01:56:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.146+0000 7f32e7a7b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e00cf280 0x7f32e00b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e7a7b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0162340 0x7f32e00cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e7a7b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162c60 0x7f32e01f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e7a7b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f32e00cf6c0 con 0x7f32e0162c60 2024-09-16T01:56:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e7a7b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f32e00d52d0 con 0x7f32e00cf280 2024-09-16T01:56:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e7a7b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f32e01630f0 con 0x7f32e0162340 2024-09-16T01:56:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e6018640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162c60 0x7f32e01f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e6018640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162c60 0x7f32e01f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47692/0 (socket says 172.21.15.42:47692) 2024-09-16T01:56:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e6018640 1 -- 172.21.15.42:0/3450314454 learned_addr learned my addr 172.21.15.42:0/3450314454 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e5817640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e00cf280 0x7f32e00b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e5016640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0162340 0x7f32e00cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e6018640 1 -- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0162340 msgr2=0x7f32e00cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e6018640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0162340 0x7f32e00cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e6018640 1 -- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e00cf280 msgr2=0x7f32e00b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e6018640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e00cf280 0x7f32e00b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e6018640 1 -- 172.21.15.42:0/3450314454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e01f53e0 con 0x7f32e0162c60 2024-09-16T01:56:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e5016640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0162340 0x7f32e00cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e5817640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e00cf280 0x7f32e00b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e6018640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162c60 0x7f32e01f4ea0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f32d800c7a0 tx=0x7f32d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:14.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32d67fc640 1 -- 172.21.15.42:0/3450314454 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d8018070 con 0x7f32e0162c60 2024-09-16T01:56:14.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32d67fc640 1 -- 172.21.15.42:0/3450314454 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d800a640 con 0x7f32e0162c60 2024-09-16T01:56:14.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e7a7b640 1 -- 172.21.15.42:0/3450314454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e00cca40 con 0x7f32e0162c60 2024-09-16T01:56:14.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32d67fc640 1 -- 172.21.15.42:0/3450314454 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d800aab0 con 0x7f32e0162c60 2024-09-16T01:56:14.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.147+0000 7f32e7a7b640 1 -- 172.21.15.42:0/3450314454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e00cd000 con 0x7f32e0162c60 2024-09-16T01:56:14.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.148+0000 7f32e7a7b640 1 -- 172.21.15.42:0/3450314454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e0162720 con 0x7f32e0162c60 2024-09-16T01:56:14.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.149+0000 7f32d67fc640 1 -- 172.21.15.42:0/3450314454 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f32d801b070 con 0x7f32e0162c60 2024-09-16T01:56:14.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.149+0000 7f32d67fc640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f32c406c2e0 0x7f32c406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:14.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.149+0000 7f32d67fc640 1 -- 172.21.15.42:0/3450314454 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5749+0+0 (secure 0 0 0) 0x7f32d808a9e0 con 0x7f32e0162c60 2024-09-16T01:56:14.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.150+0000 7f32e5817640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f32c406c2e0 0x7f32c406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:14.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.150+0000 7f32e5817640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f32c406c2e0 0x7f32c406e7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32dc034000 tx=0x7f32dc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:14.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.154+0000 7f32d67fc640 1 -- 172.21.15.42:0/3450314454 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32e01f53e0 con 0x7f32e0162c60 2024-09-16T01:56:14.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:14.328+0000 7f32e7a7b640 1 -- 172.21.15.42:0/3450314454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f32e00ba450 con 0x7f32e0162c60 2024-09-16T01:56:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.017+0000 7f32d67fc640 1 -- 172.21.15.42:0/3450314454 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) ==== 169+0+0 (secure 0 0 0) 0x7f32d80591b0 con 0x7f32e0162c60 2024-09-16T01:56:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-16T01:56:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 -- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f32c406c2e0 msgr2=0x7f32c406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f32c406c2e0 0x7f32c406e7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32dc034000 tx=0x7f32dc02e000 comp rx=0 tx=0).stop 2024-09-16T01:56:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 -- 172.21.15.42:0/3450314454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162c60 msgr2=0x7f32e01f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162c60 0x7f32e01f4ea0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f32d800c7a0 tx=0x7f32d800cc60 comp rx=0 tx=0).stop 2024-09-16T01:56:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 -- 172.21.15.42:0/3450314454 shutdown_connections 2024-09-16T01:56:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f32c406c2e0 0x7f32c406e7a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32e0162c60 0x7f32e01f4ea0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32e0162340 0x7f32e00cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 --2- 172.21.15.42:0/3450314454 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32e00cf280 0x7f32e00b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 -- 172.21.15.42:0/3450314454 >> 172.21.15.42:0/3450314454 conn(0x7f32e008bfc0 msgr2=0x7f32e00cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 -- 172.21.15.42:0/3450314454 shutdown_connections 2024-09-16T01:56:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.021+0000 7f32e7a7b640 1 -- 172.21.15.42:0/3450314454 wait complete. 2024-09-16T01:56:15.036 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:56:15.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.142+0000 7f5e52e0e640 1 Processor -- start 2024-09-16T01:56:15.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.142+0000 7f5e52e0e640 1 -- start start 2024-09-16T01:56:15.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e52e0e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5e4c15e640 0x7f5e4c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e52e0e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e4c0d5100 0x7f5e4c0cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e52e0e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4c0d3a60 con 0x7f5e4c1621b0 2024-09-16T01:56:15.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e52e0e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f5e4c0cec40 con 0x7f5e4c0d5100 2024-09-16T01:56:15.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e52e0e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5e4c0cef20 con 0x7f5e4c15e640 2024-09-16T01:56:15.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e43fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e4c0d5100 0x7f5e4c0cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e43fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e4c0d5100 0x7f5e4c0cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47696/0 (socket says 172.21.15.42:47696) 2024-09-16T01:56:15.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e43fff640 1 -- 172.21.15.42:0/48460023 learned_addr learned my addr 172.21.15.42:0/48460023 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:15.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e50baa640 1 --2- 172.21.15.42:0/48460023 >> v2:172.21.15.107:3300/0 conn(0x7f5e4c15e640 0x7f5e4c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e43fff640 1 -- 172.21.15.42:0/48460023 >> v2:172.21.15.107:3300/0 conn(0x7f5e4c15e640 msgr2=0x7f5e4c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:15.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e43fff640 1 --2- 172.21.15.42:0/48460023 >> v2:172.21.15.107:3300/0 conn(0x7f5e4c15e640 0x7f5e4c0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e43fff640 1 -- 172.21.15.42:0/48460023 >> v1:172.21.15.107:6789/0 conn(0x7f5e4c1621b0 legacy=0x7f5e4c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.143+0000 7f5e43fff640 1 -- 172.21.15.42:0/48460023 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c0cf200 con 0x7f5e4c0d5100 2024-09-16T01:56:15.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.144+0000 7f5e43fff640 1 --2- 172.21.15.42:0/48460023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 0x7f5e4c0cfa00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c08c6f0 tx=0x7f5e3c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1f0438be24cf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:15.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.144+0000 7f5e437fe640 1 -- 172.21.15.42:0/48460023 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c037070 con 0x7f5e4c0d5100 2024-09-16T01:56:15.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.144+0000 7f5e437fe640 1 -- 172.21.15.42:0/48460023 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c02ae50 con 0x7f5e4c0d5100 2024-09-16T01:56:15.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.144+0000 7f5e437fe640 1 -- 172.21.15.42:0/48460023 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c032860 con 0x7f5e4c0d5100 2024-09-16T01:56:15.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.145+0000 7f5e52e0e640 1 -- 172.21.15.42:0/48460023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 msgr2=0x7f5e4c0cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.145+0000 7f5e52e0e640 1 --2- 172.21.15.42:0/48460023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 0x7f5e4c0cfa00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c08c6f0 tx=0x7f5e3c02a300 comp rx=0 tx=0).stop 2024-09-16T01:56:15.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.145+0000 7f5e52e0e640 1 -- 172.21.15.42:0/48460023 shutdown_connections 2024-09-16T01:56:15.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.145+0000 7f5e52e0e640 1 --2- 172.21.15.42:0/48460023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 0x7f5e4c0cfa00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.145+0000 7f5e52e0e640 1 --2- 172.21.15.42:0/48460023 >> v2:172.21.15.107:3300/0 conn(0x7f5e4c15e640 0x7f5e4c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.145+0000 7f5e52e0e640 1 -- 172.21.15.42:0/48460023 >> 172.21.15.42:0/48460023 conn(0x7f5e4c08bfc0 msgr2=0x7f5e4c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:15.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.145+0000 7f5e52e0e640 1 -- 172.21.15.42:0/48460023 shutdown_connections 2024-09-16T01:56:15.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.145+0000 7f5e52e0e640 1 -- 172.21.15.42:0/48460023 wait complete. 2024-09-16T01:56:15.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.146+0000 7f5e52e0e640 1 Processor -- start 2024-09-16T01:56:15.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.146+0000 7f5e52e0e640 1 -- start start 2024-09-16T01:56:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e52e0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 0x7f5e4c160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e52e0e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e4c15e640 0x7f5e4c1617e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e52e0e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e4c1621b0 0x7f5e4c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e52e0e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c0d3720 con 0x7f5e4c0d5100 2024-09-16T01:56:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e52e0e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c15ea20 con 0x7f5e4c1621b0 2024-09-16T01:56:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e52e0e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4c0cff40 con 0x7f5e4c15e640 2024-09-16T01:56:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e50baa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 0x7f5e4c160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e50baa640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 0x7f5e4c160a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47702/0 (socket says 172.21.15.42:47702) 2024-09-16T01:56:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e50baa640 1 -- 172.21.15.42:0/820417701 learned_addr learned my addr 172.21.15.42:0/820417701 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:15.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e513ab640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e4c1621b0 0x7f5e4c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e43fff640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e4c15e640 0x7f5e4c1617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e50baa640 1 -- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e4c15e640 msgr2=0x7f5e4c1617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e50baa640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e4c15e640 0x7f5e4c1617e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e50baa640 1 -- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e4c1621b0 msgr2=0x7f5e4c15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e50baa640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e4c1621b0 0x7f5e4c15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.147+0000 7f5e50baa640 1 -- 172.21.15.42:0/820417701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c0b6dc0 con 0x7f5e4c0d5100 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.148+0000 7f5e50baa640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 0x7f5e4c160a10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800e9b0 tx=0x7f5e4800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.148+0000 7f5e417fa640 1 -- 172.21.15.42:0/820417701 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e48017070 con 0x7f5e4c0d5100 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.148+0000 7f5e417fa640 1 -- 172.21.15.42:0/820417701 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4800c9a0 con 0x7f5e4c0d5100 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.148+0000 7f5e52e0e640 1 -- 172.21.15.42:0/820417701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4c1f5730 con 0x7f5e4c0d5100 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.148+0000 7f5e417fa640 1 -- 172.21.15.42:0/820417701 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800cd90 con 0x7f5e4c0d5100 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.148+0000 7f5e52e0e640 1 -- 172.21.15.42:0/820417701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4c15ff30 con 0x7f5e4c0d5100 2024-09-16T01:56:15.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.149+0000 7f5e52e0e640 1 -- 172.21.15.42:0/820417701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4c0cfa00 con 0x7f5e4c0d5100 2024-09-16T01:56:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.149+0000 7f5e417fa640 1 -- 172.21.15.42:0/820417701 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5e4801a070 con 0x7f5e4c0d5100 2024-09-16T01:56:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.150+0000 7f5e417fa640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e3806c2b0 0x7f5e3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.150+0000 7f5e417fa640 1 -- 172.21.15.42:0/820417701 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f5e4808b260 con 0x7f5e4c0d5100 2024-09-16T01:56:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.150+0000 7f5e43fff640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e3806c2b0 0x7f5e3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.150+0000 7f5e43fff640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e3806c2b0 0x7f5e3806e770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c034000 tx=0x7f5e3c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:15.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.154+0000 7f5e417fa640 1 -- 172.21.15.42:0/820417701 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e48059bd0 con 0x7f5e4c0d5100 2024-09-16T01:56:15.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.338+0000 7f5e52e0e640 1 -- 172.21.15.42:0/820417701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f5e4c08c4d0 con 0x7f5e4c0d5100 2024-09-16T01:56:15.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.341+0000 7f5e417fa640 1 -- 172.21.15.42:0/820417701 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f5e480594d0 con 0x7f5e4c0d5100 2024-09-16T01:56:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.343+0000 7f5e52e0e640 1 -- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e3806c2b0 msgr2=0x7f5e3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.343+0000 7f5e52e0e640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e3806c2b0 0x7f5e3806e770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c034000 tx=0x7f5e3c02e000 comp rx=0 tx=0).stop 2024-09-16T01:56:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.343+0000 7f5e52e0e640 1 -- 172.21.15.42:0/820417701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 msgr2=0x7f5e4c160a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.343+0000 7f5e52e0e640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 0x7f5e4c160a10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800e9b0 tx=0x7f5e4800ee70 comp rx=0 tx=0).stop 2024-09-16T01:56:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.343+0000 7f5e52e0e640 1 -- 172.21.15.42:0/820417701 shutdown_connections 2024-09-16T01:56:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.343+0000 7f5e52e0e640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f5e3806c2b0 0x7f5e3806e770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.343+0000 7f5e52e0e640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e4c1621b0 0x7f5e4c15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.343+0000 7f5e52e0e640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e4c15e640 0x7f5e4c1617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.343+0000 7f5e52e0e640 1 --2- 172.21.15.42:0/820417701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e4c0d5100 0x7f5e4c160a10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.343+0000 7f5e52e0e640 1 -- 172.21.15.42:0/820417701 >> 172.21.15.42:0/820417701 conn(0x7f5e4c08bfc0 msgr2=0x7f5e4c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:15.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.344+0000 7f5e52e0e640 1 -- 172.21.15.42:0/820417701 shutdown_connections 2024-09-16T01:56:15.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.344+0000 7f5e52e0e640 1 -- 172.21.15.42:0/820417701 wait complete. 2024-09-16T01:56:15.356 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-09-16T01:56:15.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.457+0000 7f807939f640 1 Processor -- start 2024-09-16T01:56:15.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.457+0000 7f807939f640 1 -- start start 2024-09-16T01:56:15.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.458+0000 7f807939f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740d0450 0x7f8074169000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.458+0000 7f807939f640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80740d2c20 con 0x7f80740d4180 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.458+0000 7f807939f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f807406e390 con 0x7f807415e6a0 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.458+0000 7f807939f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f80740cefb0 con 0x7f80740d0450 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.458+0000 7f8073fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f80740d4180 0x7f80740d4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54400/0 (socket says 172.21.15.42:54400) 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.458+0000 7f8073fff640 1 -- 172.21.15.42:0/1171924754 learned_addr learned my addr 172.21.15.42:0/1171924754 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074941514 0 0) 0x7f80740d2c20 con 0x7f80740d4180 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8078b9e640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740d0450 0x7f8074169000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f805c003520 con 0x7f80740d4180 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2576240808 0 0) 0x7f805c003520 con 0x7f80740d4180 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740d0450 msgr2=0x7f8074169000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740d0450 0x7f8074169000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 >> v1:172.21.15.107:6789/0 conn(0x7f807415e6a0 legacy=0x7f807406d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807406e670 con 0x7f80740d4180 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f8064001670 con 0x7f80740d4180 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 >> v1:172.21.15.42:6789/0 conn(0x7f80740d4180 legacy=0x7f80740d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740d0450 0x7f805c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f805c003f60 0x7f805c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 0x7f805c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f80740cefb0 con 0x7f805c004d40 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f805c00bb50 con 0x7f805c003f60 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f805c00bd50 con 0x7f80740d0450 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8078b9e640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 0x7f805c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8073fff640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740d0450 0x7f805c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f80737fe640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f805c003f60 0x7f805c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8078b9e640 1 -- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740d0450 msgr2=0x7f805c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:15.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8078b9e640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740d0450 0x7f805c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8078b9e640 1 -- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f805c003f60 msgr2=0x7f805c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:15.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8078b9e640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f805c003f60 0x7f805c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.459+0000 7f8078b9e640 1 -- 172.21.15.42:0/1171924754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805c003520 con 0x7f805c004d40 2024-09-16T01:56:15.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.460+0000 7f8078b9e640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 0x7f805c0051c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f806c009f90 tx=0x7f805c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75769a0da51f313 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:15.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.460+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c009c10 con 0x7f805c004d40 2024-09-16T01:56:15.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.460+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806c036070 con 0x7f805c004d40 2024-09-16T01:56:15.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.460+0000 7f8072ffd640 1 -- 172.21.15.42:0/1171924754 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c031810 con 0x7f805c004d40 2024-09-16T01:56:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.461+0000 7f807939f640 1 -- 172.21.15.42:0/1171924754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 msgr2=0x7f805c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.461+0000 7f807939f640 1 --2- 172.21.15.42:0/1171924754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 0x7f805c0051c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f806c009f90 tx=0x7f805c005830 comp rx=0 tx=0).stop 2024-09-16T01:56:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.461+0000 7f8078b9e640 1 -- 172.21.15.42:0/1171924754 reap_dead start 2024-09-16T01:56:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.461+0000 7f807939f640 1 -- 172.21.15.42:0/1171924754 shutdown_connections 2024-09-16T01:56:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.461+0000 7f807939f640 1 -- 172.21.15.42:0/1171924754 >> 172.21.15.42:0/1171924754 conn(0x7f807409d6f0 msgr2=0x7f807408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.461+0000 7f807939f640 1 -- 172.21.15.42:0/1171924754 shutdown_connections 2024-09-16T01:56:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.461+0000 7f807939f640 1 -- 172.21.15.42:0/1171924754 wait complete. 2024-09-16T01:56:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.462+0000 7f807939f640 1 Processor -- start 2024-09-16T01:56:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.462+0000 7f807939f640 1 -- start start 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f807939f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 0x7f8074156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f807939f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740b53d0 0x7f80740cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f807939f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80740b5850 0x7f80740cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f807939f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f807406df30 con 0x7f805c004d40 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f807939f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f80740cebd0 con 0x7f80740b5850 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f807939f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f807406e0b0 con 0x7f80740b53d0 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f8073fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 0x7f8074156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f8073fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 0x7f8074156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47724/0 (socket says 172.21.15.42:47724) 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f8073fff640 1 -- 172.21.15.42:0/678269049 learned_addr learned my addr 172.21.15.42:0/678269049 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f80737fe640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740b53d0 0x7f80740cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.463+0000 7f8078b9e640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80740b5850 0x7f80740cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f8073fff640 1 -- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740b53d0 msgr2=0x7f80740cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f8073fff640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740b53d0 0x7f80740cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f8073fff640 1 -- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80740b5850 msgr2=0x7f80740cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f8073fff640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80740b5850 0x7f80740cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f8073fff640 1 -- 172.21.15.42:0/678269049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8074156870 con 0x7f805c004d40 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f8073fff640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 0x7f8074156330 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f80640072c0 tx=0x7f8064007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f8070ff9640 1 -- 172.21.15.42:0/678269049 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806400f960 con 0x7f805c004d40 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f8070ff9640 1 -- 172.21.15.42:0/678269049 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8064018070 con 0x7f805c004d40 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f807939f640 1 -- 172.21.15.42:0/678269049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80740b7370 con 0x7f805c004d40 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f8070ff9640 1 -- 172.21.15.42:0/678269049 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806400fd60 con 0x7f805c004d40 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.464+0000 7f807939f640 1 -- 172.21.15.42:0/678269049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80740b7930 con 0x7f805c004d40 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.465+0000 7f807939f640 1 -- 172.21.15.42:0/678269049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80740d4560 con 0x7f805c004d40 2024-09-16T01:56:15.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.466+0000 7f8070ff9640 1 -- 172.21.15.42:0/678269049 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f806401d460 con 0x7f805c004d40 2024-09-16T01:56:15.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.466+0000 7f8070ff9640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f806006c2b0 0x7f806006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:15.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.466+0000 7f8070ff9640 1 -- 172.21.15.42:0/678269049 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f806408b410 con 0x7f805c004d40 2024-09-16T01:56:15.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.466+0000 7f80737fe640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f806006c2b0 0x7f806006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:15.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.467+0000 7f80737fe640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f806006c2b0 0x7f806006e770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f80740b3120 tx=0x7f8068009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:15.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.470+0000 7f8070ff9640 1 -- 172.21.15.42:0/678269049 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8064059d80 con 0x7f805c004d40 2024-09-16T01:56:15.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:15.713+0000 7f807939f640 1 -- 172.21.15.42:0/678269049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f807408c160 con 0x7f805c004d40 2024-09-16T01:56:16.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.018+0000 7f8070ff9640 1 -- 172.21.15.42:0/678269049 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v122) ==== 149+0+0 (secure 0 0 0) 0x7f8064059680 con 0x7f805c004d40 2024-09-16T01:56:16.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.020+0000 7f807939f640 1 -- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f806006c2b0 msgr2=0x7f806006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:16.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.020+0000 7f807939f640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f806006c2b0 0x7f806006e770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f80740b3120 tx=0x7f8068009040 comp rx=0 tx=0).stop 2024-09-16T01:56:16.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.020+0000 7f807939f640 1 -- 172.21.15.42:0/678269049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 msgr2=0x7f8074156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:16.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.020+0000 7f807939f640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 0x7f8074156330 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f80640072c0 tx=0x7f8064007780 comp rx=0 tx=0).stop 2024-09-16T01:56:16.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.020+0000 7f807939f640 1 -- 172.21.15.42:0/678269049 shutdown_connections 2024-09-16T01:56:16.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.020+0000 7f807939f640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f806006c2b0 0x7f806006e770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:16.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.020+0000 7f807939f640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80740b5850 0x7f80740cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:16.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.020+0000 7f807939f640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f80740b53d0 0x7f80740cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:16.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.020+0000 7f807939f640 1 --2- 172.21.15.42:0/678269049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f805c004d40 0x7f8074156330 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:16.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.020+0000 7f807939f640 1 -- 172.21.15.42:0/678269049 >> 172.21.15.42:0/678269049 conn(0x7f807409d6f0 msgr2=0x7f80740d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:16.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.021+0000 7f807939f640 1 -- 172.21.15.42:0/678269049 shutdown_connections 2024-09-16T01:56:16.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:16.021+0000 7f807939f640 1 -- 172.21.15.42:0/678269049 wait complete. 2024-09-16T01:56:16.035 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ERROR 2024-09-16T01:56:16.035 INFO:tasks.cephfs_test_runner: 2024-09-16T01:56:16.035 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner:ERROR: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_forward_scrub.py", line 294, in test_backtrace_repair 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner: backtrace = self.fs.read_backtrace(file_ino) 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-16T01:56:16.036 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi042 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner: 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner:Ran 2 tests in 79.164s 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner: 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner: 2024-09-16T01:56:16.037 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner:ERROR: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_forward_scrub.py", line 294, in test_backtrace_repair 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner: backtrace = self.fs.read_backtrace(file_ino) 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-16T01:56:16.038 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi042 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-16T01:56:16.039 INFO:tasks.cephfs_test_runner: 2024-09-16T01:56:16.039 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-16T01:56:16.273 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5f7b6379320a411faf7af4c695a22c90 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-16T01:56:16.274 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-16T01:56:16.282 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-16T01:56:16.293 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-16T01:56:16.293 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:56:16.293 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:56:16.316 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=159 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:56:16.317 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-16T01:56:16.317 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:56:16.375 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=159 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:56:16.375 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:56:16.376 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:56:16.395 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:56:16.395 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-16T01:56:16.395 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:56:16.453 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055984,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:56:16.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:16.454 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-16T01:56:16.471 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:56:16.471 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:56:16.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:16.472 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:56:16.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:16.542 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:56:16.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:16.613 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-09-16T01:56:16.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:16.714 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-16T01:56:16.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:16.732 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-09-16T01:56:16.801 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-09-16T01:56:16.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:56:16.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:16.803 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-16T01:56:16.821 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:56:16.822 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:56:16.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:16.822 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:56:16.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:16.892 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:56:16.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:16.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-16T01:56:17.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:17.058 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-09-16T01:56:17.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:56:17.075 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-09-16T01:56:17.113 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:56:17.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:56:17.144 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-09-16T01:56:17.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:56:17.145 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T01:56:17.154 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:56:17.154 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:56:17.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.259+0000 7f7e18ee6640 1 Processor -- start 2024-09-16T01:56:17.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.259+0000 7f7e18ee6640 1 -- start start 2024-09-16T01:56:17.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.260+0000 7f7e18ee6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7e1415b300 0x7f7e140cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.260+0000 7f7e18ee6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7e140cd3f0 0x7f7e1406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.260+0000 7f7e18ee6640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e140cdbe0 con 0x7f7e14072d30 2024-09-16T01:56:17.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.260+0000 7f7e18ee6640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f7e140728a0 con 0x7f7e1415b300 2024-09-16T01:56:17.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.260+0000 7f7e18ee6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7e140cd900 con 0x7f7e140cd3f0 2024-09-16T01:56:17.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.261+0000 7f7e1259c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7e1415b300 0x7f7e140cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.261+0000 7f7e12d9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f7e14072d30 0x7f7e140b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54404/0 (socket says 172.21.15.42:54404) 2024-09-16T01:56:17.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.261+0000 7f7e12d9d640 1 -- 172.21.15.42:0/1166354578 learned_addr learned my addr 172.21.15.42:0/1166354578 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:17.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.261+0000 7f7e11d9b640 1 --2- 172.21.15.42:0/1166354578 >> v2:172.21.15.107:3300/0 conn(0x7f7e140cd3f0 0x7f7e1406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.261+0000 7f7e1259c640 1 -- 172.21.15.42:0/1166354578 >> v2:172.21.15.107:3300/0 conn(0x7f7e140cd3f0 msgr2=0x7f7e1406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:17.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.261+0000 7f7e1259c640 1 --2- 172.21.15.42:0/1166354578 >> v2:172.21.15.107:3300/0 conn(0x7f7e140cd3f0 0x7f7e1406f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.261+0000 7f7e1259c640 1 -- 172.21.15.42:0/1166354578 >> v1:172.21.15.42:6789/0 conn(0x7f7e14072d30 legacy=0x7f7e140b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.261+0000 7f7e1259c640 1 -- 172.21.15.42:0/1166354578 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e14072250 con 0x7f7e1415b300 2024-09-16T01:56:17.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.261+0000 7f7e1159a640 1 -- 172.21.15.42:0/1166354578 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1998067317 0 0) 0x7f7e140cdbe0 con 0x7f7e14072d30 2024-09-16T01:56:17.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.261+0000 7f7e11d9b640 1 --2- 172.21.15.42:0/1166354578 >> v2:172.21.15.107:3300/0 conn(0x7f7e140cd3f0 0x7f7e1406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:56:17.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.262+0000 7f7e1259c640 1 --2- 172.21.15.42:0/1166354578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 0x7f7e140cceb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7e140b57c0 tx=0x7f7e0402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88f1b78f46f9611 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:17.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.262+0000 7f7e1159a640 1 -- 172.21.15.42:0/1166354578 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04007740 con 0x7f7e1415b300 2024-09-16T01:56:17.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.262+0000 7f7e1159a640 1 -- 172.21.15.42:0/1166354578 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e040078e0 con 0x7f7e1415b300 2024-09-16T01:56:17.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.262+0000 7f7e1159a640 1 -- 172.21.15.42:0/1166354578 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04007cb0 con 0x7f7e1415b300 2024-09-16T01:56:17.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.262+0000 7f7e18ee6640 1 -- 172.21.15.42:0/1166354578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 msgr2=0x7f7e140cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.262+0000 7f7e18ee6640 1 --2- 172.21.15.42:0/1166354578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 0x7f7e140cceb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7e140b57c0 tx=0x7f7e0402a680 comp rx=0 tx=0).stop 2024-09-16T01:56:17.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.262+0000 7f7e18ee6640 1 -- 172.21.15.42:0/1166354578 shutdown_connections 2024-09-16T01:56:17.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.262+0000 7f7e18ee6640 1 --2- 172.21.15.42:0/1166354578 >> v2:172.21.15.107:3300/0 conn(0x7f7e140cd3f0 0x7f7e1406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.262+0000 7f7e18ee6640 1 --2- 172.21.15.42:0/1166354578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 0x7f7e140cceb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.262+0000 7f7e18ee6640 1 -- 172.21.15.42:0/1166354578 >> 172.21.15.42:0/1166354578 conn(0x7f7e14067d70 msgr2=0x7f7e1406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:17.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.263+0000 7f7e18ee6640 1 -- 172.21.15.42:0/1166354578 shutdown_connections 2024-09-16T01:56:17.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.263+0000 7f7e18ee6640 1 -- 172.21.15.42:0/1166354578 wait complete. 2024-09-16T01:56:17.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.264+0000 7f7e18ee6640 1 Processor -- start 2024-09-16T01:56:17.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.264+0000 7f7e18ee6640 1 -- start start 2024-09-16T01:56:17.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e18ee6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14072d30 0x7f7e141438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e18ee6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e140cd3f0 0x7f7e140c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e18ee6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 0x7f7e140c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e18ee6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7e140d0160 con 0x7f7e1415b300 2024-09-16T01:56:17.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e18ee6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7e140cffe0 con 0x7f7e14072d30 2024-09-16T01:56:17.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e18ee6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1406f700 con 0x7f7e140cd3f0 2024-09-16T01:56:17.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e12d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 0x7f7e140c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e12d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 0x7f7e140c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47740/0 (socket says 172.21.15.42:47740) 2024-09-16T01:56:17.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e12d9d640 1 -- 172.21.15.42:0/316300277 learned_addr learned my addr 172.21.15.42:0/316300277 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:17.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e1259c640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14072d30 0x7f7e141438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e11d9b640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e140cd3f0 0x7f7e140c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e12d9d640 1 -- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e140cd3f0 msgr2=0x7f7e140c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e12d9d640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e140cd3f0 0x7f7e140c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e12d9d640 1 -- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14072d30 msgr2=0x7f7e141438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e12d9d640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14072d30 0x7f7e141438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e12d9d640 1 -- 172.21.15.42:0/316300277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e141455e0 con 0x7f7e1415b300 2024-09-16T01:56:17.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e12d9d640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 0x7f7e140c5980 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00c450 tx=0x7f7e0c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:17.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e0affd640 1 -- 172.21.15.42:0/316300277 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0074e0 con 0x7f7e1415b300 2024-09-16T01:56:17.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e0affd640 1 -- 172.21.15.42:0/316300277 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0c0047e0 con 0x7f7e1415b300 2024-09-16T01:56:17.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e18ee6640 1 -- 172.21.15.42:0/316300277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e141458c0 con 0x7f7e1415b300 2024-09-16T01:56:17.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e0affd640 1 -- 172.21.15.42:0/316300277 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c004bd0 con 0x7f7e1415b300 2024-09-16T01:56:17.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.265+0000 7f7e18ee6640 1 -- 172.21.15.42:0/316300277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e141562b0 con 0x7f7e1415b300 2024-09-16T01:56:17.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.266+0000 7f7e18ee6640 1 -- 172.21.15.42:0/316300277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e141560a0 con 0x7f7e1415b300 2024-09-16T01:56:17.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.267+0000 7f7e0affd640 1 -- 172.21.15.42:0/316300277 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7e0c011070 con 0x7f7e1415b300 2024-09-16T01:56:17.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.267+0000 7f7e0affd640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7df406c2e0 0x7f7df406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.268+0000 7f7e0affd640 1 -- 172.21.15.42:0/316300277 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f7e0c08ad70 con 0x7f7e1415b300 2024-09-16T01:56:17.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.268+0000 7f7e1259c640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7df406c2e0 0x7f7df406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.269+0000 7f7e1259c640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7df406c2e0 0x7f7df406e7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7e04034000 tx=0x7f7e0402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:17.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.272+0000 7f7e0affd640 1 -- 172.21.15.42:0/316300277 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e0c059000 con 0x7f7e1415b300 2024-09-16T01:56:17.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.443+0000 7f7e18ee6640 1 -- 172.21.15.42:0/316300277 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e14156480 con 0x7f7df406c2e0 2024-09-16T01:56:17.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.445+0000 7f7e0affd640 1 -- 172.21.15.42:0/316300277 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13477 (secure 0 0 0) 0x7f7e14156480 con 0x7f7df406c2e0 2024-09-16T01:56:17.446 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:17.447 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:56:17.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 -- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7df406c2e0 msgr2=0x7f7df406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7df406c2e0 0x7f7df406e7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7e04034000 tx=0x7f7e0402f000 comp rx=0 tx=0).stop 2024-09-16T01:56:17.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 -- 172.21.15.42:0/316300277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 msgr2=0x7f7e140c5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 0x7f7e140c5980 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00c450 tx=0x7f7e0c00c910 comp rx=0 tx=0).stop 2024-09-16T01:56:17.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 -- 172.21.15.42:0/316300277 shutdown_connections 2024-09-16T01:56:17.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7df406c2e0 0x7f7df406e7a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e1415b300 0x7f7e140c5980 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7e140cd3f0 0x7f7e140c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 --2- 172.21.15.42:0/316300277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14072d30 0x7f7e141438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 -- 172.21.15.42:0/316300277 >> 172.21.15.42:0/316300277 conn(0x7f7e14067d70 msgr2=0x7f7e140cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:17.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 -- 172.21.15.42:0/316300277 shutdown_connections 2024-09-16T01:56:17.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.447+0000 7f7e18ee6640 1 -- 172.21.15.42:0/316300277 wait complete. 2024-09-16T01:56:17.459 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-16T01:56:16.276933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":238848,"kb_used_data":5980,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735872,"statfs":{"total":773094113280,"available":772849532928,"internally_reserved":0,"allocated":6123520,"data_stored":3359178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001319"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:56:12.317257+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:56:12.317257+0000","last_peered":"2024-09-16T01:56:12.317257+0000","last_clean":"2024-09-16T01:56:12.317257+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:56:12.317257+0000","last_undegraded":"2024-09-16T01:56:12.317257+0000","last_fullsized":"2024-09-16T01:56:12.317257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":614400,"data_stored":271387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":614400,"data_stored":271387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":614400,"data_stored":271387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31804,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1208320,"data_stored":861755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1200128,"data_stored":855484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":610304,"data_stored":273090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:56:17.460 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:56:17.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.561+0000 7fef45217640 1 Processor -- start 2024-09-16T01:56:17.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.561+0000 7fef45217640 1 -- start start 2024-09-16T01:56:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef45217640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef4006f8d0 0x7fef40165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef45217640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef400cdbe0 con 0x7fef4015b300 2024-09-16T01:56:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef45217640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef400cd900 con 0x7fef40072d30 2024-09-16T01:56:17.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef45217640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fef400728a0 con 0x7fef4006f8d0 2024-09-16T01:56:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3ed9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fef4015b300 0x7fef400cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54420/0 (socket says 172.21.15.42:54420) 2024-09-16T01:56:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3ed9d640 1 -- 172.21.15.42:0/2785083155 learned_addr learned my addr 172.21.15.42:0/2785083155 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 81851937 0 0) 0x7fef400cdbe0 con 0x7fef4015b300 2024-09-16T01:56:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3f59e640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef4006f8d0 0x7fef40165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef28003520 con 0x7fef4015b300 2024-09-16T01:56:17.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1157117078 0 0) 0x7fef28003520 con 0x7fef4015b300 2024-09-16T01:56:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef4006f8d0 msgr2=0x7fef40165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef4006f8d0 0x7fef40165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 >> v1:172.21.15.107:6789/0 conn(0x7fef40072d30 legacy=0x7fef4006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef40072250 con 0x7fef4015b300 2024-09-16T01:56:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7fef30001670 con 0x7fef4015b300 2024-09-16T01:56:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 >> v1:172.21.15.42:6789/0 conn(0x7fef4015b300 legacy=0x7fef400cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef280039e0 0x7fef28003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28004800 0x7fef28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef4006f8d0 0x7fef28005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.562+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef400728a0 con 0x7fef28004800 2024-09-16T01:56:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.563+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef2800bb20 con 0x7fef280039e0 2024-09-16T01:56:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.563+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fef2800bd20 con 0x7fef4006f8d0 2024-09-16T01:56:17.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.563+0000 7fef3e59c640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28004800 0x7fef28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.563+0000 7fef3f59e640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef4006f8d0 0x7fef28005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.563+0000 7fef3ed9d640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef280039e0 0x7fef28003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.563+0000 7fef3e59c640 1 -- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef4006f8d0 msgr2=0x7fef28005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.563+0000 7fef3e59c640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef4006f8d0 0x7fef28005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.563+0000 7fef3e59c640 1 -- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef280039e0 msgr2=0x7fef28003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.563+0000 7fef3e59c640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef280039e0 0x7fef28003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.563+0000 7fef3e59c640 1 -- 172.21.15.42:0/2785083155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef28003520 con 0x7fef28004800 2024-09-16T01:56:17.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef3e59c640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28004800 0x7fef28004c80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fef34001330 tx=0x7fef28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f40b6c9a63e961a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34001370 con 0x7fef28004800 2024-09-16T01:56:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3402cdb0 con 0x7fef28004800 2024-09-16T01:56:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef3dd9b640 1 -- 172.21.15.42:0/2785083155 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34005310 con 0x7fef28004800 2024-09-16T01:56:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef45217640 1 -- 172.21.15.42:0/2785083155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28004800 msgr2=0x7fef28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef45217640 1 --2- 172.21.15.42:0/2785083155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28004800 0x7fef28004c80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fef34001330 tx=0x7fef28005830 comp rx=0 tx=0).stop 2024-09-16T01:56:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef3f59e640 1 -- 172.21.15.42:0/2785083155 reap_dead start 2024-09-16T01:56:17.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef45217640 1 -- 172.21.15.42:0/2785083155 shutdown_connections 2024-09-16T01:56:17.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef45217640 1 -- 172.21.15.42:0/2785083155 >> 172.21.15.42:0/2785083155 conn(0x7fef40067d70 msgr2=0x7fef4006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:17.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef45217640 1 -- 172.21.15.42:0/2785083155 shutdown_connections 2024-09-16T01:56:17.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.564+0000 7fef45217640 1 -- 172.21.15.42:0/2785083155 wait complete. 2024-09-16T01:56:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.566+0000 7fef45217640 1 Processor -- start 2024-09-16T01:56:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.566+0000 7fef45217640 1 -- start start 2024-09-16T01:56:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef45217640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef28004800 0x7fef400b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef45217640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef4014f660 0x7fef400c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef45217640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef40152dd0 0x7fef40153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef45217640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef400cffe0 con 0x7fef4014f660 2024-09-16T01:56:17.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef45217640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef400cd5c0 con 0x7fef40152dd0 2024-09-16T01:56:17.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef45217640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fef400d0160 con 0x7fef28004800 2024-09-16T01:56:17.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef4014f660 0x7fef400c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3e59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef4014f660 0x7fef400c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47762/0 (socket says 172.21.15.42:47762) 2024-09-16T01:56:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3e59c640 1 -- 172.21.15.42:0/549572998 learned_addr learned my addr 172.21.15.42:0/549572998 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3ed9d640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef28004800 0x7fef400b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3f59e640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef40152dd0 0x7fef40153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3e59c640 1 -- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef28004800 msgr2=0x7fef400b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3e59c640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef28004800 0x7fef400b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3e59c640 1 -- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef40152dd0 msgr2=0x7fef40153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3e59c640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef40152dd0 0x7fef40153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3e59c640 1 -- 172.21.15.42:0/549572998 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef400c67e0 con 0x7fef4014f660 2024-09-16T01:56:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3f59e640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef40152dd0 0x7fef40153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef3e59c640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef4014f660 0x7fef400c5f90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fef34001840 tx=0x7fef34001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.567+0000 7fef277fe640 1 -- 172.21.15.42:0/549572998 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34042020 con 0x7fef4014f660 2024-09-16T01:56:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.568+0000 7fef277fe640 1 -- 172.21.15.42:0/549572998 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef34007680 con 0x7fef4014f660 2024-09-16T01:56:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.568+0000 7fef45217640 1 -- 172.21.15.42:0/549572998 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef400c6ac0 con 0x7fef4014f660 2024-09-16T01:56:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.568+0000 7fef277fe640 1 -- 172.21.15.42:0/549572998 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34001370 con 0x7fef4014f660 2024-09-16T01:56:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.568+0000 7fef45217640 1 -- 172.21.15.42:0/549572998 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef400c64d0 con 0x7fef4014f660 2024-09-16T01:56:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.568+0000 7fef45217640 1 -- 172.21.15.42:0/549572998 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef400cde10 con 0x7fef4014f660 2024-09-16T01:56:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.569+0000 7fef277fe640 1 -- 172.21.15.42:0/549572998 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fef34045020 con 0x7fef4014f660 2024-09-16T01:56:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.569+0000 7fef277fe640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fef2c06c2e0 0x7fef2c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.570+0000 7fef277fe640 1 -- 172.21.15.42:0/549572998 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7fef340ad310 con 0x7fef4014f660 2024-09-16T01:56:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.570+0000 7fef3ed9d640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fef2c06c2e0 0x7fef2c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.570+0000 7fef3ed9d640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fef2c06c2e0 0x7fef2c06e7a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fef400cfbb0 tx=0x7fef30000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:17.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.574+0000 7fef277fe640 1 -- 172.21.15.42:0/549572998 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef400cde10 con 0x7fef4014f660 2024-09-16T01:56:17.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.745+0000 7fef45217640 1 -- 172.21.15.42:0/549572998 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef400b3030 con 0x7fef2c06c2e0 2024-09-16T01:56:17.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.746+0000 7fef277fe640 1 -- 172.21.15.42:0/549572998 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13477 (secure 0 0 0) 0x7fef400b3030 con 0x7fef2c06c2e0 2024-09-16T01:56:17.748 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:17.749 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:56:17.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 -- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fef2c06c2e0 msgr2=0x7fef2c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fef2c06c2e0 0x7fef2c06e7a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fef400cfbb0 tx=0x7fef30000ed0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 -- 172.21.15.42:0/549572998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef4014f660 msgr2=0x7fef400c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef4014f660 0x7fef400c5f90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fef34001840 tx=0x7fef34001120 comp rx=0 tx=0).stop 2024-09-16T01:56:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 -- 172.21.15.42:0/549572998 shutdown_connections 2024-09-16T01:56:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fef2c06c2e0 0x7fef2c06e7a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef40152dd0 0x7fef40153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef4014f660 0x7fef400c5f90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 --2- 172.21.15.42:0/549572998 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fef28004800 0x7fef400b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 -- 172.21.15.42:0/549572998 >> 172.21.15.42:0/549572998 conn(0x7fef40067d70 msgr2=0x7fef4015ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.748+0000 7fef45217640 1 -- 172.21.15.42:0/549572998 shutdown_connections 2024-09-16T01:56:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.749+0000 7fef45217640 1 -- 172.21.15.42:0/549572998 wait complete. 2024-09-16T01:56:17.761 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-16T01:56:16.276933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":238848,"kb_used_data":5980,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735872,"statfs":{"total":773094113280,"available":772849532928,"internally_reserved":0,"allocated":6123520,"data_stored":3359178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001319"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:56:12.317257+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:56:12.317257+0000","last_peered":"2024-09-16T01:56:12.317257+0000","last_clean":"2024-09-16T01:56:12.317257+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:56:12.317257+0000","last_undegraded":"2024-09-16T01:56:12.317257+0000","last_fullsized":"2024-09-16T01:56:12.317257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":614400,"data_stored":271387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":614400,"data_stored":271387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":614400,"data_stored":271387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31804,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1208320,"data_stored":861755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1200128,"data_stored":855484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":610304,"data_stored":273090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:56:17.761 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:56:17.762 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:56:17.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.862+0000 7fe9710a6640 1 Processor -- start 2024-09-16T01:56:17.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.862+0000 7fe9710a6640 1 -- start start 2024-09-16T01:56:17.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe9710a6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe96c15e5f0 0x7fe96c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe9710a6640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe96c0b6690 0x7fe96c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe9710a6640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe96c0d3690 con 0x7fe96c0d30f0 2024-09-16T01:56:17.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe9710a6640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe96c06d530 con 0x7fe96c0b6690 2024-09-16T01:56:17.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe9710a6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe96c0d3970 con 0x7fe96c15e5f0 2024-09-16T01:56:17.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe96b59e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe96c0b6690 0x7fe96c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe96a59c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe96c0d30f0 0x7fe96c0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:54426/0 (socket says 172.21.15.42:54426) 2024-09-16T01:56:17.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe96a59c640 1 -- 172.21.15.42:0/1455895383 learned_addr learned my addr 172.21.15.42:0/1455895383 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:17.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe96b59e640 1 -- 172.21.15.42:0/1455895383 >> v2:172.21.15.107:3300/0 conn(0x7fe96c15e5f0 msgr2=0x7fe96c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:17.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe96b59e640 1 --2- 172.21.15.42:0/1455895383 >> v2:172.21.15.107:3300/0 conn(0x7fe96c15e5f0 0x7fe96c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe96b59e640 1 -- 172.21.15.42:0/1455895383 >> v1:172.21.15.42:6789/0 conn(0x7fe96c0d30f0 legacy=0x7fe96c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe969d9b640 1 -- 172.21.15.42:0/1455895383 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406160827 0 0) 0x7fe96c0d3690 con 0x7fe96c0d30f0 2024-09-16T01:56:17.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.863+0000 7fe96b59e640 1 -- 172.21.15.42:0/1455895383 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96c06cee0 con 0x7fe96c0b6690 2024-09-16T01:56:17.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.864+0000 7fe96b59e640 1 --2- 172.21.15.42:0/1455895383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0b6690 0x7fe96c06d9c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe964009d90 tx=0x7fe96402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947074807421d273 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:17.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.864+0000 7fe969d9b640 1 -- 172.21.15.42:0/1455895383 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964007740 con 0x7fe96c0b6690 2024-09-16T01:56:17.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.864+0000 7fe969d9b640 1 -- 172.21.15.42:0/1455895383 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9640078e0 con 0x7fe96c0b6690 2024-09-16T01:56:17.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.864+0000 7fe969d9b640 1 -- 172.21.15.42:0/1455895383 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964007cb0 con 0x7fe96c0b6690 2024-09-16T01:56:17.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.865+0000 7fe9710a6640 1 -- 172.21.15.42:0/1455895383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0b6690 msgr2=0x7fe96c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.865+0000 7fe9710a6640 1 --2- 172.21.15.42:0/1455895383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0b6690 0x7fe96c06d9c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe964009d90 tx=0x7fe96402a6a0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.865+0000 7fe9710a6640 1 -- 172.21.15.42:0/1455895383 shutdown_connections 2024-09-16T01:56:17.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.865+0000 7fe9710a6640 1 --2- 172.21.15.42:0/1455895383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0b6690 0x7fe96c06d9c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.865+0000 7fe9710a6640 1 --2- 172.21.15.42:0/1455895383 >> v2:172.21.15.107:3300/0 conn(0x7fe96c15e5f0 0x7fe96c0d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.865+0000 7fe9710a6640 1 -- 172.21.15.42:0/1455895383 >> 172.21.15.42:0/1455895383 conn(0x7fe96c08bfc0 msgr2=0x7fe96c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:17.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.865+0000 7fe9710a6640 1 -- 172.21.15.42:0/1455895383 shutdown_connections 2024-09-16T01:56:17.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.865+0000 7fe9710a6640 1 -- 172.21.15.42:0/1455895383 wait complete. 2024-09-16T01:56:17.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.866+0000 7fe9710a6640 1 Processor -- start 2024-09-16T01:56:17.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.866+0000 7fe9710a6640 1 -- start start 2024-09-16T01:56:17.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.867+0000 7fe9710a6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe96c0b6690 0x7fe96c15d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.867+0000 7fe9710a6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0d30f0 0x7fe96c0c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.867+0000 7fe9710a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe96c15e5f0 0x7fe96c0c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.867+0000 7fe9710a6640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe96c0d5310 con 0x7fe96c0d30f0 2024-09-16T01:56:17.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.867+0000 7fe9710a6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe96c15e9d0 con 0x7fe96c15e5f0 2024-09-16T01:56:17.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.867+0000 7fe9710a6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe96c06df00 con 0x7fe96c0b6690 2024-09-16T01:56:17.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.867+0000 7fe96a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0d30f0 0x7fe96c0c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.867+0000 7fe96a59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0d30f0 0x7fe96c0c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47780/0 (socket says 172.21.15.42:47780) 2024-09-16T01:56:17.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.867+0000 7fe96a59c640 1 -- 172.21.15.42:0/3939278855 learned_addr learned my addr 172.21.15.42:0/3939278855 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:17.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe96b59e640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe96c15e5f0 0x7fe96c0c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe96ad9d640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe96c0b6690 0x7fe96c15d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe96a59c640 1 -- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe96c0b6690 msgr2=0x7fe96c15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe96a59c640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe96c0b6690 0x7fe96c15d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe96a59c640 1 -- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe96c15e5f0 msgr2=0x7fe96c0c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:17.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe96a59c640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe96c15e5f0 0x7fe96c0c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:17.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe96a59c640 1 -- 172.21.15.42:0/3939278855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96c1616d0 con 0x7fe96c0d30f0 2024-09-16T01:56:17.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe96b59e640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe96c15e5f0 0x7fe96c0c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:17.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe96ad9d640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe96c0b6690 0x7fe96c15d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:17.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe96a59c640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0d30f0 0x7fe96c0c8030 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe96000c4d0 tx=0x7fe96000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:17.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe9537fe640 1 -- 172.21.15.42:0/3939278855 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960018070 con 0x7fe96c0d30f0 2024-09-16T01:56:17.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe9537fe640 1 -- 172.21.15.42:0/3939278855 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe960007500 con 0x7fe96c0d30f0 2024-09-16T01:56:17.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe9710a6640 1 -- 172.21.15.42:0/3939278855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe96c1619b0 con 0x7fe96c0d30f0 2024-09-16T01:56:17.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe9537fe640 1 -- 172.21.15.42:0/3939278855 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960004a20 con 0x7fe96c0d30f0 2024-09-16T01:56:17.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.868+0000 7fe9710a6640 1 -- 172.21.15.42:0/3939278855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe96c0b76d0 con 0x7fe96c0d30f0 2024-09-16T01:56:17.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.869+0000 7fe9710a6640 1 -- 172.21.15.42:0/3939278855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe96c06d9c0 con 0x7fe96c0d30f0 2024-09-16T01:56:17.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.870+0000 7fe9537fe640 1 -- 172.21.15.42:0/3939278855 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe96001b070 con 0x7fe96c0d30f0 2024-09-16T01:56:17.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.870+0000 7fe9537fe640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe95806c2b0 0x7fe95806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:17.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.870+0000 7fe9537fe640 1 -- 172.21.15.42:0/3939278855 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7fe96008a620 con 0x7fe96c0d30f0 2024-09-16T01:56:17.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.870+0000 7fe96ad9d640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe95806c2b0 0x7fe95806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:17.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.871+0000 7fe96ad9d640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe95806c2b0 0x7fe95806e770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009890 tx=0x7fe95c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:17.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:17.875+0000 7fe9537fe640 1 -- 172.21.15.42:0/3939278855 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe960058f30 con 0x7fe96c0d30f0 2024-09-16T01:56:18.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.047+0000 7fe9710a6640 1 -- 172.21.15.42:0/3939278855 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe96c0b45e0 con 0x7fe95806c2b0 2024-09-16T01:56:18.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.048+0000 7fe9537fe640 1 -- 172.21.15.42:0/3939278855 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13477 (secure 0 0 0) 0x7fe96c0b45e0 con 0x7fe95806c2b0 2024-09-16T01:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:18.050 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:56:18.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.050+0000 7fe9710a6640 1 -- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe95806c2b0 msgr2=0x7fe95806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:18.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.050+0000 7fe9710a6640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe95806c2b0 0x7fe95806e770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009890 tx=0x7fe95c008040 comp rx=0 tx=0).stop 2024-09-16T01:56:18.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.051+0000 7fe9710a6640 1 -- 172.21.15.42:0/3939278855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0d30f0 msgr2=0x7fe96c0c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.051+0000 7fe9710a6640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0d30f0 0x7fe96c0c8030 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe96000c4d0 tx=0x7fe96000c990 comp rx=0 tx=0).stop 2024-09-16T01:56:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.051+0000 7fe9710a6640 1 -- 172.21.15.42:0/3939278855 shutdown_connections 2024-09-16T01:56:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.051+0000 7fe9710a6640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fe95806c2b0 0x7fe95806e770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.051+0000 7fe9710a6640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe96c15e5f0 0x7fe96c0c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.051+0000 7fe9710a6640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe96c0d30f0 0x7fe96c0c8030 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.051+0000 7fe9710a6640 1 --2- 172.21.15.42:0/3939278855 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe96c0b6690 0x7fe96c15d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.051+0000 7fe9710a6640 1 -- 172.21.15.42:0/3939278855 >> 172.21.15.42:0/3939278855 conn(0x7fe96c08bfc0 msgr2=0x7fe96c0b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:18.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.051+0000 7fe9710a6640 1 -- 172.21.15.42:0/3939278855 shutdown_connections 2024-09-16T01:56:18.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.051+0000 7fe9710a6640 1 -- 172.21.15.42:0/3939278855 wait complete. 2024-09-16T01:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-16T01:56:16.276933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":238848,"kb_used_data":5980,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735872,"statfs":{"total":773094113280,"available":772849532928,"internally_reserved":0,"allocated":6123520,"data_stored":3359178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001319"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:56:12.317257+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:56:12.317257+0000","last_peered":"2024-09-16T01:56:12.317257+0000","last_clean":"2024-09-16T01:56:12.317257+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:56:12.317257+0000","last_undegraded":"2024-09-16T01:56:12.317257+0000","last_fullsized":"2024-09-16T01:56:12.317257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":614400,"data_stored":271387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":614400,"data_stored":271387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":614400,"data_stored":271387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31804,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1208320,"data_stored":861755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1200128,"data_stored":855484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":610304,"data_stored":273090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:56:18.064 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:56:18.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.164+0000 7ff073ffd640 1 Processor -- start 2024-09-16T01:56:18.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.164+0000 7ff073ffd640 1 -- start start 2024-09-16T01:56:18.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff073ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff06c15b300 0x7ff06c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:18.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff073ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff06c06f8d0 0x7ff06c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:18.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff073ffd640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06c0cdbe0 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff073ffd640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff06c0728a0 con 0x7ff06c06f8d0 2024-09-16T01:56:18.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff073ffd640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff06c0cd900 con 0x7ff06c15b300 2024-09-16T01:56:18.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff07259a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff06c06f8d0 0x7ff06c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:18.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff07259a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff06c06f8d0 0x7ff06c15b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50068/0 (socket says 172.21.15.42:50068) 2024-09-16T01:56:18.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff07259a640 1 -- 172.21.15.42:0/2905050529 learned_addr learned my addr 172.21.15.42:0/2905050529 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:18.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff071d99640 1 --2- 172.21.15.42:0/2905050529 >> v2:172.21.15.107:3300/0 conn(0x7ff06c15b300 0x7ff06c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:18.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff07259a640 1 -- 172.21.15.42:0/2905050529 >> v2:172.21.15.107:3300/0 conn(0x7ff06c15b300 msgr2=0x7ff06c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff07259a640 1 --2- 172.21.15.42:0/2905050529 >> v2:172.21.15.107:3300/0 conn(0x7ff06c15b300 0x7ff06c0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff07259a640 1 -- 172.21.15.42:0/2905050529 >> v1:172.21.15.107:6789/0 conn(0x7ff06c0cd3f0 legacy=0x7ff06c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:18.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.165+0000 7ff07259a640 1 -- 172.21.15.42:0/2905050529 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c072250 con 0x7ff06c06f8d0 2024-09-16T01:56:18.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.166+0000 7ff07259a640 1 --2- 172.21.15.42:0/2905050529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c06f8d0 0x7ff06c15b6e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff06c070250 tx=0x7ff06402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb65a3d9ce63c37 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:18.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.166+0000 7ff070d97640 1 -- 172.21.15.42:0/2905050529 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06400b2e0 con 0x7ff06c06f8d0 2024-09-16T01:56:18.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.166+0000 7ff070d97640 1 -- 172.21.15.42:0/2905050529 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff064037070 con 0x7ff06c06f8d0 2024-09-16T01:56:18.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.166+0000 7ff070d97640 1 -- 172.21.15.42:0/2905050529 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06400b480 con 0x7ff06c06f8d0 2024-09-16T01:56:18.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.167+0000 7ff073ffd640 1 -- 172.21.15.42:0/2905050529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c06f8d0 msgr2=0x7ff06c15b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:18.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.167+0000 7ff073ffd640 1 --2- 172.21.15.42:0/2905050529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c06f8d0 0x7ff06c15b6e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff06c070250 tx=0x7ff06402c940 comp rx=0 tx=0).stop 2024-09-16T01:56:18.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.167+0000 7ff073ffd640 1 -- 172.21.15.42:0/2905050529 shutdown_connections 2024-09-16T01:56:18.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.167+0000 7ff073ffd640 1 --2- 172.21.15.42:0/2905050529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c06f8d0 0x7ff06c15b6e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.167+0000 7ff073ffd640 1 --2- 172.21.15.42:0/2905050529 >> v2:172.21.15.107:3300/0 conn(0x7ff06c15b300 0x7ff06c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.167+0000 7ff073ffd640 1 -- 172.21.15.42:0/2905050529 >> 172.21.15.42:0/2905050529 conn(0x7ff06c067d70 msgr2=0x7ff06c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:18.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.167+0000 7ff073ffd640 1 -- 172.21.15.42:0/2905050529 shutdown_connections 2024-09-16T01:56:18.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.167+0000 7ff073ffd640 1 -- 172.21.15.42:0/2905050529 wait complete. 2024-09-16T01:56:18.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.168+0000 7ff073ffd640 1 Processor -- start 2024-09-16T01:56:18.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.168+0000 7ff073ffd640 1 -- start start 2024-09-16T01:56:18.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff073ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff06c06f8d0 0x7ff06c143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:18.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff073ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c0cd3f0 0x7ff06c1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff073ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff06c15b300 0x7ff06c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff073ffd640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c0d0160 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff073ffd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c0cffe0 con 0x7ff06c15b300 2024-09-16T01:56:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff073ffd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff06c072d30 con 0x7ff06c06f8d0 2024-09-16T01:56:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff071598640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c0cd3f0 0x7ff06c1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff071598640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c0cd3f0 0x7ff06c1558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50080/0 (socket says 172.21.15.42:50080) 2024-09-16T01:56:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff071598640 1 -- 172.21.15.42:0/3058585341 learned_addr learned my addr 172.21.15.42:0/3058585341 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:18.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff07259a640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff06c15b300 0x7ff06c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff071d99640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff06c06f8d0 0x7ff06c143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff071598640 1 -- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff06c06f8d0 msgr2=0x7ff06c143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff071598640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff06c06f8d0 0x7ff06c143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff071598640 1 -- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff06c15b300 msgr2=0x7ff06c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff071598640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff06c15b300 0x7ff06c15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.169+0000 7ff071598640 1 -- 172.21.15.42:0/3058585341 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c1562d0 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.170+0000 7ff071598640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c0cd3f0 0x7ff06c1558f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00c400 tx=0x7ff05c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.170+0000 7ff0627fc640 1 -- 172.21.15.42:0/3058585341 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0052d0 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.170+0000 7ff0627fc640 1 -- 172.21.15.42:0/3058585341 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05c005490 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.170+0000 7ff073ffd640 1 -- 172.21.15.42:0/3058585341 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06c1565b0 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.170+0000 7ff0627fc640 1 -- 172.21.15.42:0/3058585341 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c007260 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.170+0000 7ff073ffd640 1 -- 172.21.15.42:0/3058585341 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06c156b70 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.171+0000 7ff073ffd640 1 -- 172.21.15.42:0/3058585341 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff06c15a8a0 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.171+0000 7ff0627fc640 1 -- 172.21.15.42:0/3058585341 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff05c007400 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.172+0000 7ff0627fc640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05006c2b0 0x7ff05006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:18.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.172+0000 7ff0627fc640 1 -- 172.21.15.42:0/3058585341 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7ff05c08a6c0 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.172+0000 7ff071d99640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05006c2b0 0x7ff05006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.173+0000 7ff071d99640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05006c2b0 0x7ff05006e770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff0680079a0 tx=0x7ff068008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.176+0000 7ff0627fc640 1 -- 172.21.15.42:0/3058585341 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff05c0589e0 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.350+0000 7ff073ffd640 1 -- 172.21.15.42:0/3058585341 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff06c157370 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.351+0000 7ff0627fc640 1 -- 172.21.15.42:0/3058585341 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+13291 (secure 0 0 0) 0x7ff05c05cce0 con 0x7ff06c0cd3f0 2024-09-16T01:56:18.353 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:18.353 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":53,"fsid":"356ce71f-2ad9-4fe3-af21-266c510b09c8","created":"2024-09-16T01:53:58.043256+0000","modified":"2024-09-16T01:56:15.012723+0000","last_up_change":"2024-09-16T01:54:09.335870+0000","last_in_change":"2024-09-16T01:54:00.146407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:54:08.299569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"508cf9e9-0769-4afd-86cf-48af76ed36cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6809","nonce":4033955434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6811","nonce":4033955434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6815","nonce":4033955434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":4033955434},{"type":"v1","addr":"172.21.15.42:6813","nonce":4033955434}]},"public_addr":"172.21.15.42:6809/4033955434","cluster_addr":"172.21.15.42:6811/4033955434","heartbeat_back_addr":"172.21.15.42:6815/4033955434","heartbeat_front_addr":"172.21.15.42:6813/4033955434","state":["exists","up"]},{"osd":1,"uuid":"920a2682-24f3-445d-9f9f-724c7753bbbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6825","nonce":2370128537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6827","nonce":2370128537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6831","nonce":2370128537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":2370128537},{"type":"v1","addr":"172.21.15.42:6829","nonce":2370128537}]},"public_addr":"172.21.15.42:6825/2370128537","cluster_addr":"172.21.15.42:6827/2370128537","heartbeat_back_addr":"172.21.15.42:6831/2370128537","heartbeat_front_addr":"172.21.15.42:6829/2370128537","state":["exists","up"]},{"osd":2,"uuid":"57b7ae20-811c-44ce-b992-d1658bfe7c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6801","nonce":773751051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6803","nonce":773751051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6807","nonce":773751051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":773751051},{"type":"v1","addr":"172.21.15.42:6805","nonce":773751051}]},"public_addr":"172.21.15.42:6801/773751051","cluster_addr":"172.21.15.42:6803/773751051","heartbeat_back_addr":"172.21.15.42:6807/773751051","heartbeat_front_addr":"172.21.15.42:6805/773751051","state":["exists","up"]},{"osd":3,"uuid":"550be68c-fdb9-4643-b20d-0cd602a754ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6817","nonce":3057553949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6819","nonce":3057553949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6823","nonce":3057553949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3057553949},{"type":"v1","addr":"172.21.15.42:6821","nonce":3057553949}]},"public_addr":"172.21.15.42:6817/3057553949","cluster_addr":"172.21.15.42:6819/3057553949","heartbeat_back_addr":"172.21.15.42:6823/3057553949","heartbeat_front_addr":"172.21.15.42:6821/3057553949","state":["exists","up"]},{"osd":4,"uuid":"a9f2c68b-9906-472b-af51-1f7707c3cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6809","nonce":3395815991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6811","nonce":3395815991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6815","nonce":3395815991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3395815991},{"type":"v1","addr":"172.21.15.107:6813","nonce":3395815991}]},"public_addr":"172.21.15.107:6809/3395815991","cluster_addr":"172.21.15.107:6811/3395815991","heartbeat_back_addr":"172.21.15.107:6815/3395815991","heartbeat_front_addr":"172.21.15.107:6813/3395815991","state":["exists","up"]},{"osd":5,"uuid":"484684e7-8177-4db0-a40b-ccbe75d070d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6817","nonce":188494589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6819","nonce":188494589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6823","nonce":188494589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":188494589},{"type":"v1","addr":"172.21.15.107:6821","nonce":188494589}]},"public_addr":"172.21.15.107:6817/188494589","cluster_addr":"172.21.15.107:6819/188494589","heartbeat_back_addr":"172.21.15.107:6823/188494589","heartbeat_front_addr":"172.21.15.107:6821/188494589","state":["exists","up"]},{"osd":6,"uuid":"17c46c97-625c-4570-8156-7eee3de3c26b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6825","nonce":986436490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6827","nonce":986436490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6831","nonce":986436490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":986436490},{"type":"v1","addr":"172.21.15.107:6829","nonce":986436490}]},"public_addr":"172.21.15.107:6825/986436490","cluster_addr":"172.21.15.107:6827/986436490","heartbeat_back_addr":"172.21.15.107:6831/986436490","heartbeat_front_addr":"172.21.15.107:6829/986436490","state":["exists","up"]},{"osd":7,"uuid":"cc31a75c-2b98-4d25-a7cf-e0be100618c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6801","nonce":1756026323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6803","nonce":1756026323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6807","nonce":1756026323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1756026323},{"type":"v1","addr":"172.21.15.107:6805","nonce":1756026323}]},"public_addr":"172.21.15.107:6801/1756026323","cluster_addr":"172.21.15.107:6803/1756026323","heartbeat_back_addr":"172.21.15.107:6807/1756026323","heartbeat_front_addr":"172.21.15.107:6805/1756026323","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.415345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:07.134058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.165042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.743385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.230327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.350388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:06.911735+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:54:05.963933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6836/19167184":"2024-09-17T01:56:11.925848+0000","172.21.15.107:6834/19167184":"2024-09-17T01:56:11.925848+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:56:18.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 -- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05006c2b0 msgr2=0x7ff05006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:18.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05006c2b0 0x7ff05006e770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff0680079a0 tx=0x7ff068008040 comp rx=0 tx=0).stop 2024-09-16T01:56:18.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 -- 172.21.15.42:0/3058585341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c0cd3f0 msgr2=0x7ff06c1558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:18.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c0cd3f0 0x7ff06c1558f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00c400 tx=0x7ff05c00c8c0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 -- 172.21.15.42:0/3058585341 shutdown_connections 2024-09-16T01:56:18.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05006c2b0 0x7ff05006e770 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff06c15b300 0x7ff06c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff06c0cd3f0 0x7ff06c1558f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 --2- 172.21.15.42:0/3058585341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff06c06f8d0 0x7ff06c143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:18.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 -- 172.21.15.42:0/3058585341 >> 172.21.15.42:0/3058585341 conn(0x7ff06c067d70 msgr2=0x7ff06c0b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:18.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 -- 172.21.15.42:0/3058585341 shutdown_connections 2024-09-16T01:56:18.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:18.353+0000 7ff073ffd640 1 -- 172.21.15.42:0/3058585341 wait complete. 2024-09-16T01:56:19.366 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T01:56:19.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:56:19.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.486+0000 7fc526d4b640 1 Processor -- start 2024-09-16T01:56:19.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.486+0000 7fc526d4b640 1 -- start start 2024-09-16T01:56:19.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.486+0000 7fc526d4b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52006d740 0x7fc5200cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.486+0000 7fc526d4b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52015ff70 con 0x7fc520162e30 2024-09-16T01:56:19.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.486+0000 7fc526d4b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52006dbd0 con 0x7fc520162340 2024-09-16T01:56:19.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.486+0000 7fc526d4b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc52006de90 con 0x7fc52006d740 2024-09-16T01:56:19.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51ffff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc520162e30 0x7fc5200d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57748/0 (socket says 172.21.15.42:57748) 2024-09-16T01:56:19.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51ffff640 1 -- 172.21.15.42:0/3548123829 learned_addr learned my addr 172.21.15.42:0/3548123829 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:19.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc5252e8640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52006d740 0x7fc5200cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345919458 0 0) 0x7fc52015ff70 con 0x7fc520162e30 2024-09-16T01:56:19.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc508003520 con 0x7fc520162e30 2024-09-16T01:56:19.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1987196237 0 0) 0x7fc508003520 con 0x7fc520162e30 2024-09-16T01:56:19.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52006d740 msgr2=0x7fc5200cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:19.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52006d740 0x7fc5200cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 >> v1:172.21.15.107:6789/0 conn(0x7fc520162340 legacy=0x7fc520162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5200d4d10 con 0x7fc520162e30 2024-09-16T01:56:19.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7fc5140017f0 con 0x7fc520162e30 2024-09-16T01:56:19.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 >> v1:172.21.15.42:6789/0 conn(0x7fc520162e30 legacy=0x7fc5200d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52006d740 0x7fc5080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc508003f60 0x7fc508004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc508004d40 0x7fc5080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc52006de90 con 0x7fc508004d40 2024-09-16T01:56:19.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc50800bb50 con 0x7fc508003f60 2024-09-16T01:56:19.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc50800bd50 con 0x7fc52006d740 2024-09-16T01:56:19.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc5252e8640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc508004d40 0x7fc5080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.487+0000 7fc51ffff640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc508003f60 0x7fc508004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.488+0000 7fc524ae7640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52006d740 0x7fc5080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.488+0000 7fc5252e8640 1 -- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52006d740 msgr2=0x7fc5080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.488+0000 7fc5252e8640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52006d740 0x7fc5080039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.488+0000 7fc5252e8640 1 -- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc508003f60 msgr2=0x7fc508004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.488+0000 7fc5252e8640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc508003f60 0x7fc508004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.488+0000 7fc5252e8640 1 -- 172.21.15.42:0/3548123829 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc508003520 con 0x7fc508004d40 2024-09-16T01:56:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.488+0000 7fc5252e8640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc508004d40 0x7fc5080051c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc518009fc0 tx=0x7fc508005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31c7180f4512aea server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.489+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518009c10 con 0x7fc508004d40 2024-09-16T01:56:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.489+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc518036070 con 0x7fc508004d40 2024-09-16T01:56:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.489+0000 7fc51f7fe640 1 -- 172.21.15.42:0/3548123829 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518031880 con 0x7fc508004d40 2024-09-16T01:56:19.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.489+0000 7fc526d4b640 1 -- 172.21.15.42:0/3548123829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc508004d40 msgr2=0x7fc5080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.489+0000 7fc526d4b640 1 --2- 172.21.15.42:0/3548123829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc508004d40 0x7fc5080051c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc518009fc0 tx=0x7fc508005830 comp rx=0 tx=0).stop 2024-09-16T01:56:19.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.489+0000 7fc5252e8640 1 -- 172.21.15.42:0/3548123829 reap_dead start 2024-09-16T01:56:19.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.489+0000 7fc526d4b640 1 -- 172.21.15.42:0/3548123829 shutdown_connections 2024-09-16T01:56:19.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.489+0000 7fc526d4b640 1 -- 172.21.15.42:0/3548123829 >> 172.21.15.42:0/3548123829 conn(0x7fc52008bfc0 msgr2=0x7fc5200d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:19.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.489+0000 7fc526d4b640 1 -- 172.21.15.42:0/3548123829 shutdown_connections 2024-09-16T01:56:19.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.489+0000 7fc526d4b640 1 -- 172.21.15.42:0/3548123829 wait complete. 2024-09-16T01:56:19.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.490+0000 7fc526d4b640 1 Processor -- start 2024-09-16T01:56:19.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.491+0000 7fc526d4b640 1 -- start start 2024-09-16T01:56:19.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.491+0000 7fc526d4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc520154840 0x7fc5200b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.491+0000 7fc526d4b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52015e9b0 0x7fc5200cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.491+0000 7fc526d4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5200cdaf0 0x7fc5200b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.491+0000 7fc526d4b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc5200d2470 con 0x7fc5200cdaf0 2024-09-16T01:56:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.491+0000 7fc526d4b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc520163270 con 0x7fc520154840 2024-09-16T01:56:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.491+0000 7fc526d4b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc5200d52d0 con 0x7fc52015e9b0 2024-09-16T01:56:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc5252e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5200cdaf0 0x7fc5200b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc5252e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5200cdaf0 0x7fc5200b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50102/0 (socket says 172.21.15.42:50102) 2024-09-16T01:56:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc5252e8640 1 -- 172.21.15.42:0/237254013 learned_addr learned my addr 172.21.15.42:0/237254013 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc51ffff640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52015e9b0 0x7fc5200cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc524ae7640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc520154840 0x7fc5200b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc5252e8640 1 -- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52015e9b0 msgr2=0x7fc5200cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc5252e8640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc52015e9b0 0x7fc5200cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc5252e8640 1 -- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc520154840 msgr2=0x7fc5200b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc5252e8640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc520154840 0x7fc5200b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc5252e8640 1 -- 172.21.15.42:0/237254013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52015f0c0 con 0x7fc5200cdaf0 2024-09-16T01:56:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc5252e8640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5200cdaf0 0x7fc5200b7300 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc51800e230 tx=0x7fc518009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc51d7fa640 1 -- 172.21.15.42:0/237254013 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518009c10 con 0x7fc5200cdaf0 2024-09-16T01:56:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc51d7fa640 1 -- 172.21.15.42:0/237254013 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc518031dd0 con 0x7fc5200cdaf0 2024-09-16T01:56:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5200b58e0 con 0x7fc5200cdaf0 2024-09-16T01:56:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc51d7fa640 1 -- 172.21.15.42:0/237254013 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518003bd0 con 0x7fc5200cdaf0 2024-09-16T01:56:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.492+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5200b5ea0 con 0x7fc5200cdaf0 2024-09-16T01:56:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.493+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc5200b6ec0 con 0x7fc5200cdaf0 2024-09-16T01:56:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.494+0000 7fc51d7fa640 1 -- 172.21.15.42:0/237254013 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc518005d10 con 0x7fc5200cdaf0 2024-09-16T01:56:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.494+0000 7fc51d7fa640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc50c06c2b0 0x7fc50c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.494+0000 7fc51d7fa640 1 -- 172.21.15.42:0/237254013 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7fc5180ac410 con 0x7fc5200cdaf0 2024-09-16T01:56:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.494+0000 7fc51d7fa640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] conn(0x7fc50c072750 0x7fc50c074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.494+0000 7fc524ae7640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc50c06c2b0 0x7fc50c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.494+0000 7fc51d7fa640 1 -- 172.21.15.42:0/237254013 --> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc50c075260 con 0x7fc50c072750 2024-09-16T01:56:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.495+0000 7fc51d7fa640 1 -- 172.21.15.42:0/237254013 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fc5180b3050 con 0x7fc5200cdaf0 2024-09-16T01:56:19.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.495+0000 7fc51ffff640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] conn(0x7fc50c072750 0x7fc50c074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.495+0000 7fc524ae7640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc50c06c2b0 0x7fc50c06e770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc5100017e0 tx=0x7fc510009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.495+0000 7fc51ffff640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] conn(0x7fc50c072750 0x7fc50c074b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.496+0000 7fc51d7fa640 1 -- 172.21.15.42:0/237254013 <== osd.0 v2:172.21.15.42:6808/4033955434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc50c075260 con 0x7fc50c072750 2024-09-16T01:56:19.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.508+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 --> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc52008e640 con 0x7fc50c072750 2024-09-16T01:56:19.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.508+0000 7fc51d7fa640 1 -- 172.21.15.42:0/237254013 <== osd.0 v2:172.21.15.42:6808/4033955434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc52008e640 con 0x7fc50c072750 2024-09-16T01:56:19.510 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:56:19.510 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:56:19.511 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:56:19.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 >> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] conn(0x7fc50c072750 msgr2=0x7fc50c074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc526d4b640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.42:6808/4033955434,v1:172.21.15.42:6809/4033955434] conn(0x7fc50c072750 0x7fc50c074b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc50c06c2b0 msgr2=0x7fc50c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc526d4b640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fc50c06c2b0 0x7fc50c06e770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc5100017e0 tx=0x7fc510009040 comp rx=0 tx=0).stop 2024-09-16T01:56:19.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5200cdaf0 msgr2=0x7fc5200b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc526d4b640 1 --2- 172.21.15.42:0/237254013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5200cdaf0 0x7fc5200b7300 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc51800e230 tx=0x7fc518009750 comp rx=0 tx=0).stop 2024-09-16T01:56:19.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc5252e8640 1 -- 172.21.15.42:0/237254013 reap_dead start 2024-09-16T01:56:19.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 shutdown_connections 2024-09-16T01:56:19.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 >> 172.21.15.42:0/237254013 conn(0x7fc52008bfc0 msgr2=0x7fc520162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:19.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 shutdown_connections 2024-09-16T01:56:19.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.509+0000 7fc526d4b640 1 -- 172.21.15.42:0/237254013 wait complete. 2024-09-16T01:56:19.521 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T01:56:19.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.624+0000 7f2b72fb9640 1 Processor -- start 2024-09-16T01:56:19.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.624+0000 7f2b72fb9640 1 -- start start 2024-09-16T01:56:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b72fb9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c15e5d0 0x7f2b6c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b72fb9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6c06cec0 con 0x7f2b6c09b140 2024-09-16T01:56:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b72fb9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6c06d1a0 con 0x7f2b6c06df60 2024-09-16T01:56:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b72fb9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c06dad0 con 0x7f2b6c15e5d0 2024-09-16T01:56:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b71556640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2b6c09b140 0x7f2b6c168560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57754/0 (socket says 172.21.15.42:57754) 2024-09-16T01:56:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b71556640 1 -- 172.21.15.42:0/3584947711 learned_addr learned my addr 172.21.15.42:0/3584947711 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b70d55640 1 --2- 172.21.15.42:0/3584947711 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c15e5d0 0x7f2b6c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b6b7fe640 1 -- 172.21.15.42:0/3584947711 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904918053 0 0) 0x7f2b6c06cec0 con 0x7f2b6c09b140 2024-09-16T01:56:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b6b7fe640 1 -- 172.21.15.42:0/3584947711 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b5c003520 con 0x7f2b6c09b140 2024-09-16T01:56:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b6b7fe640 1 -- 172.21.15.42:0/3584947711 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1876893573 0 0) 0x7f2b6c06d1a0 con 0x7f2b6c06df60 2024-09-16T01:56:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b6b7fe640 1 -- 172.21.15.42:0/3584947711 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b6c06cec0 con 0x7f2b6c06df60 2024-09-16T01:56:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b70d55640 1 -- 172.21.15.42:0/3584947711 >> v1:172.21.15.107:6789/0 conn(0x7f2b6c06df60 legacy=0x7f2b6c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b70d55640 1 -- 172.21.15.42:0/3584947711 >> v1:172.21.15.42:6789/0 conn(0x7f2b6c09b140 legacy=0x7f2b6c168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.625+0000 7f2b70d55640 1 -- 172.21.15.42:0/3584947711 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c06d480 con 0x7f2b6c15e5d0 2024-09-16T01:56:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.626+0000 7f2b70d55640 1 --2- 172.21.15.42:0/3584947711 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c15e5d0 0x7f2b6c0d10f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b600097d0 tx=0x7f2b6002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=589b6ec926a2d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.627+0000 7f2b6b7fe640 1 -- 172.21.15.42:0/3584947711 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60037070 con 0x7f2b6c15e5d0 2024-09-16T01:56:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.627+0000 7f2b6b7fe640 1 -- 172.21.15.42:0/3584947711 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b60032440 con 0x7f2b6c15e5d0 2024-09-16T01:56:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.627+0000 7f2b6b7fe640 1 -- 172.21.15.42:0/3584947711 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600327f0 con 0x7f2b6c15e5d0 2024-09-16T01:56:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.627+0000 7f2b72fb9640 1 -- 172.21.15.42:0/3584947711 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c15e5d0 msgr2=0x7f2b6c0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.627+0000 7f2b72fb9640 1 --2- 172.21.15.42:0/3584947711 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c15e5d0 0x7f2b6c0d10f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b600097d0 tx=0x7f2b6002a290 comp rx=0 tx=0).stop 2024-09-16T01:56:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.627+0000 7f2b72fb9640 1 -- 172.21.15.42:0/3584947711 shutdown_connections 2024-09-16T01:56:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.627+0000 7f2b72fb9640 1 --2- 172.21.15.42:0/3584947711 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c15e5d0 0x7f2b6c0d10f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.627+0000 7f2b72fb9640 1 -- 172.21.15.42:0/3584947711 >> 172.21.15.42:0/3584947711 conn(0x7f2b6c0d23a0 msgr2=0x7f2b6c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.627+0000 7f2b72fb9640 1 -- 172.21.15.42:0/3584947711 shutdown_connections 2024-09-16T01:56:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.627+0000 7f2b72fb9640 1 -- 172.21.15.42:0/3584947711 wait complete. 2024-09-16T01:56:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.628+0000 7f2b72fb9640 1 Processor -- start 2024-09-16T01:56:19.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.628+0000 7f2b72fb9640 1 -- start start 2024-09-16T01:56:19.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.629+0000 7f2b72fb9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c06df60 0x7f2b6c0b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.629+0000 7f2b72fb9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c09b140 0x7f2b6c0b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.629+0000 7f2b72fb9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b6c15e5d0 0x7f2b6c157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.629+0000 7f2b72fb9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c15eb30 con 0x7f2b6c06df60 2024-09-16T01:56:19.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.629+0000 7f2b72fb9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c15e9b0 con 0x7f2b6c15e5d0 2024-09-16T01:56:19.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.629+0000 7f2b72fb9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6c0d1630 con 0x7f2b6c09b140 2024-09-16T01:56:19.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.629+0000 7f2b70d55640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c06df60 0x7f2b6c0b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.629+0000 7f2b70d55640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c06df60 0x7f2b6c0b5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50104/0 (socket says 172.21.15.42:50104) 2024-09-16T01:56:19.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.629+0000 7f2b70d55640 1 -- 172.21.15.42:0/1956021147 learned_addr learned my addr 172.21.15.42:0/1956021147 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:19.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.629+0000 7f2b6bfff640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c09b140 0x7f2b6c0b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b71556640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b6c15e5d0 0x7f2b6c157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b70d55640 1 -- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c09b140 msgr2=0x7f2b6c0b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b70d55640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c09b140 0x7f2b6c0b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b70d55640 1 -- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b6c15e5d0 msgr2=0x7f2b6c157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b70d55640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b6c15e5d0 0x7f2b6c157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b70d55640 1 -- 172.21.15.42:0/1956021147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c0b6dd0 con 0x7f2b6c06df60 2024-09-16T01:56:19.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b70d55640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c06df60 0x7f2b6c0b5fb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2b600097d0 tx=0x7f2b600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b697fa640 1 -- 172.21.15.42:0/1956021147 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60041020 con 0x7f2b6c06df60 2024-09-16T01:56:19.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b697fa640 1 -- 172.21.15.42:0/1956021147 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6003d640 con 0x7f2b6c06df60 2024-09-16T01:56:19.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b72fb9640 1 -- 172.21.15.42:0/1956021147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6c0b70b0 con 0x7f2b6c06df60 2024-09-16T01:56:19.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b697fa640 1 -- 172.21.15.42:0/1956021147 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60037040 con 0x7f2b6c06df60 2024-09-16T01:56:19.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.630+0000 7f2b72fb9640 1 -- 172.21.15.42:0/1956021147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6c0b7670 con 0x7f2b6c06df60 2024-09-16T01:56:19.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.631+0000 7f2b72fb9640 1 -- 172.21.15.42:0/1956021147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b6c0d10f0 con 0x7f2b6c06df60 2024-09-16T01:56:19.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.632+0000 7f2b697fa640 1 -- 172.21.15.42:0/1956021147 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2b60044020 con 0x7f2b6c06df60 2024-09-16T01:56:19.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.632+0000 7f2b697fa640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2b5006c2b0 0x7f2b5006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.632+0000 7f2b697fa640 1 -- 172.21.15.42:0/1956021147 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f2b600ab890 con 0x7f2b6c06df60 2024-09-16T01:56:19.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.632+0000 7f2b6bfff640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2b5006c2b0 0x7f2b5006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.633+0000 7f2b6bfff640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2b5006c2b0 0x7f2b5006e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2b58007fd0 tx=0x7f2b58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.637+0000 7f2b697fa640 1 -- 172.21.15.42:0/1956021147 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b6004b030 con 0x7f2b6c06df60 2024-09-16T01:56:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.811+0000 7f2b72fb9640 1 -- 172.21.15.42:0/1956021147 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f2b6c0b8320 con 0x7f2b5006c2b0 2024-09-16T01:56:19.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.812+0000 7f2b697fa640 1 -- 172.21.15.42:0/1956021147 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2b6c0b8320 con 0x7f2b5006c2b0 2024-09-16T01:56:19.814 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T01:56:19.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 -- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2b5006c2b0 msgr2=0x7f2b5006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2b5006c2b0 0x7f2b5006e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2b58007fd0 tx=0x7f2b58009040 comp rx=0 tx=0).stop 2024-09-16T01:56:19.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 -- 172.21.15.42:0/1956021147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c06df60 msgr2=0x7f2b6c0b5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c06df60 0x7f2b6c0b5fb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2b600097d0 tx=0x7f2b600046c0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 -- 172.21.15.42:0/1956021147 shutdown_connections 2024-09-16T01:56:19.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f2b5006c2b0 0x7f2b5006e770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b6c15e5d0 0x7f2b6c157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2b6c09b140 0x7f2b6c0b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 --2- 172.21.15.42:0/1956021147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b6c06df60 0x7f2b6c0b5fb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 -- 172.21.15.42:0/1956021147 >> 172.21.15.42:0/1956021147 conn(0x7f2b6c0d23a0 msgr2=0x7f2b6c0d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 -- 172.21.15.42:0/1956021147 shutdown_connections 2024-09-16T01:56:19.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.814+0000 7f2b72fb9640 1 -- 172.21.15.42:0/1956021147 wait complete. 2024-09-16T01:56:19.826 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T01:56:19.826 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:56:19.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.932+0000 7fecb319f640 1 Processor -- start 2024-09-16T01:56:19.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.932+0000 7fecb319f640 1 -- start start 2024-09-16T01:56:19.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.932+0000 7fecb319f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac0af210 0x7fecac070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.932+0000 7fecb319f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fecac070fb0 0x7fecac06de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.932+0000 7fecb319f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecac06cdc0 con 0x7fecac15e7f0 2024-09-16T01:56:19.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.932+0000 7fecb319f640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fecac06d0a0 con 0x7fecac070fb0 2024-09-16T01:56:19.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.932+0000 7fecb319f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fecac06d380 con 0x7fecac0af210 2024-09-16T01:56:19.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.933+0000 7fecb173c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fecac070fb0 0x7fecac06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.933+0000 7fecb173c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fecac070fb0 0x7fecac06de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50120/0 (socket says 172.21.15.42:50120) 2024-09-16T01:56:19.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.933+0000 7fecb173c640 1 -- 172.21.15.42:0/1409455826 learned_addr learned my addr 172.21.15.42:0/1409455826 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:19.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.933+0000 7fecabfff640 1 --2- 172.21.15.42:0/1409455826 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac0af210 0x7fecac070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.933+0000 7fecb173c640 1 -- 172.21.15.42:0/1409455826 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac0af210 msgr2=0x7fecac070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:19.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.933+0000 7fecb173c640 1 --2- 172.21.15.42:0/1409455826 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac0af210 0x7fecac070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.933+0000 7fecb173c640 1 -- 172.21.15.42:0/1409455826 >> v1:172.21.15.107:6789/0 conn(0x7fecac15e7f0 legacy=0x7fecac0b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:19.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.933+0000 7fecb173c640 1 -- 172.21.15.42:0/1409455826 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac06d660 con 0x7fecac070fb0 2024-09-16T01:56:19.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.933+0000 7fecabfff640 1 --2- 172.21.15.42:0/1409455826 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac0af210 0x7fecac070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:56:19.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.934+0000 7fecb173c640 1 --2- 172.21.15.42:0/1409455826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac070fb0 0x7fecac06de60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7feca4009e50 tx=0x7feca402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94eb6ded858cb53 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.934+0000 7fecab7fe640 1 -- 172.21.15.42:0/1409455826 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4036070 con 0x7fecac070fb0 2024-09-16T01:56:19.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.934+0000 7fecab7fe640 1 -- 172.21.15.42:0/1409455826 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca4031600 con 0x7fecac070fb0 2024-09-16T01:56:19.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.934+0000 7fecab7fe640 1 -- 172.21.15.42:0/1409455826 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca40319d0 con 0x7fecac070fb0 2024-09-16T01:56:19.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.934+0000 7fecb319f640 1 -- 172.21.15.42:0/1409455826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac070fb0 msgr2=0x7fecac06de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.934+0000 7fecb319f640 1 --2- 172.21.15.42:0/1409455826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac070fb0 0x7fecac06de60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7feca4009e50 tx=0x7feca402a6c0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.934+0000 7fecb319f640 1 -- 172.21.15.42:0/1409455826 shutdown_connections 2024-09-16T01:56:19.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.934+0000 7fecb319f640 1 --2- 172.21.15.42:0/1409455826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac070fb0 0x7fecac06de60 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.934+0000 7fecb319f640 1 --2- 172.21.15.42:0/1409455826 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac0af210 0x7fecac070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.934+0000 7fecb319f640 1 -- 172.21.15.42:0/1409455826 >> 172.21.15.42:0/1409455826 conn(0x7fecac0b3f30 msgr2=0x7fecac0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.935+0000 7fecb319f640 1 -- 172.21.15.42:0/1409455826 shutdown_connections 2024-09-16T01:56:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.935+0000 7fecb319f640 1 -- 172.21.15.42:0/1409455826 wait complete. 2024-09-16T01:56:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.936+0000 7fecb319f640 1 Processor -- start 2024-09-16T01:56:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.936+0000 7fecb319f640 1 -- start start 2024-09-16T01:56:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb319f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac070fb0 0x7fecac0cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb319f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecac0af210 0x7fecac160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb319f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac15e7f0 0x7fecac160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb319f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fecac0b60c0 con 0x7fecac15e7f0 2024-09-16T01:56:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb319f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fecac0b5f40 con 0x7fecac0af210 2024-09-16T01:56:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb319f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fecac06e3a0 con 0x7fecac070fb0 2024-09-16T01:56:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb173c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac15e7f0 0x7fecac160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb173c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac15e7f0 0x7fecac160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50122/0 (socket says 172.21.15.42:50122) 2024-09-16T01:56:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb173c640 1 -- 172.21.15.42:0/408702353 learned_addr learned my addr 172.21.15.42:0/408702353 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb0f3b640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac070fb0 0x7fecac0cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecabfff640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecac0af210 0x7fecac160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb173c640 1 -- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac070fb0 msgr2=0x7fecac0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb173c640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac070fb0 0x7fecac0cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb173c640 1 -- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecac0af210 msgr2=0x7fecac160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb173c640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecac0af210 0x7fecac160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb173c640 1 -- 172.21.15.42:0/408702353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac150e10 con 0x7fecac15e7f0 2024-09-16T01:56:19.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb0f3b640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fecac070fb0 0x7fecac0cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:19.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecabfff640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fecac0af210 0x7fecac160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:19.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb173c640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac15e7f0 0x7fecac160f50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feca4034040 tx=0x7feca4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7feca97fa640 1 -- 172.21.15.42:0/408702353 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4036050 con 0x7fecac15e7f0 2024-09-16T01:56:19.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7feca97fa640 1 -- 172.21.15.42:0/408702353 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca4042070 con 0x7fecac15e7f0 2024-09-16T01:56:19.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecac1510f0 con 0x7fecac15e7f0 2024-09-16T01:56:19.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7feca97fa640 1 -- 172.21.15.42:0/408702353 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4009510 con 0x7fecac15e7f0 2024-09-16T01:56:19.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.937+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecac1516b0 con 0x7fecac15e7f0 2024-09-16T01:56:19.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.938+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecac06de60 con 0x7fecac15e7f0 2024-09-16T01:56:19.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.939+0000 7feca97fa640 1 -- 172.21.15.42:0/408702353 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feca4007bf0 con 0x7fecac15e7f0 2024-09-16T01:56:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.939+0000 7feca97fa640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fec9006c2b0 0x7fec9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.939+0000 7feca97fa640 1 -- 172.21.15.42:0/408702353 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7feca40ac2d0 con 0x7fecac15e7f0 2024-09-16T01:56:19.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.939+0000 7feca97fa640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x7fec90072750 0x7fec90074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:19.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.939+0000 7feca97fa640 1 -- 172.21.15.42:0/408702353 --> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feca4043ec0 con 0x7fec90072750 2024-09-16T01:56:19.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.939+0000 7feca97fa640 1 -- 172.21.15.42:0/408702353 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7feca40b3050 con 0x7fecac15e7f0 2024-09-16T01:56:19.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.939+0000 7fecb0f3b640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fec9006c2b0 0x7fec9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.940+0000 7fecabfff640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x7fec90072750 0x7fec90074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:19.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.940+0000 7fecabfff640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x7fec90072750 0x7fec90074b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.940+0000 7fecb0f3b640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fec9006c2b0 0x7fec9006e770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feca0006fd0 tx=0x7feca0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:19.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.941+0000 7feca97fa640 1 -- 172.21.15.42:0/408702353 <== osd.1 v2:172.21.15.42:6824/2370128537 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feca4043ec0 con 0x7fec90072750 2024-09-16T01:56:19.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.953+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 --> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fecac0d3080 con 0x7fec90072750 2024-09-16T01:56:19.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.953+0000 7feca97fa640 1 -- 172.21.15.42:0/408702353 <== osd.1 v2:172.21.15.42:6824/2370128537 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fecac0d3080 con 0x7fec90072750 2024-09-16T01:56:19.955 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:56:19.955 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:56:19.955 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:56:19.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x7fec90072750 msgr2=0x7fec90074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb319f640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.42:6824/2370128537,v1:172.21.15.42:6825/2370128537] conn(0x7fec90072750 0x7fec90074b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:19.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fec9006c2b0 msgr2=0x7fec9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb319f640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fec9006c2b0 0x7fec9006e770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feca0006fd0 tx=0x7feca0008040 comp rx=0 tx=0).stop 2024-09-16T01:56:19.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac15e7f0 msgr2=0x7fecac160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:19.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb319f640 1 --2- 172.21.15.42:0/408702353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecac15e7f0 0x7fecac160f50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feca4034040 tx=0x7feca4004a40 comp rx=0 tx=0).stop 2024-09-16T01:56:19.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb173c640 1 -- 172.21.15.42:0/408702353 reap_dead start 2024-09-16T01:56:19.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 shutdown_connections 2024-09-16T01:56:19.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 >> 172.21.15.42:0/408702353 conn(0x7fecac0b3f30 msgr2=0x7fecac0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:19.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 shutdown_connections 2024-09-16T01:56:19.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:19.954+0000 7fecb319f640 1 -- 172.21.15.42:0/408702353 wait complete. 2024-09-16T01:56:19.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T01:56:20.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.067+0000 7f061c55f640 1 Processor -- start 2024-09-16T01:56:20.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.067+0000 7f061c55f640 1 -- start start 2024-09-16T01:56:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.068+0000 7f061c55f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06140b3760 0x7f06140b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.068+0000 7f061c55f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f061406cd20 0x7f0614162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.068+0000 7f061c55f640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06140b2790 con 0x7f061409aa30 2024-09-16T01:56:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.068+0000 7f061c55f640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f06140d0670 con 0x7f061406cd20 2024-09-16T01:56:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.068+0000 7f061c55f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f06140b2a70 con 0x7f06140b3760 2024-09-16T01:56:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.068+0000 7f061a2fb640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f061409aa30 0x7f061409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57756/0 (socket says 172.21.15.42:57756) 2024-09-16T01:56:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.069+0000 7f061a2fb640 1 -- 172.21.15.42:0/2882811987 learned_addr learned my addr 172.21.15.42:0/2882811987 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.069+0000 7f061aafc640 1 --2- 172.21.15.42:0/2882811987 >> v2:172.21.15.42:3300/0 conn(0x7f061406cd20 0x7f0614162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.069+0000 7f06192f9640 1 -- 172.21.15.42:0/2882811987 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015040029 0 0) 0x7f06140b2790 con 0x7f061409aa30 2024-09-16T01:56:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.069+0000 7f06192f9640 1 -- 172.21.15.42:0/2882811987 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05fc003520 con 0x7f061409aa30 2024-09-16T01:56:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.069+0000 7f0619afa640 1 --2- 172.21.15.42:0/2882811987 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06140b3760 0x7f06140b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.069+0000 7f061aafc640 1 -- 172.21.15.42:0/2882811987 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06140b3760 msgr2=0x7f06140b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.069+0000 7f061aafc640 1 --2- 172.21.15.42:0/2882811987 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06140b3760 0x7f06140b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.069+0000 7f061aafc640 1 -- 172.21.15.42:0/2882811987 >> v1:172.21.15.42:6789/0 conn(0x7f061409aa30 legacy=0x7f061409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.069+0000 7f061aafc640 1 -- 172.21.15.42:0/2882811987 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06140b2d50 con 0x7f061406cd20 2024-09-16T01:56:20.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.070+0000 7f061aafc640 1 --2- 172.21.15.42:0/2882811987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 0x7f0614162340 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0604009d90 tx=0x7f060402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e95927be1343a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.070+0000 7f06192f9640 1 -- 172.21.15.42:0/2882811987 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604031600 con 0x7f061406cd20 2024-09-16T01:56:20.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.070+0000 7f06192f9640 1 -- 172.21.15.42:0/2882811987 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06040317a0 con 0x7f061406cd20 2024-09-16T01:56:20.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.070+0000 7f06192f9640 1 -- 172.21.15.42:0/2882811987 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604031b70 con 0x7f061406cd20 2024-09-16T01:56:20.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.070+0000 7f061c55f640 1 -- 172.21.15.42:0/2882811987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 msgr2=0x7f0614162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.070+0000 7f061c55f640 1 --2- 172.21.15.42:0/2882811987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 0x7f0614162340 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0604009d90 tx=0x7f060402a5d0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.070+0000 7f061c55f640 1 -- 172.21.15.42:0/2882811987 shutdown_connections 2024-09-16T01:56:20.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.071+0000 7f061c55f640 1 --2- 172.21.15.42:0/2882811987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 0x7f0614162340 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.071+0000 7f061c55f640 1 --2- 172.21.15.42:0/2882811987 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06140b3760 0x7f06140b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.071+0000 7f061c55f640 1 -- 172.21.15.42:0/2882811987 >> 172.21.15.42:0/2882811987 conn(0x7f06140d23a0 msgr2=0x7f06140d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:20.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.071+0000 7f061c55f640 1 -- 172.21.15.42:0/2882811987 shutdown_connections 2024-09-16T01:56:20.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.071+0000 7f061c55f640 1 -- 172.21.15.42:0/2882811987 wait complete. 2024-09-16T01:56:20.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.072+0000 7f061c55f640 1 Processor -- start 2024-09-16T01:56:20.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.072+0000 7f061c55f640 1 -- start start 2024-09-16T01:56:20.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.072+0000 7f061c55f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 0x7f06141f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061c55f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f061409aa30 0x7f06141f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061c55f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06140b3760 0x7f06140b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061c55f640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f061415fe20 con 0x7f061406cd20 2024-09-16T01:56:20.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061c55f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f061415fca0 con 0x7f061409aa30 2024-09-16T01:56:20.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061c55f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f06140d1fe0 con 0x7f06140b3760 2024-09-16T01:56:20.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061a2fb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 0x7f06141f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061a2fb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 0x7f06141f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50130/0 (socket says 172.21.15.42:50130) 2024-09-16T01:56:20.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061a2fb640 1 -- 172.21.15.42:0/4146273611 learned_addr learned my addr 172.21.15.42:0/4146273611 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:20.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f0619afa640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f061409aa30 0x7f06141f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061aafc640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06140b3760 0x7f06140b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061a2fb640 1 -- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06140b3760 msgr2=0x7f06140b6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061a2fb640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06140b3760 0x7f06140b6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061a2fb640 1 -- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f061409aa30 msgr2=0x7f06141f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061a2fb640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f061409aa30 0x7f06141f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061a2fb640 1 -- 172.21.15.42:0/4146273611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06140b78e0 con 0x7f061406cd20 2024-09-16T01:56:20.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061a2fb640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 0x7f06141f5d10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f060c00c430 tx=0x7f060c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f0612ffd640 1 -- 172.21.15.42:0/4146273611 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c017070 con 0x7f061406cd20 2024-09-16T01:56:20.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f0612ffd640 1 -- 172.21.15.42:0/4146273611 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060c005ce0 con 0x7f061406cd20 2024-09-16T01:56:20.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061c55f640 1 -- 172.21.15.42:0/4146273611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06140b7bc0 con 0x7f061406cd20 2024-09-16T01:56:20.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f0612ffd640 1 -- 172.21.15.42:0/4146273611 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c0072f0 con 0x7f061406cd20 2024-09-16T01:56:20.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.073+0000 7f061c55f640 1 -- 172.21.15.42:0/4146273611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0614162e00 con 0x7f061406cd20 2024-09-16T01:56:20.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.074+0000 7f061c55f640 1 -- 172.21.15.42:0/4146273611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06140b3030 con 0x7f061406cd20 2024-09-16T01:56:20.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.075+0000 7f0612ffd640 1 -- 172.21.15.42:0/4146273611 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f060c01a070 con 0x7f061406cd20 2024-09-16T01:56:20.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.075+0000 7f0612ffd640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f060006c2b0 0x7f060006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.076+0000 7f0612ffd640 1 -- 172.21.15.42:0/4146273611 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f060c08a7a0 con 0x7f061406cd20 2024-09-16T01:56:20.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.076+0000 7f0619afa640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f060006c2b0 0x7f060006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.076+0000 7f0619afa640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f060006c2b0 0x7f060006e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0608006fd0 tx=0x7f0608008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.080+0000 7f0612ffd640 1 -- 172.21.15.42:0/4146273611 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f060c059070 con 0x7f061406cd20 2024-09-16T01:56:20.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.253+0000 7f061c55f640 1 -- 172.21.15.42:0/4146273611 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f06141f68f0 con 0x7f060006c2b0 2024-09-16T01:56:20.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.254+0000 7f0612ffd640 1 -- 172.21.15.42:0/4146273611 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f06141f68f0 con 0x7f060006c2b0 2024-09-16T01:56:20.255 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T01:56:20.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.255+0000 7f061c55f640 1 -- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f060006c2b0 msgr2=0x7f060006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.255+0000 7f061c55f640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f060006c2b0 0x7f060006e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0608006fd0 tx=0x7f0608008040 comp rx=0 tx=0).stop 2024-09-16T01:56:20.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.255+0000 7f061c55f640 1 -- 172.21.15.42:0/4146273611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 msgr2=0x7f06141f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.255+0000 7f061c55f640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 0x7f06141f5d10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f060c00c430 tx=0x7f060c00c8f0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.255+0000 7f061c55f640 1 -- 172.21.15.42:0/4146273611 shutdown_connections 2024-09-16T01:56:20.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.255+0000 7f061c55f640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f060006c2b0 0x7f060006e770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.255+0000 7f061c55f640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f06140b3760 0x7f06140b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.255+0000 7f061c55f640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f061409aa30 0x7f06141f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.255+0000 7f061c55f640 1 --2- 172.21.15.42:0/4146273611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f061406cd20 0x7f06141f5d10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.256+0000 7f061c55f640 1 -- 172.21.15.42:0/4146273611 >> 172.21.15.42:0/4146273611 conn(0x7f06140d23a0 msgr2=0x7f061415d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:20.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.256+0000 7f061c55f640 1 -- 172.21.15.42:0/4146273611 shutdown_connections 2024-09-16T01:56:20.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.256+0000 7f061c55f640 1 -- 172.21.15.42:0/4146273611 wait complete. 2024-09-16T01:56:20.268 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T01:56:20.269 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:56:20.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.375+0000 7f2481559640 1 Processor -- start 2024-09-16T01:56:20.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.375+0000 7f2481559640 1 -- start start 2024-09-16T01:56:20.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2481559640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f247c0d4c10 0x7f247c162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2481559640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247c0d2600 con 0x7f247c0b5f80 2024-09-16T01:56:20.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2481559640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247c0b3c10 con 0x7f247c0d3320 2024-09-16T01:56:20.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2481559640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f247c0d5420 con 0x7f247c0d4c10 2024-09-16T01:56:20.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f247affd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f247c0b5f80 0x7f247c0b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57772/0 (socket says 172.21.15.42:57772) 2024-09-16T01:56:20.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f247affd640 1 -- 172.21.15.42:0/2218368934 learned_addr learned my addr 172.21.15.42:0/2218368934 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:20.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3123110278 0 0) 0x7f246c001110 con 0x7f247c0b5f80 2024-09-16T01:56:20.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2464003520 con 0x7f247c0b5f80 2024-09-16T01:56:20.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f247a7fc640 1 --2- 172.21.15.42:0/2218368934 >> v2:172.21.15.107:3300/0 conn(0x7f247c0d4c10 0x7f247c162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4290802370 0 0) 0x7f2464003520 con 0x7f247c0b5f80 2024-09-16T01:56:20.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 >> v2:172.21.15.107:3300/0 conn(0x7f247c0d4c10 msgr2=0x7f247c162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:20.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 --2- 172.21.15.42:0/2218368934 >> v2:172.21.15.107:3300/0 conn(0x7f247c0d4c10 0x7f247c162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 >> v1:172.21.15.107:6789/0 conn(0x7f247c0d3320 legacy=0x7f247c0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c0d2880 con 0x7f247c0b5f80 2024-09-16T01:56:20.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f246c001840 con 0x7f247c0b5f80 2024-09-16T01:56:20.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 >> v1:172.21.15.42:6789/0 conn(0x7f247c0b5f80 legacy=0x7f247c0b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24640039e0 0x7f2464003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 0x7f2464004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2464005210 0x7f246400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f247c0d5420 con 0x7f2464004800 2024-09-16T01:56:20.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f246400c140 con 0x7f24640039e0 2024-09-16T01:56:20.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f246400c340 con 0x7f2464005210 2024-09-16T01:56:20.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.376+0000 7f247a7fc640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 0x7f2464004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.377+0000 7f247affd640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24640039e0 0x7f2464003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.377+0000 7f247b7fe640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2464005210 0x7f246400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.377+0000 7f247a7fc640 1 -- 172.21.15.42:0/2218368934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2464005210 msgr2=0x7f246400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:20.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.377+0000 7f247a7fc640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2464005210 0x7f246400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.377+0000 7f247a7fc640 1 -- 172.21.15.42:0/2218368934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24640039e0 msgr2=0x7f2464003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:20.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.377+0000 7f247a7fc640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24640039e0 0x7f2464003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.377+0000 7f247b7fe640 1 -- 172.21.15.42:0/2218368934 reap_dead start 2024-09-16T01:56:20.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.377+0000 7f247a7fc640 1 -- 172.21.15.42:0/2218368934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2464003520 con 0x7f2464004800 2024-09-16T01:56:20.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.377+0000 7f247a7fc640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 0x7f2464004c80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f247000ba00 tx=0x7f2464005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1885c8e98cd83d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.378+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2470030070 con 0x7f2464004800 2024-09-16T01:56:20.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.378+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247002ada0 con 0x7f2464004800 2024-09-16T01:56:20.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.378+0000 7f2479ffb640 1 -- 172.21.15.42:0/2218368934 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247000b600 con 0x7f2464004800 2024-09-16T01:56:20.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.378+0000 7f2481559640 1 -- 172.21.15.42:0/2218368934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 msgr2=0x7f2464004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.378+0000 7f2481559640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 0x7f2464004c80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f247000ba00 tx=0x7f2464005830 comp rx=0 tx=0).stop 2024-09-16T01:56:20.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.378+0000 7f2481559640 1 -- 172.21.15.42:0/2218368934 shutdown_connections 2024-09-16T01:56:20.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.378+0000 7f2481559640 1 --2- 172.21.15.42:0/2218368934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 0x7f2464004c80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.378+0000 7f2481559640 1 -- 172.21.15.42:0/2218368934 >> 172.21.15.42:0/2218368934 conn(0x7f247c08bfc0 msgr2=0x7f247c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:20.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.378+0000 7f2481559640 1 -- 172.21.15.42:0/2218368934 shutdown_connections 2024-09-16T01:56:20.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.378+0000 7f2481559640 1 -- 172.21.15.42:0/2218368934 wait complete. 2024-09-16T01:56:20.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.379+0000 7f2481559640 1 Processor -- start 2024-09-16T01:56:20.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.380+0000 7f2481559640 1 -- start start 2024-09-16T01:56:20.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.380+0000 7f2481559640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 0x7f247c0b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.380+0000 7f2481559640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247c1f8fe0 0x7f247c146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.380+0000 7f2481559640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f247c1442e0 0x7f247c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.380+0000 7f2481559640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f247c0d2b20 con 0x7f2464004800 2024-09-16T01:56:20.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.380+0000 7f2481559640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f247c0d2e90 con 0x7f247c1f8fe0 2024-09-16T01:56:20.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.380+0000 7f2481559640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f247c0d37b0 con 0x7f247c1442e0 2024-09-16T01:56:20.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.380+0000 7f247affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 0x7f247c0b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.380+0000 7f247affd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 0x7f247c0b9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50140/0 (socket says 172.21.15.42:50140) 2024-09-16T01:56:20.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.380+0000 7f247affd640 1 -- 172.21.15.42:0/3840651175 learned_addr learned my addr 172.21.15.42:0/3840651175 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:20.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f247a7fc640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247c1f8fe0 0x7f247c146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f247b7fe640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f247c1442e0 0x7f247c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f247affd640 1 -- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f247c1442e0 msgr2=0x7f247c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f247affd640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f247c1442e0 0x7f247c0b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f247affd640 1 -- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247c1f8fe0 msgr2=0x7f247c146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f247affd640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247c1f8fe0 0x7f247c146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f247affd640 1 -- 172.21.15.42:0/3840651175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c146c70 con 0x7f2464004800 2024-09-16T01:56:20.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f247affd640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 0x7f247c0b9e00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f246c007290 tx=0x7f246c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f24637fe640 1 -- 172.21.15.42:0/3840651175 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c01a070 con 0x7f2464004800 2024-09-16T01:56:20.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f24637fe640 1 -- 172.21.15.42:0/3840651175 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c00f8e0 con 0x7f2464004800 2024-09-16T01:56:20.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247c146f50 con 0x7f2464004800 2024-09-16T01:56:20.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f24637fe640 1 -- 172.21.15.42:0/3840651175 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c00fcd0 con 0x7f2464004800 2024-09-16T01:56:20.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.381+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247c0c9e90 con 0x7f2464004800 2024-09-16T01:56:20.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.382+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f247c0b4ae0 con 0x7f2464004800 2024-09-16T01:56:20.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.383+0000 7f24637fe640 1 -- 172.21.15.42:0/3840651175 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f246c01e3f0 con 0x7f2464004800 2024-09-16T01:56:20.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.383+0000 7f24637fe640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f246806c2e0 0x7f246806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.383+0000 7f24637fe640 1 -- 172.21.15.42:0/3840651175 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f246c08a8f0 con 0x7f2464004800 2024-09-16T01:56:20.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.383+0000 7f24637fe640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] conn(0x7f2468072780 0x7f2468074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.383+0000 7f24637fe640 1 -- 172.21.15.42:0/3840651175 --> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2468075290 con 0x7f2468072780 2024-09-16T01:56:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.383+0000 7f24637fe640 1 -- 172.21.15.42:0/3840651175 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f246c08f2c0 con 0x7f2464004800 2024-09-16T01:56:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.383+0000 7f247a7fc640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f246806c2e0 0x7f246806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.383+0000 7f247b7fe640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] conn(0x7f2468072780 0x7f2468074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.384+0000 7f247b7fe640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] conn(0x7f2468072780 0x7f2468074bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.384+0000 7f247a7fc640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f246806c2e0 0x7f246806e7a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f24640057e0 tx=0x7f2470030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.384+0000 7f24637fe640 1 -- 172.21.15.42:0/3840651175 <== osd.2 v2:172.21.15.42:6800/773751051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2468075290 con 0x7f2468072780 2024-09-16T01:56:20.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.397+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 --> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f247c0b4800 con 0x7f2468072780 2024-09-16T01:56:20.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.397+0000 7f24637fe640 1 -- 172.21.15.42:0/3840651175 <== osd.2 v2:172.21.15.42:6800/773751051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f247c0b4800 con 0x7f2468072780 2024-09-16T01:56:20.401 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:56:20.401 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:56:20.402 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:56:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 >> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] conn(0x7f2468072780 msgr2=0x7f2468074bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f2481559640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.42:6800/773751051,v1:172.21.15.42:6801/773751051] conn(0x7f2468072780 0x7f2468074bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f246806c2e0 msgr2=0x7f246806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f2481559640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f246806c2e0 0x7f246806e7a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f24640057e0 tx=0x7f2470030000 comp rx=0 tx=0).stop 2024-09-16T01:56:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 msgr2=0x7f247c0b9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f2481559640 1 --2- 172.21.15.42:0/3840651175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2464004800 0x7f247c0b9e00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f246c007290 tx=0x7f246c007750 comp rx=0 tx=0).stop 2024-09-16T01:56:20.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f247b7fe640 1 -- 172.21.15.42:0/3840651175 reap_dead start 2024-09-16T01:56:20.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 shutdown_connections 2024-09-16T01:56:20.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 >> 172.21.15.42:0/3840651175 conn(0x7f247c08bfc0 msgr2=0x7f247c161f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:20.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 shutdown_connections 2024-09-16T01:56:20.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.398+0000 7f2481559640 1 -- 172.21.15.42:0/3840651175 wait complete. 2024-09-16T01:56:20.409 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T01:56:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.511+0000 7ff6836c9640 1 Processor -- start 2024-09-16T01:56:20.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.511+0000 7ff6836c9640 1 -- start start 2024-09-16T01:56:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff6836c9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff67c15e740 0x7ff67c0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff6836c9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c06dbd0 0x7ff67c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff6836c9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67c06e000 con 0x7ff67c09b690 2024-09-16T01:56:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff6836c9640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff67c15eb20 con 0x7ff67c15e740 2024-09-16T01:56:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff6836c9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c06d260 con 0x7ff67c06dbd0 2024-09-16T01:56:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff681465640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff67c15e740 0x7ff67c0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff680c64640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff67c09b690 0x7ff67c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57776/0 (socket says 172.21.15.42:57776) 2024-09-16T01:56:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff680c64640 1 -- 172.21.15.42:0/1316180100 learned_addr learned my addr 172.21.15.42:0/1316180100 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff681c66640 1 --2- 172.21.15.42:0/1316180100 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c06dbd0 0x7ff67c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff673fff640 1 -- 172.21.15.42:0/1316180100 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261081719 0 0) 0x7ff67c06e000 con 0x7ff67c09b690 2024-09-16T01:56:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff681465640 1 -- 172.21.15.42:0/1316180100 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c06dbd0 msgr2=0x7ff67c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff681465640 1 --2- 172.21.15.42:0/1316180100 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c06dbd0 0x7ff67c06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff681465640 1 -- 172.21.15.42:0/1316180100 >> v1:172.21.15.42:6789/0 conn(0x7ff67c09b690 legacy=0x7ff67c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.512+0000 7ff681465640 1 -- 172.21.15.42:0/1316180100 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c0d0780 con 0x7ff67c15e740 2024-09-16T01:56:20.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.513+0000 7ff681465640 1 --2- 172.21.15.42:0/1316180100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c15e740 0x7ff67c0d1540 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff6780097a0 tx=0x7ff67802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c56a77728f55bb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.513+0000 7ff673fff640 1 -- 172.21.15.42:0/1316180100 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678037070 con 0x7ff67c15e740 2024-09-16T01:56:20.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.513+0000 7ff673fff640 1 -- 172.21.15.42:0/1316180100 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678032440 con 0x7ff67c15e740 2024-09-16T01:56:20.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.513+0000 7ff673fff640 1 -- 172.21.15.42:0/1316180100 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678032810 con 0x7ff67c15e740 2024-09-16T01:56:20.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.514+0000 7ff6836c9640 1 -- 172.21.15.42:0/1316180100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c15e740 msgr2=0x7ff67c0d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.514+0000 7ff6836c9640 1 --2- 172.21.15.42:0/1316180100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c15e740 0x7ff67c0d1540 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff6780097a0 tx=0x7ff67802a210 comp rx=0 tx=0).stop 2024-09-16T01:56:20.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.514+0000 7ff6836c9640 1 -- 172.21.15.42:0/1316180100 shutdown_connections 2024-09-16T01:56:20.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.514+0000 7ff6836c9640 1 --2- 172.21.15.42:0/1316180100 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c06dbd0 0x7ff67c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.514+0000 7ff6836c9640 1 --2- 172.21.15.42:0/1316180100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c15e740 0x7ff67c0d1540 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.514+0000 7ff6836c9640 1 -- 172.21.15.42:0/1316180100 >> 172.21.15.42:0/1316180100 conn(0x7ff67c0d23a0 msgr2=0x7ff67c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:20.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.514+0000 7ff6836c9640 1 -- 172.21.15.42:0/1316180100 shutdown_connections 2024-09-16T01:56:20.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.514+0000 7ff6836c9640 1 -- 172.21.15.42:0/1316180100 wait complete. 2024-09-16T01:56:20.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.515+0000 7ff6836c9640 1 Processor -- start 2024-09-16T01:56:20.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.515+0000 7ff6836c9640 1 -- start start 2024-09-16T01:56:20.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff6836c9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c06dbd0 0x7ff67c0c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff6836c9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c09b690 0x7ff67c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff6836c9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff67c15e740 0x7ff67c155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff6836c9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c0d1020 con 0x7ff67c06dbd0 2024-09-16T01:56:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff6836c9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c0d0d40 con 0x7ff67c15e740 2024-09-16T01:56:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff6836c9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c09bac0 con 0x7ff67c09b690 2024-09-16T01:56:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681465640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c06dbd0 0x7ff67c0c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681465640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c06dbd0 0x7ff67c0c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50146/0 (socket says 172.21.15.42:50146) 2024-09-16T01:56:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681465640 1 -- 172.21.15.42:0/1044107096 learned_addr learned my addr 172.21.15.42:0/1044107096 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff680c64640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c09b690 0x7ff67c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681c66640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff67c15e740 0x7ff67c155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681465640 1 -- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c09b690 msgr2=0x7ff67c0b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681465640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c09b690 0x7ff67c0b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681465640 1 -- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff67c15e740 msgr2=0x7ff67c155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681465640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff67c15e740 0x7ff67c155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681465640 1 -- 172.21.15.42:0/1044107096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c0b6af0 con 0x7ff67c06dbd0 2024-09-16T01:56:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff680c64640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c09b690 0x7ff67c0b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:56:20.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681c66640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff67c15e740 0x7ff67c155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:56:20.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff681465640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c06dbd0 0x7ff67c0c9470 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff6780098c0 tx=0x7ff6780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff671ffb640 1 -- 172.21.15.42:0/1044107096 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678037040 con 0x7ff67c06dbd0 2024-09-16T01:56:20.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff671ffb640 1 -- 172.21.15.42:0/1044107096 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678030500 con 0x7ff67c06dbd0 2024-09-16T01:56:20.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff6836c9640 1 -- 172.21.15.42:0/1044107096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c1598f0 con 0x7ff67c06dbd0 2024-09-16T01:56:20.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.516+0000 7ff671ffb640 1 -- 172.21.15.42:0/1044107096 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6780308d0 con 0x7ff67c06dbd0 2024-09-16T01:56:20.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.517+0000 7ff6836c9640 1 -- 172.21.15.42:0/1044107096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c159b90 con 0x7ff67c06dbd0 2024-09-16T01:56:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.518+0000 7ff6836c9640 1 -- 172.21.15.42:0/1044107096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67c06cd20 con 0x7ff67c06dbd0 2024-09-16T01:56:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.518+0000 7ff671ffb640 1 -- 172.21.15.42:0/1044107096 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff678044020 con 0x7ff67c06dbd0 2024-09-16T01:56:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.519+0000 7ff671ffb640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66006c2b0 0x7ff66006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.519+0000 7ff671ffb640 1 -- 172.21.15.42:0/1044107096 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7ff6780ab590 con 0x7ff67c06dbd0 2024-09-16T01:56:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.519+0000 7ff680c64640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66006c2b0 0x7ff66006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.519+0000 7ff680c64640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66006c2b0 0x7ff66006e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff67c1f7e20 tx=0x7ff66c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.523+0000 7ff671ffb640 1 -- 172.21.15.42:0/1044107096 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff678079e60 con 0x7ff67c06dbd0 2024-09-16T01:56:20.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.700+0000 7ff6836c9640 1 -- 172.21.15.42:0/1044107096 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ff67c0d1cb0 con 0x7ff66006c2b0 2024-09-16T01:56:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.700+0000 7ff671ffb640 1 -- 172.21.15.42:0/1044107096 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff67c0d1cb0 con 0x7ff66006c2b0 2024-09-16T01:56:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T01:56:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 -- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66006c2b0 msgr2=0x7ff66006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66006c2b0 0x7ff66006e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff67c1f7e20 tx=0x7ff66c009040 comp rx=0 tx=0).stop 2024-09-16T01:56:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 -- 172.21.15.42:0/1044107096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c06dbd0 msgr2=0x7ff67c0c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c06dbd0 0x7ff67c0c9470 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff6780098c0 tx=0x7ff6780046c0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 -- 172.21.15.42:0/1044107096 shutdown_connections 2024-09-16T01:56:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff66006c2b0 0x7ff66006e770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff67c15e740 0x7ff67c155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff67c09b690 0x7ff67c0b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 --2- 172.21.15.42:0/1044107096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff67c06dbd0 0x7ff67c0c9470 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 -- 172.21.15.42:0/1044107096 >> 172.21.15.42:0/1044107096 conn(0x7ff67c0d23a0 msgr2=0x7ff67c0ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 -- 172.21.15.42:0/1044107096 shutdown_connections 2024-09-16T01:56:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.702+0000 7ff6836c9640 1 -- 172.21.15.42:0/1044107096 wait complete. 2024-09-16T01:56:20.715 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T01:56:20.715 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:56:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.820+0000 7f347ca2e640 1 Processor -- start 2024-09-16T01:56:20.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.820+0000 7f347ca2e640 1 -- start start 2024-09-16T01:56:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f347ca2e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f347815e5a0 0x7f34780cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f347ca2e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f347815e980 0x7f34780d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f347ca2e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34780d53f0 con 0x7f34780d0df0 2024-09-16T01:56:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f347ca2e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f347806cd90 con 0x7f347815e980 2024-09-16T01:56:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f347ca2e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f347806d070 con 0x7f347815e5a0 2024-09-16T01:56:20.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f3475d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f347815e980 0x7f34780d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f3476d9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f34780d0df0 0x7f3478162290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57780/0 (socket says 172.21.15.42:57780) 2024-09-16T01:56:20.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f3476d9d640 1 -- 172.21.15.42:0/1251668505 learned_addr learned my addr 172.21.15.42:0/1251668505 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:20.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f347659c640 1 --2- 172.21.15.42:0/1251668505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f347815e5a0 0x7f34780cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f3475d9b640 1 -- 172.21.15.42:0/1251668505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f347815e5a0 msgr2=0x7f34780cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:20.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f3475d9b640 1 --2- 172.21.15.42:0/1251668505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f347815e5a0 0x7f34780cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f3475d9b640 1 -- 172.21.15.42:0/1251668505 >> v1:172.21.15.42:6789/0 conn(0x7f34780d0df0 legacy=0x7f3478162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.821+0000 7f3475d9b640 1 -- 172.21.15.42:0/1251668505 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347806d350 con 0x7f347815e980 2024-09-16T01:56:20.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.822+0000 7f3475d9b640 1 --2- 172.21.15.42:0/1251668505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f347815e980 0x7f34780d0210 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f346c0097a0 tx=0x7f346c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3ea6821951fc62 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.822+0000 7f347559a640 1 -- 172.21.15.42:0/1251668505 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c037070 con 0x7f347815e980 2024-09-16T01:56:20.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.822+0000 7f347559a640 1 -- 172.21.15.42:0/1251668505 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346c02ae50 con 0x7f347815e980 2024-09-16T01:56:20.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.822+0000 7f347559a640 1 -- 172.21.15.42:0/1251668505 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c032660 con 0x7f347815e980 2024-09-16T01:56:20.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.823+0000 7f347ca2e640 1 -- 172.21.15.42:0/1251668505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f347815e980 msgr2=0x7f34780d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.823+0000 7f347ca2e640 1 --2- 172.21.15.42:0/1251668505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f347815e980 0x7f34780d0210 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f346c0097a0 tx=0x7f346c02a100 comp rx=0 tx=0).stop 2024-09-16T01:56:20.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.823+0000 7f347ca2e640 1 -- 172.21.15.42:0/1251668505 shutdown_connections 2024-09-16T01:56:20.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.823+0000 7f347ca2e640 1 --2- 172.21.15.42:0/1251668505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f347815e980 0x7f34780d0210 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.823+0000 7f347ca2e640 1 --2- 172.21.15.42:0/1251668505 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f347815e5a0 0x7f34780cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.823+0000 7f347ca2e640 1 -- 172.21.15.42:0/1251668505 >> 172.21.15.42:0/1251668505 conn(0x7f347808bfc0 msgr2=0x7f34780d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:20.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.823+0000 7f347ca2e640 1 -- 172.21.15.42:0/1251668505 shutdown_connections 2024-09-16T01:56:20.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.823+0000 7f347ca2e640 1 -- 172.21.15.42:0/1251668505 wait complete. 2024-09-16T01:56:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.824+0000 7f347ca2e640 1 Processor -- start 2024-09-16T01:56:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.824+0000 7f347ca2e640 1 -- start start 2024-09-16T01:56:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.825+0000 7f347ca2e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34780d0df0 0x7f34781f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.825+0000 7f347ca2e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f347815e5a0 0x7f34781616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.825+0000 7f347ca2e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f347815e980 0x7f34780d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.825+0000 7f347ca2e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f347806de30 con 0x7f34780d0df0 2024-09-16T01:56:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.825+0000 7f347ca2e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f347806d910 con 0x7f347815e5a0 2024-09-16T01:56:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.825+0000 7f347ca2e640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f347806dfb0 con 0x7f347815e980 2024-09-16T01:56:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.825+0000 7f347659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34780d0df0 0x7f34781f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.825+0000 7f347659c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34780d0df0 0x7f34781f4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50160/0 (socket says 172.21.15.42:50160) 2024-09-16T01:56:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.825+0000 7f347659c640 1 -- 172.21.15.42:0/68510485 learned_addr learned my addr 172.21.15.42:0/68510485 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f347659c640 1 -- 172.21.15.42:0/68510485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f347815e980 msgr2=0x7f34780d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f347659c640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f347815e980 0x7f34780d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f347659c640 1 -- 172.21.15.42:0/68510485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f347815e5a0 msgr2=0x7f34781616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f347659c640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f347815e5a0 0x7f34781616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f347659c640 1 -- 172.21.15.42:0/68510485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347815f1f0 con 0x7f34780d0df0 2024-09-16T01:56:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f347659c640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34780d0df0 0x7f34781f4ed0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f346800e9b0 tx=0x7f346800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f3466ffd640 1 -- 172.21.15.42:0/68510485 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468017070 con 0x7f34780d0df0 2024-09-16T01:56:20.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f3466ffd640 1 -- 172.21.15.42:0/68510485 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346800c9a0 con 0x7f34780d0df0 2024-09-16T01:56:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347815f4d0 con 0x7f34780d0df0 2024-09-16T01:56:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f3466ffd640 1 -- 172.21.15.42:0/68510485 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346800cd90 con 0x7f34780d0df0 2024-09-16T01:56:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.826+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347815fd70 con 0x7f34780d0df0 2024-09-16T01:56:20.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.827+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34780d1260 con 0x7f34780d0df0 2024-09-16T01:56:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.827+0000 7f3466ffd640 1 -- 172.21.15.42:0/68510485 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f346801a070 con 0x7f34780d0df0 2024-09-16T01:56:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.828+0000 7f3466ffd640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f345806c2b0 0x7f345806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.828+0000 7f3466ffd640 1 -- 172.21.15.42:0/68510485 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f346808b630 con 0x7f34780d0df0 2024-09-16T01:56:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.828+0000 7f3466ffd640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] conn(0x7f3458072750 0x7f3458074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.828+0000 7f3466ffd640 1 -- 172.21.15.42:0/68510485 --> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f346801fe50 con 0x7f3458072750 2024-09-16T01:56:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.828+0000 7f3466ffd640 1 -- 172.21.15.42:0/68510485 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f3468092050 con 0x7f34780d0df0 2024-09-16T01:56:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.828+0000 7f3475d9b640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f345806c2b0 0x7f345806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.828+0000 7f3476d9d640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] conn(0x7f3458072750 0x7f3458074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.829+0000 7f3476d9d640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] conn(0x7f3458072750 0x7f3458074b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.829+0000 7f3475d9b640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f345806c2b0 0x7f345806e770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f346c034000 tx=0x7f346c02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.829+0000 7f3466ffd640 1 -- 172.21.15.42:0/68510485 <== osd.3 v2:172.21.15.42:6816/3057553949 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f346801fe50 con 0x7f3458072750 2024-09-16T01:56:20.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 --> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f347815cd70 con 0x7f3458072750 2024-09-16T01:56:20.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f3466ffd640 1 -- 172.21.15.42:0/68510485 <== osd.3 v2:172.21.15.42:6816/3057553949 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f347815cd70 con 0x7f3458072750 2024-09-16T01:56:20.843 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:56:20.844 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:56:20.844 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:56:20.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 >> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] conn(0x7f3458072750 msgr2=0x7f3458074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.42:6816/3057553949,v1:172.21.15.42:6817/3057553949] conn(0x7f3458072750 0x7f3458074b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f345806c2b0 msgr2=0x7f345806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f345806c2b0 0x7f345806e770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f346c034000 tx=0x7f346c02c000 comp rx=0 tx=0).stop 2024-09-16T01:56:20.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34780d0df0 msgr2=0x7f34781f4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 --2- 172.21.15.42:0/68510485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34780d0df0 0x7f34781f4ed0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f346800e9b0 tx=0x7f346800ee70 comp rx=0 tx=0).stop 2024-09-16T01:56:20.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f3476d9d640 1 -- 172.21.15.42:0/68510485 reap_dead start 2024-09-16T01:56:20.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 shutdown_connections 2024-09-16T01:56:20.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 >> 172.21.15.42:0/68510485 conn(0x7f347808bfc0 msgr2=0x7f34780b73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:20.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 shutdown_connections 2024-09-16T01:56:20.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.842+0000 7f347ca2e640 1 -- 172.21.15.42:0/68510485 wait complete. 2024-09-16T01:56:20.854 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T01:56:20.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.957+0000 7f41ca9f1640 1 Processor -- start 2024-09-16T01:56:20.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.957+0000 7f41ca9f1640 1 -- start start 2024-09-16T01:56:20.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.958+0000 7f41ca9f1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c415fc30 0x7f41c4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.958+0000 7f41ca9f1640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f41c40b17d0 0x7f41c409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.958+0000 7f41ca9f1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c409ba30 con 0x7f41c409af70 2024-09-16T01:56:20.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.958+0000 7f41ca9f1640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f41c40b1590 con 0x7f41c40b17d0 2024-09-16T01:56:20.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.958+0000 7f41ca9f1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f41c4160ab0 con 0x7f41c415fc30 2024-09-16T01:56:20.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.959+0000 7f41c37fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f41c40b17d0 0x7f41c409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.959+0000 7f41c37fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f41c40b17d0 0x7f41c409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50176/0 (socket says 172.21.15.42:50176) 2024-09-16T01:56:20.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.959+0000 7f41c37fe640 1 -- 172.21.15.42:0/3803831373 learned_addr learned my addr 172.21.15.42:0/3803831373 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:20.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.959+0000 7f41c3fff640 1 --2- 172.21.15.42:0/3803831373 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c415fc30 0x7f41c4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.959+0000 7f41c37fe640 1 -- 172.21.15.42:0/3803831373 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c415fc30 msgr2=0x7f41c4071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:20.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.959+0000 7f41c37fe640 1 --2- 172.21.15.42:0/3803831373 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c415fc30 0x7f41c4071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.959+0000 7f41c37fe640 1 -- 172.21.15.42:0/3803831373 >> v1:172.21.15.107:6789/0 conn(0x7f41c409af70 legacy=0x7f41c40d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.959+0000 7f41c37fe640 1 -- 172.21.15.42:0/3803831373 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c409bcf0 con 0x7f41c40b17d0 2024-09-16T01:56:20.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41c37fe640 1 --2- 172.21.15.42:0/3803831373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 0x7f41c409aa30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009870 tx=0x7f41b802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20216b10e3730886 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41c2ffd640 1 -- 172.21.15.42:0/3803831373 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8037070 con 0x7f41c40b17d0 2024-09-16T01:56:20.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41c2ffd640 1 -- 172.21.15.42:0/3803831373 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b8032440 con 0x7f41c40b17d0 2024-09-16T01:56:20.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41c2ffd640 1 -- 172.21.15.42:0/3803831373 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8032810 con 0x7f41c40b17d0 2024-09-16T01:56:20.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41ca9f1640 1 -- 172.21.15.42:0/3803831373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 msgr2=0x7f41c409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41ca9f1640 1 --2- 172.21.15.42:0/3803831373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 0x7f41c409aa30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009870 tx=0x7f41b802a1c0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41ca9f1640 1 -- 172.21.15.42:0/3803831373 shutdown_connections 2024-09-16T01:56:20.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41ca9f1640 1 --2- 172.21.15.42:0/3803831373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 0x7f41c409aa30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41ca9f1640 1 --2- 172.21.15.42:0/3803831373 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c415fc30 0x7f41c4071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41ca9f1640 1 -- 172.21.15.42:0/3803831373 >> 172.21.15.42:0/3803831373 conn(0x7f41c40d23a0 msgr2=0x7f41c40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:20.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.960+0000 7f41ca9f1640 1 -- 172.21.15.42:0/3803831373 shutdown_connections 2024-09-16T01:56:20.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.961+0000 7f41ca9f1640 1 -- 172.21.15.42:0/3803831373 wait complete. 2024-09-16T01:56:20.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.962+0000 7f41ca9f1640 1 Processor -- start 2024-09-16T01:56:20.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.962+0000 7f41ca9f1640 1 -- start start 2024-09-16T01:56:20.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41ca9f1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c409af70 0x7f41c4153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41ca9f1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 0x7f41c41544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41ca9f1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c415fc30 0x7f41c41599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41ca9f1640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f41c40b1bd0 con 0x7f41c40b17d0 2024-09-16T01:56:20.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41ca9f1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f41c4160fe0 con 0x7f41c415fc30 2024-09-16T01:56:20.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41ca9f1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f41c4071500 con 0x7f41c409af70 2024-09-16T01:56:20.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 0x7f41c41544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 0x7f41c41544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50192/0 (socket says 172.21.15.42:50192) 2024-09-16T01:56:20.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c37fe640 1 -- 172.21.15.42:0/2322622664 learned_addr learned my addr 172.21.15.42:0/2322622664 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:20.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c3fff640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c409af70 0x7f41c4153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c8f8e640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c415fc30 0x7f41c41599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c37fe640 1 -- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c409af70 msgr2=0x7f41c4153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c37fe640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c409af70 0x7f41c4153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c37fe640 1 -- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c415fc30 msgr2=0x7f41c41599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c37fe640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c415fc30 0x7f41c41599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c37fe640 1 -- 172.21.15.42:0/2322622664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c40c8df0 con 0x7f41c40b17d0 2024-09-16T01:56:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c8f8e640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c415fc30 0x7f41c41599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c37fe640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 0x7f41c41544b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009870 tx=0x7f41b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c0ff9640 1 -- 172.21.15.42:0/2322622664 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8041070 con 0x7f41c40b17d0 2024-09-16T01:56:20.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c0ff9640 1 -- 172.21.15.42:0/2322622664 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b803c870 con 0x7f41c40b17d0 2024-09-16T01:56:20.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41ca9f1640 1 -- 172.21.15.42:0/2322622664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c40b8050 con 0x7f41c40b17d0 2024-09-16T01:56:20.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41c0ff9640 1 -- 172.21.15.42:0/2322622664 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8037040 con 0x7f41c40b17d0 2024-09-16T01:56:20.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.963+0000 7f41ca9f1640 1 -- 172.21.15.42:0/2322622664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c40c6750 con 0x7f41c40b17d0 2024-09-16T01:56:20.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.964+0000 7f41ca9f1640 1 -- 172.21.15.42:0/2322622664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c40b0390 con 0x7f41c40b17d0 2024-09-16T01:56:20.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.965+0000 7f41c0ff9640 1 -- 172.21.15.42:0/2322622664 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f41b8044070 con 0x7f41c40b17d0 2024-09-16T01:56:20.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.965+0000 7f41c0ff9640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b006c2b0 0x7f41b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.965+0000 7f41c0ff9640 1 -- 172.21.15.42:0/2322622664 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f41b80abea0 con 0x7f41c40b17d0 2024-09-16T01:56:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.966+0000 7f41c3fff640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b006c2b0 0x7f41b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.966+0000 7f41c3fff640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b006c2b0 0x7f41b006e770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009aa0 tx=0x7f41b4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:20.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:20.970+0000 7f41c0ff9640 1 -- 172.21.15.42:0/2322622664 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41c40b0390 con 0x7f41c40b17d0 2024-09-16T01:56:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.147+0000 7f41ca9f1640 1 -- 172.21.15.42:0/2322622664 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f41c406c0a0 con 0x7f41b006c2b0 2024-09-16T01:56:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.148+0000 7f41c0ff9640 1 -- 172.21.15.42:0/2322622664 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f41c406c0a0 con 0x7f41b006c2b0 2024-09-16T01:56:21.150 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T01:56:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 -- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b006c2b0 msgr2=0x7f41b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b006c2b0 0x7f41b006e770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009aa0 tx=0x7f41b4009190 comp rx=0 tx=0).stop 2024-09-16T01:56:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 -- 172.21.15.42:0/2322622664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 msgr2=0x7f41c41544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 0x7f41c41544b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009870 tx=0x7f41b80046c0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 -- 172.21.15.42:0/2322622664 shutdown_connections 2024-09-16T01:56:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f41b006c2b0 0x7f41b006e770 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41c415fc30 0x7f41c41599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41c40b17d0 0x7f41c41544b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 --2- 172.21.15.42:0/2322622664 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41c409af70 0x7f41c4153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 -- 172.21.15.42:0/2322622664 >> 172.21.15.42:0/2322622664 conn(0x7f41c40d23a0 msgr2=0x7f41c40afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 -- 172.21.15.42:0/2322622664 shutdown_connections 2024-09-16T01:56:21.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.150+0000 7f41ca9f1640 1 -- 172.21.15.42:0/2322622664 wait complete. 2024-09-16T01:56:21.163 INFO:tasks.ceph:Scrubbing osd.4 2024-09-16T01:56:21.163 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:56:21.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.269+0000 7fb197ae4640 1 Processor -- start 2024-09-16T01:56:21.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.269+0000 7fb197ae4640 1 -- start start 2024-09-16T01:56:21.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb197ae4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb190156740 0x7fb1900b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb197ae4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb1900b4af0 0x7fb1900cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb197ae4640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1900b30e0 con 0x7fb1900cfcd0 2024-09-16T01:56:21.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb197ae4640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb19006edc0 con 0x7fb1900b4af0 2024-09-16T01:56:21.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb197ae4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb1900b33c0 con 0x7fb190156740 2024-09-16T01:56:21.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb196081640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb1900cfcd0 0x7fb19015fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57784/0 (socket says 172.21.15.42:57784) 2024-09-16T01:56:21.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb196081640 1 -- 172.21.15.42:0/679863394 learned_addr learned my addr 172.21.15.42:0/679863394 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:21.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb195880640 1 --2- 172.21.15.42:0/679863394 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb190156740 0x7fb1900b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb19507f640 1 --2- 172.21.15.42:0/679863394 >> v2:172.21.15.107:3300/0 conn(0x7fb1900b4af0 0x7fb1900cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb19487e640 1 -- 172.21.15.42:0/679863394 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3911771398 0 0) 0x7fb1900b30e0 con 0x7fb1900cfcd0 2024-09-16T01:56:21.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb19487e640 1 -- 172.21.15.42:0/679863394 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb17c003520 con 0x7fb1900cfcd0 2024-09-16T01:56:21.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb195880640 1 -- 172.21.15.42:0/679863394 >> v2:172.21.15.107:3300/0 conn(0x7fb1900b4af0 msgr2=0x7fb1900cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:21.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb195880640 1 --2- 172.21.15.42:0/679863394 >> v2:172.21.15.107:3300/0 conn(0x7fb1900b4af0 0x7fb1900cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb195880640 1 -- 172.21.15.42:0/679863394 >> v1:172.21.15.42:6789/0 conn(0x7fb1900cfcd0 legacy=0x7fb19015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.270+0000 7fb195880640 1 -- 172.21.15.42:0/679863394 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1900b36a0 con 0x7fb190156740 2024-09-16T01:56:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.271+0000 7fb195880640 1 --2- 172.21.15.42:0/679863394 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb190156740 0x7fb1900b45b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0097a0 tx=0x7fb18c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b655bcfb147fd9c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.271+0000 7fb19487e640 1 -- 172.21.15.42:0/679863394 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c037070 con 0x7fb190156740 2024-09-16T01:56:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.271+0000 7fb19487e640 1 -- 172.21.15.42:0/679863394 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18c032440 con 0x7fb190156740 2024-09-16T01:56:21.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.271+0000 7fb19487e640 1 -- 172.21.15.42:0/679863394 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0327f0 con 0x7fb190156740 2024-09-16T01:56:21.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.272+0000 7fb197ae4640 1 -- 172.21.15.42:0/679863394 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb190156740 msgr2=0x7fb1900b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.272+0000 7fb197ae4640 1 --2- 172.21.15.42:0/679863394 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb190156740 0x7fb1900b45b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0097a0 tx=0x7fb18c02a180 comp rx=0 tx=0).stop 2024-09-16T01:56:21.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.272+0000 7fb197ae4640 1 -- 172.21.15.42:0/679863394 shutdown_connections 2024-09-16T01:56:21.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.272+0000 7fb197ae4640 1 --2- 172.21.15.42:0/679863394 >> v2:172.21.15.107:3300/0 conn(0x7fb1900b4af0 0x7fb1900cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.272+0000 7fb197ae4640 1 --2- 172.21.15.42:0/679863394 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb190156740 0x7fb1900b45b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.272+0000 7fb197ae4640 1 -- 172.21.15.42:0/679863394 >> 172.21.15.42:0/679863394 conn(0x7fb19006bdf0 msgr2=0x7fb19006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:21.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.272+0000 7fb197ae4640 1 -- 172.21.15.42:0/679863394 shutdown_connections 2024-09-16T01:56:21.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.272+0000 7fb197ae4640 1 -- 172.21.15.42:0/679863394 wait complete. 2024-09-16T01:56:21.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.273+0000 7fb197ae4640 1 Processor -- start 2024-09-16T01:56:21.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.273+0000 7fb197ae4640 1 -- start start 2024-09-16T01:56:21.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb197ae4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb1900b4af0 0x7fb190159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb197ae4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900cfcd0 0x7fb19009bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb197ae4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb190156740 0x7fb19009d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb197ae4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb1900d0890 con 0x7fb1900cfcd0 2024-09-16T01:56:21.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb197ae4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb1900b3c60 con 0x7fb190156740 2024-09-16T01:56:21.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb197ae4640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb1900d0a10 con 0x7fb1900b4af0 2024-09-16T01:56:21.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb19507f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900cfcd0 0x7fb19009bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb19507f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900cfcd0 0x7fb19009bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50202/0 (socket says 172.21.15.42:50202) 2024-09-16T01:56:21.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb19507f640 1 -- 172.21.15.42:0/2874078068 learned_addr learned my addr 172.21.15.42:0/2874078068 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:21.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb196081640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb190156740 0x7fb19009d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.274+0000 7fb195880640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb1900b4af0 0x7fb190159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb19507f640 1 -- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb1900b4af0 msgr2=0x7fb190159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb19507f640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb1900b4af0 0x7fb190159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb19507f640 1 -- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb190156740 msgr2=0x7fb19009d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb19507f640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb190156740 0x7fb19009d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb19507f640 1 -- 172.21.15.42:0/2874078068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19009ae00 con 0x7fb1900cfcd0 2024-09-16T01:56:21.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb196081640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb190156740 0x7fb19009d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:21.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb19507f640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900cfcd0 0x7fb19009bbc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb18000e9b0 tx=0x7fb18000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb1867fc640 1 -- 172.21.15.42:0/2874078068 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180017070 con 0x7fb1900cfcd0 2024-09-16T01:56:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb1867fc640 1 -- 172.21.15.42:0/2874078068 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18000c9a0 con 0x7fb1900cfcd0 2024-09-16T01:56:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb1867fc640 1 -- 172.21.15.42:0/2874078068 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18000cd90 con 0x7fb1900cfcd0 2024-09-16T01:56:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19009b0e0 con 0x7fb1900cfcd0 2024-09-16T01:56:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.275+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb190073460 con 0x7fb1900cfcd0 2024-09-16T01:56:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.276+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb19009b480 con 0x7fb1900cfcd0 2024-09-16T01:56:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.277+0000 7fb1867fc640 1 -- 172.21.15.42:0/2874078068 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb18001a070 con 0x7fb1900cfcd0 2024-09-16T01:56:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.277+0000 7fb1867fc640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb17406c2b0 0x7fb17406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.277+0000 7fb1867fc640 1 -- 172.21.15.42:0/2874078068 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7fb18008b610 con 0x7fb1900cfcd0 2024-09-16T01:56:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.277+0000 7fb1867fc640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] conn(0x7fb174072750 0x7fb174074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.277+0000 7fb1867fc640 1 -- 172.21.15.42:0/2874078068 --> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb18001fe50 con 0x7fb174072750 2024-09-16T01:56:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.277+0000 7fb1867fc640 1 -- 172.21.15.42:0/2874078068 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fb180092050 con 0x7fb1900cfcd0 2024-09-16T01:56:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.277+0000 7fb195880640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb17406c2b0 0x7fb17406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.277+0000 7fb196081640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] conn(0x7fb174072750 0x7fb174074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.278+0000 7fb196081640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] conn(0x7fb174072750 0x7fb174074b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.278+0000 7fb195880640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb17406c2b0 0x7fb17406e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb18c034000 tx=0x7fb18c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.279+0000 7fb1867fc640 1 -- 172.21.15.42:0/2874078068 <== osd.4 v2:172.21.15.107:6808/3395815991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb18001fe50 con 0x7fb174072750 2024-09-16T01:56:21.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.291+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 --> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb1900b1ab0 con 0x7fb174072750 2024-09-16T01:56:21.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb1867fc640 1 -- 172.21.15.42:0/2874078068 <== osd.4 v2:172.21.15.107:6808/3395815991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb1900b1ab0 con 0x7fb174072750 2024-09-16T01:56:21.294 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:56:21.294 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:56:21.295 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:56:21.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] conn(0x7fb174072750 msgr2=0x7fb174074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb197ae4640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:6808/3395815991,v1:172.21.15.107:6809/3395815991] conn(0x7fb174072750 0x7fb174074b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb17406c2b0 msgr2=0x7fb17406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb197ae4640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb17406c2b0 0x7fb17406e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb18c034000 tx=0x7fb18c02e000 comp rx=0 tx=0).stop 2024-09-16T01:56:21.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900cfcd0 msgr2=0x7fb19009bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb197ae4640 1 --2- 172.21.15.42:0/2874078068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900cfcd0 0x7fb19009bbc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb18000e9b0 tx=0x7fb18000ee70 comp rx=0 tx=0).stop 2024-09-16T01:56:21.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb196081640 1 -- 172.21.15.42:0/2874078068 reap_dead start 2024-09-16T01:56:21.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 shutdown_connections 2024-09-16T01:56:21.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 >> 172.21.15.42:0/2874078068 conn(0x7fb19006bdf0 msgr2=0x7fb190155890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:21.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.292+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 shutdown_connections 2024-09-16T01:56:21.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.293+0000 7fb197ae4640 1 -- 172.21.15.42:0/2874078068 wait complete. 2024-09-16T01:56:21.305 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-16T01:56:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.406+0000 7f69dc282640 1 Processor -- start 2024-09-16T01:56:21.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.406+0000 7f69dc282640 1 -- start start 2024-09-16T01:56:21.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69dc282640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f69d415e5d0 0x7f69d40d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69dc282640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d406df60 0x7f69d409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69dc282640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69d406cec0 con 0x7f69d40d1630 2024-09-16T01:56:21.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69dc282640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f69d406dad0 con 0x7f69d415e5d0 2024-09-16T01:56:21.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69dc282640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f69d406d1a0 con 0x7f69d406df60 2024-09-16T01:56:21.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69da81f640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f69d40d1630 0x7f69d4162230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57788/0 (socket says 172.21.15.42:57788) 2024-09-16T01:56:21.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69da81f640 1 -- 172.21.15.42:0/3254129616 learned_addr learned my addr 172.21.15.42:0/3254129616 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:21.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69da01e640 1 --2- 172.21.15.42:0/3254129616 >> v2:172.21.15.107:3300/0 conn(0x7f69d415e5d0 0x7f69d40d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69d981d640 1 --2- 172.21.15.42:0/3254129616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d406df60 0x7f69d409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69d901c640 1 -- 172.21.15.42:0/3254129616 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237907286 0 0) 0x7f69d406cec0 con 0x7f69d40d1630 2024-09-16T01:56:21.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.407+0000 7f69d901c640 1 -- 172.21.15.42:0/3254129616 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69bc003520 con 0x7f69d40d1630 2024-09-16T01:56:21.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.408+0000 7f69d901c640 1 -- 172.21.15.42:0/3254129616 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 152648125 0 0) 0x7f69bc003520 con 0x7f69d40d1630 2024-09-16T01:56:21.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.408+0000 7f69d981d640 1 -- 172.21.15.42:0/3254129616 >> v2:172.21.15.107:3300/0 conn(0x7f69d415e5d0 msgr2=0x7f69d40d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:21.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.408+0000 7f69d981d640 1 --2- 172.21.15.42:0/3254129616 >> v2:172.21.15.107:3300/0 conn(0x7f69d415e5d0 0x7f69d40d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.408+0000 7f69d981d640 1 -- 172.21.15.42:0/3254129616 >> v1:172.21.15.42:6789/0 conn(0x7f69d40d1630 legacy=0x7f69d4162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.408+0000 7f69d981d640 1 -- 172.21.15.42:0/3254129616 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d406d480 con 0x7f69d406df60 2024-09-16T01:56:21.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.408+0000 7f69da01e640 1 --2- 172.21.15.42:0/3254129616 >> v2:172.21.15.107:3300/0 conn(0x7f69d415e5d0 0x7f69d40d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:56:21.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.408+0000 7f69d981d640 1 --2- 172.21.15.42:0/3254129616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d406df60 0x7f69d409aa30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69c80097a0 tx=0x7f69c802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=812bd075425870dc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69d901c640 1 -- 172.21.15.42:0/3254129616 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c8037070 con 0x7f69d406df60 2024-09-16T01:56:21.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69d901c640 1 -- 172.21.15.42:0/3254129616 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c802ac30 con 0x7f69d406df60 2024-09-16T01:56:21.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69d901c640 1 -- 172.21.15.42:0/3254129616 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c40019f0 con 0x7f69d406df60 2024-09-16T01:56:21.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69dc282640 1 -- 172.21.15.42:0/3254129616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d406df60 msgr2=0x7f69d409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69dc282640 1 --2- 172.21.15.42:0/3254129616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d406df60 0x7f69d409aa30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69c80097a0 tx=0x7f69c802a1a0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69dc282640 1 -- 172.21.15.42:0/3254129616 shutdown_connections 2024-09-16T01:56:21.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69dc282640 1 --2- 172.21.15.42:0/3254129616 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d406df60 0x7f69d409aa30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69dc282640 1 --2- 172.21.15.42:0/3254129616 >> v2:172.21.15.107:3300/0 conn(0x7f69d415e5d0 0x7f69d40d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69dc282640 1 -- 172.21.15.42:0/3254129616 >> 172.21.15.42:0/3254129616 conn(0x7f69d40d23a0 msgr2=0x7f69d40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:21.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69dc282640 1 -- 172.21.15.42:0/3254129616 shutdown_connections 2024-09-16T01:56:21.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.409+0000 7f69dc282640 1 -- 172.21.15.42:0/3254129616 wait complete. 2024-09-16T01:56:21.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.410+0000 7f69dc282640 1 Processor -- start 2024-09-16T01:56:21.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.410+0000 7f69dc282640 1 -- start start 2024-09-16T01:56:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69dc282640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69d406df60 0x7f69d41528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69dc282640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d40d1630 0x7f69d40712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69dc282640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69d415e5d0 0x7f69d4071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69dc282640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f69d415eb30 con 0x7f69d415e5d0 2024-09-16T01:56:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69dc282640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f69d415e9b0 con 0x7f69d406df60 2024-09-16T01:56:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69dc282640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f69d409af70 con 0x7f69d40d1630 2024-09-16T01:56:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69da81f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69d415e5d0 0x7f69d4071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69da81f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69d415e5d0 0x7f69d4071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50218/0 (socket says 172.21.15.42:50218) 2024-09-16T01:56:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69da81f640 1 -- 172.21.15.42:0/2971269646 learned_addr learned my addr 172.21.15.42:0/2971269646 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69d981d640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d40d1630 0x7f69d40712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.411+0000 7f69da01e640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69d406df60 0x7f69d41528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69da81f640 1 -- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d40d1630 msgr2=0x7f69d40712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69da81f640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d40d1630 0x7f69d40712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69da81f640 1 -- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69d406df60 msgr2=0x7f69d41528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69da81f640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69d406df60 0x7f69d41528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69da81f640 1 -- 172.21.15.42:0/2971269646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d40c6ff0 con 0x7f69d415e5d0 2024-09-16T01:56:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69da81f640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69d415e5d0 0x7f69d4071800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f69c400cc90 tx=0x7f69c400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69d2ffd640 1 -- 172.21.15.42:0/2971269646 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4017070 con 0x7f69d415e5d0 2024-09-16T01:56:21.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69d2ffd640 1 -- 172.21.15.42:0/2971269646 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c4012400 con 0x7f69d415e5d0 2024-09-16T01:56:21.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69dc282640 1 -- 172.21.15.42:0/2971269646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d40c72d0 con 0x7f69d415e5d0 2024-09-16T01:56:21.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69d2ffd640 1 -- 172.21.15.42:0/2971269646 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c40127b0 con 0x7f69d415e5d0 2024-09-16T01:56:21.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.412+0000 7f69dc282640 1 -- 172.21.15.42:0/2971269646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d40c7890 con 0x7f69d415e5d0 2024-09-16T01:56:21.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.413+0000 7f69dc282640 1 -- 172.21.15.42:0/2971269646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d409aa30 con 0x7f69d415e5d0 2024-09-16T01:56:21.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.414+0000 7f69d2ffd640 1 -- 172.21.15.42:0/2971269646 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f69c401a070 con 0x7f69d415e5d0 2024-09-16T01:56:21.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.414+0000 7f69d2ffd640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69c006c2e0 0x7f69c006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.414+0000 7f69d2ffd640 1 -- 172.21.15.42:0/2971269646 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f69c408b0e0 con 0x7f69d415e5d0 2024-09-16T01:56:21.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.415+0000 7f69da01e640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69c006c2e0 0x7f69c006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.415+0000 7f69da01e640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69c006c2e0 0x7f69c006e7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009560 tx=0x7f69cc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.419+0000 7f69d2ffd640 1 -- 172.21.15.42:0/2971269646 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69c4059370 con 0x7f69d415e5d0 2024-09-16T01:56:21.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.593+0000 7f69dc282640 1 -- 172.21.15.42:0/2971269646 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f69d406e5f0 con 0x7f69c006c2e0 2024-09-16T01:56:21.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.593+0000 7f69d2ffd640 1 -- 172.21.15.42:0/2971269646 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f69d406e5f0 con 0x7f69c006c2e0 2024-09-16T01:56:21.595 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 4 to deep-scrub 2024-09-16T01:56:21.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 -- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69c006c2e0 msgr2=0x7f69c006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69c006c2e0 0x7f69c006e7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009560 tx=0x7f69cc009190 comp rx=0 tx=0).stop 2024-09-16T01:56:21.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 -- 172.21.15.42:0/2971269646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69d415e5d0 msgr2=0x7f69d4071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69d415e5d0 0x7f69d4071800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f69c400cc90 tx=0x7f69c400a430 comp rx=0 tx=0).stop 2024-09-16T01:56:21.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 -- 172.21.15.42:0/2971269646 shutdown_connections 2024-09-16T01:56:21.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f69c006c2e0 0x7f69c006e7a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69d415e5d0 0x7f69d4071800 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f69d40d1630 0x7f69d40712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 --2- 172.21.15.42:0/2971269646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f69d406df60 0x7f69d41528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 -- 172.21.15.42:0/2971269646 >> 172.21.15.42:0/2971269646 conn(0x7f69d40d23a0 msgr2=0x7f69d40b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 -- 172.21.15.42:0/2971269646 shutdown_connections 2024-09-16T01:56:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.595+0000 7f69dc282640 1 -- 172.21.15.42:0/2971269646 wait complete. 2024-09-16T01:56:21.610 INFO:tasks.ceph:Scrubbing osd.5 2024-09-16T01:56:21.610 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:56:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.716+0000 7f7a8f60a640 1 Processor -- start 2024-09-16T01:56:21.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.716+0000 7f7a8f60a640 1 -- start start 2024-09-16T01:56:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.717+0000 7f7a8f60a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7a88162340 0x7f7a8806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.717+0000 7f7a8f60a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a88162e30 0x7f7a880d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.717+0000 7f7a8f60a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a8815ff70 con 0x7f7a880cf280 2024-09-16T01:56:21.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.717+0000 7f7a8f60a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8806de90 con 0x7f7a88162340 2024-09-16T01:56:21.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.717+0000 7f7a8f60a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7a880d4d10 con 0x7f7a88162e30 2024-09-16T01:56:21.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.718+0000 7f7a8d3a6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7a88162340 0x7f7a8806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.718+0000 7f7a8cba5640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7a880cf280 0x7f7a88162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.42:49888/0 (socket says 172.21.15.42:49888) 2024-09-16T01:56:21.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.718+0000 7f7a8cba5640 1 -- 172.21.15.42:0/3491330827 learned_addr learned my addr 172.21.15.42:0/3491330827 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:21.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.718+0000 7f7a8dba7640 1 --2- 172.21.15.42:0/3491330827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a88162e30 0x7f7a880d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.718+0000 7f7a8d3a6640 1 -- 172.21.15.42:0/3491330827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a88162e30 msgr2=0x7f7a880d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:21.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.718+0000 7f7a8d3a6640 1 --2- 172.21.15.42:0/3491330827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a88162e30 0x7f7a880d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.718+0000 7f7a8d3a6640 1 -- 172.21.15.42:0/3491330827 >> v1:172.21.15.107:6789/0 conn(0x7f7a880cf280 legacy=0x7f7a88162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.718+0000 7f7a8d3a6640 1 -- 172.21.15.42:0/3491330827 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a880d4ff0 con 0x7f7a88162340 2024-09-16T01:56:21.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.719+0000 7f7a8d3a6640 1 --2- 172.21.15.42:0/3491330827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a88162340 0x7f7a8806d740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7a840097a0 tx=0x7f7a8402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a53777b2244b661d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.719+0000 7f7a7ffff640 1 -- 172.21.15.42:0/3491330827 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84037070 con 0x7f7a88162340 2024-09-16T01:56:21.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.719+0000 7f7a7ffff640 1 -- 172.21.15.42:0/3491330827 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8402ae50 con 0x7f7a88162340 2024-09-16T01:56:21.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.719+0000 7f7a7ffff640 1 -- 172.21.15.42:0/3491330827 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84032660 con 0x7f7a88162340 2024-09-16T01:56:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.719+0000 7f7a8f60a640 1 -- 172.21.15.42:0/3491330827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a88162340 msgr2=0x7f7a8806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.719+0000 7f7a8f60a640 1 --2- 172.21.15.42:0/3491330827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a88162340 0x7f7a8806d740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7a840097a0 tx=0x7f7a8402a100 comp rx=0 tx=0).stop 2024-09-16T01:56:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.719+0000 7f7a8f60a640 1 -- 172.21.15.42:0/3491330827 shutdown_connections 2024-09-16T01:56:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.719+0000 7f7a8f60a640 1 --2- 172.21.15.42:0/3491330827 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a88162e30 0x7f7a880d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.719+0000 7f7a8f60a640 1 --2- 172.21.15.42:0/3491330827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a88162340 0x7f7a8806d740 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.719+0000 7f7a8f60a640 1 -- 172.21.15.42:0/3491330827 >> 172.21.15.42:0/3491330827 conn(0x7f7a8808bfc0 msgr2=0x7f7a880d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.720+0000 7f7a8f60a640 1 -- 172.21.15.42:0/3491330827 shutdown_connections 2024-09-16T01:56:21.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.720+0000 7f7a8f60a640 1 -- 172.21.15.42:0/3491330827 wait complete. 2024-09-16T01:56:21.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.721+0000 7f7a8f60a640 1 Processor -- start 2024-09-16T01:56:21.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.721+0000 7f7a8f60a640 1 -- start start 2024-09-16T01:56:21.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.721+0000 7f7a8f60a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880cf280 0x7f7a880c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.721+0000 7f7a8f60a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a88162340 0x7f7a88155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.721+0000 7f7a8f60a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a88162e30 0x7f7a881f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.721+0000 7f7a8f60a640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7a880cf6c0 con 0x7f7a880cf280 2024-09-16T01:56:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.721+0000 7f7a8f60a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7a880d52d0 con 0x7f7a88162e30 2024-09-16T01:56:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.721+0000 7f7a8f60a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7a880d2ed0 con 0x7f7a88162340 2024-09-16T01:56:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8d3a6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880cf280 0x7f7a880c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8d3a6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880cf280 0x7f7a880c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50224/0 (socket says 172.21.15.42:50224) 2024-09-16T01:56:21.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8d3a6640 1 -- 172.21.15.42:0/2342275413 learned_addr learned my addr 172.21.15.42:0/2342275413 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:21.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8cba5640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a88162340 0x7f7a88155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8dba7640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a88162e30 0x7f7a881f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8d3a6640 1 -- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a88162340 msgr2=0x7f7a88155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8d3a6640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7a88162340 0x7f7a88155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8d3a6640 1 -- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a88162e30 msgr2=0x7f7a881f7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8d3a6640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a88162e30 0x7f7a881f7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8d3a6640 1 -- 172.21.15.42:0/2342275413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a880c9180 con 0x7f7a880cf280 2024-09-16T01:56:21.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8d3a6640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880cf280 0x7f7a880c8c40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7a84035040 tx=0x7f7a840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a7dffb640 1 -- 172.21.15.42:0/2342275413 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84041070 con 0x7f7a880cf280 2024-09-16T01:56:21.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a7dffb640 1 -- 172.21.15.42:0/2342275413 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8403c460 con 0x7f7a880cf280 2024-09-16T01:56:21.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a88156250 con 0x7f7a880cf280 2024-09-16T01:56:21.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.722+0000 7f7a7dffb640 1 -- 172.21.15.42:0/2342275413 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84037040 con 0x7f7a880cf280 2024-09-16T01:56:21.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.723+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a881e93b0 con 0x7f7a880cf280 2024-09-16T01:56:21.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.723+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a8808e640 con 0x7f7a880cf280 2024-09-16T01:56:21.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.724+0000 7f7a7dffb640 1 -- 172.21.15.42:0/2342275413 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a8403a070 con 0x7f7a880cf280 2024-09-16T01:56:21.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.724+0000 7f7a7dffb640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7a6c06c2b0 0x7f7a6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.725+0000 7f7a7dffb640 1 -- 172.21.15.42:0/2342275413 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f7a840ab520 con 0x7f7a880cf280 2024-09-16T01:56:21.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.725+0000 7f7a7dffb640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x7f7a6c072750 0x7f7a6c074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.725+0000 7f7a8cba5640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7a6c06c2b0 0x7f7a6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.725+0000 7f7a7dffb640 1 -- 172.21.15.42:0/2342275413 --> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a6c075260 con 0x7f7a6c072750 2024-09-16T01:56:21.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.725+0000 7f7a7dffb640 1 -- 172.21.15.42:0/2342275413 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f7a840b2050 con 0x7f7a880cf280 2024-09-16T01:56:21.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.725+0000 7f7a8dba7640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x7f7a6c072750 0x7f7a6c074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.725+0000 7f7a8cba5640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7a6c06c2b0 0x7f7a6c06e770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7a8815f380 tx=0x7f7a78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.725+0000 7f7a8dba7640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x7f7a6c072750 0x7f7a6c074b90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.726+0000 7f7a7dffb640 1 -- 172.21.15.42:0/2342275413 <== osd.5 v2:172.21.15.107:6816/188494589 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a6c075260 con 0x7f7a6c072750 2024-09-16T01:56:21.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.739+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 --> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7a880ba450 con 0x7f7a6c072750 2024-09-16T01:56:21.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.739+0000 7f7a7dffb640 1 -- 172.21.15.42:0/2342275413 <== osd.5 v2:172.21.15.107:6816/188494589 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7a880ba450 con 0x7f7a6c072750 2024-09-16T01:56:21.741 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:56:21.741 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:56:21.741 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:56:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x7f7a6c072750 msgr2=0x7f7a6c074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8f60a640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:6816/188494589,v1:172.21.15.107:6817/188494589] conn(0x7f7a6c072750 0x7f7a6c074b90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7a6c06c2b0 msgr2=0x7f7a6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8f60a640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f7a6c06c2b0 0x7f7a6c06e770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7a8815f380 tx=0x7f7a78009040 comp rx=0 tx=0).stop 2024-09-16T01:56:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880cf280 msgr2=0x7f7a880c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8f60a640 1 --2- 172.21.15.42:0/2342275413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880cf280 0x7f7a880c8c40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7a84035040 tx=0x7f7a840046c0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8dba7640 1 -- 172.21.15.42:0/2342275413 reap_dead start 2024-09-16T01:56:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 shutdown_connections 2024-09-16T01:56:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 >> 172.21.15.42:0/2342275413 conn(0x7f7a8808bfc0 msgr2=0x7f7a88161860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 shutdown_connections 2024-09-16T01:56:21.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.740+0000 7f7a8f60a640 1 -- 172.21.15.42:0/2342275413 wait complete. 2024-09-16T01:56:21.752 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-16T01:56:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.854+0000 7fd1d77f8640 1 Processor -- start 2024-09-16T01:56:21.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.854+0000 7fd1d77f8640 1 -- start start 2024-09-16T01:56:21.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.855+0000 7fd1d77f8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd1d0165260 0x7fd1d0167650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.855+0000 7fd1d77f8640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d00d01c0 con 0x7fd1d015c870 2024-09-16T01:56:21.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.855+0000 7fd1d77f8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d00d04a0 con 0x7fd1d015c490 2024-09-16T01:56:21.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.855+0000 7fd1d77f8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d00cff70 con 0x7fd1d0165260 2024-09-16T01:56:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.855+0000 7fd1d4d93640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd1d015c870 0x7fd1d015cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57798/0 (socket says 172.21.15.42:57798) 2024-09-16T01:56:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.855+0000 7fd1d4d93640 1 -- 172.21.15.42:0/1628895188 learned_addr learned my addr 172.21.15.42:0/1628895188 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.855+0000 7fd1d5d95640 1 --2- 172.21.15.42:0/1628895188 >> v2:172.21.15.107:3300/0 conn(0x7fd1d0165260 0x7fd1d0167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.855+0000 7fd1c7fff640 1 -- 172.21.15.42:0/1628895188 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263958476 0 0) 0x7fd1d00d01c0 con 0x7fd1d015c870 2024-09-16T01:56:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.855+0000 7fd1c7fff640 1 -- 172.21.15.42:0/1628895188 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1bc003520 con 0x7fd1d015c870 2024-09-16T01:56:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.856+0000 7fd1c7fff640 1 -- 172.21.15.42:0/1628895188 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3964661631 0 0) 0x7fd1bc003520 con 0x7fd1d015c870 2024-09-16T01:56:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.856+0000 7fd1d5d95640 1 -- 172.21.15.42:0/1628895188 >> v1:172.21.15.107:6789/0 conn(0x7fd1d015c490 legacy=0x7fd1d009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.856+0000 7fd1d5d95640 1 -- 172.21.15.42:0/1628895188 >> v1:172.21.15.42:6789/0 conn(0x7fd1d015c870 legacy=0x7fd1d015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.856+0000 7fd1d5d95640 1 -- 172.21.15.42:0/1628895188 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d00d0780 con 0x7fd1d0165260 2024-09-16T01:56:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1d5d95640 1 --2- 172.21.15.42:0/1628895188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1d0165260 0x7fd1d0167650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009d90 tx=0x7fd1c802a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=207dcc99c41327b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1c7fff640 1 -- 172.21.15.42:0/1628895188 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8035020 con 0x7fd1d0165260 2024-09-16T01:56:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1c7fff640 1 -- 172.21.15.42:0/1628895188 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c8007540 con 0x7fd1d0165260 2024-09-16T01:56:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1c7fff640 1 -- 172.21.15.42:0/1628895188 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0001670 con 0x7fd1d0165260 2024-09-16T01:56:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1d77f8640 1 -- 172.21.15.42:0/1628895188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1d0165260 msgr2=0x7fd1d0167650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1d77f8640 1 --2- 172.21.15.42:0/1628895188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1d0165260 0x7fd1d0167650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009d90 tx=0x7fd1c802a630 comp rx=0 tx=0).stop 2024-09-16T01:56:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1d77f8640 1 -- 172.21.15.42:0/1628895188 shutdown_connections 2024-09-16T01:56:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1d77f8640 1 --2- 172.21.15.42:0/1628895188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1d0165260 0x7fd1d0167650 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1d77f8640 1 -- 172.21.15.42:0/1628895188 >> 172.21.15.42:0/1628895188 conn(0x7fd1d00d23a0 msgr2=0x7fd1d00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1d77f8640 1 -- 172.21.15.42:0/1628895188 shutdown_connections 2024-09-16T01:56:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.857+0000 7fd1d77f8640 1 -- 172.21.15.42:0/1628895188 wait complete. 2024-09-16T01:56:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d77f8640 1 Processor -- start 2024-09-16T01:56:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d77f8640 1 -- start start 2024-09-16T01:56:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d77f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d015c490 0x7fd1d0151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d77f8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1d015c870 0x7fd1d01564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d77f8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1d0165260 0x7fd1d0156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d77f8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d00cdfa0 con 0x7fd1d015c490 2024-09-16T01:56:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d77f8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d00d0dd0 con 0x7fd1d0165260 2024-09-16T01:56:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d77f8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d00d1260 con 0x7fd1d015c870 2024-09-16T01:56:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d5594640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d015c490 0x7fd1d0151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d5594640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d015c490 0x7fd1d0151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50232/0 (socket says 172.21.15.42:50232) 2024-09-16T01:56:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.859+0000 7fd1d5594640 1 -- 172.21.15.42:0/2183130573 learned_addr learned my addr 172.21.15.42:0/2183130573 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:21.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1d5d95640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1d0165260 0x7fd1d0156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1d4d93640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1d015c870 0x7fd1d01564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1d5594640 1 -- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1d015c870 msgr2=0x7fd1d01564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1d5594640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1d015c870 0x7fd1d01564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1d5594640 1 -- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1d0165260 msgr2=0x7fd1d0156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:21.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1d5594640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1d0165260 0x7fd1d0156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:21.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1d5594640 1 -- 172.21.15.42:0/2183130573 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d00b5390 con 0x7fd1d015c490 2024-09-16T01:56:21.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1d5594640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d015c490 0x7fd1d0151350 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c570 tx=0x7fd1cc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1c5ffb640 1 -- 172.21.15.42:0/2183130573 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc005480 con 0x7fd1d015c490 2024-09-16T01:56:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1c5ffb640 1 -- 172.21.15.42:0/2183130573 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0035f0 con 0x7fd1d015c490 2024-09-16T01:56:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1d77f8640 1 -- 172.21.15.42:0/2183130573 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d00b5670 con 0x7fd1d015c490 2024-09-16T01:56:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1c5ffb640 1 -- 172.21.15.42:0/2183130573 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0039c0 con 0x7fd1d015c490 2024-09-16T01:56:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.860+0000 7fd1d77f8640 1 -- 172.21.15.42:0/2183130573 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d0151dd0 con 0x7fd1d015c490 2024-09-16T01:56:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.861+0000 7fd1d77f8640 1 -- 172.21.15.42:0/2183130573 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d00d3190 con 0x7fd1d015c490 2024-09-16T01:56:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.862+0000 7fd1c5ffb640 1 -- 172.21.15.42:0/2183130573 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd1cc003b60 con 0x7fd1d015c490 2024-09-16T01:56:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.862+0000 7fd1c5ffb640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd1b406c480 0x7fd1b406e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.862+0000 7fd1c5ffb640 1 -- 172.21.15.42:0/2183130573 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7fd1cc08b030 con 0x7fd1d015c490 2024-09-16T01:56:21.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.862+0000 7fd1d4d93640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd1b406c480 0x7fd1b406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:21.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.863+0000 7fd1d4d93640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd1b406c480 0x7fd1b406e940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0001eb0 tx=0x7fd1c0001c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:21.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:21.866+0000 7fd1c5ffb640 1 -- 172.21.15.42:0/2183130573 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1cc00a2e0 con 0x7fd1d015c490 2024-09-16T01:56:22.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.041+0000 7fd1d77f8640 1 -- 172.21.15.42:0/2183130573 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd1d00b8320 con 0x7fd1b406c480 2024-09-16T01:56:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.042+0000 7fd1c5ffb640 1 -- 172.21.15.42:0/2183130573 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd1d00b8320 con 0x7fd1b406c480 2024-09-16T01:56:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 5 to deep-scrub 2024-09-16T01:56:22.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 -- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd1b406c480 msgr2=0x7fd1b406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd1b406c480 0x7fd1b406e940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0001eb0 tx=0x7fd1c0001c40 comp rx=0 tx=0).stop 2024-09-16T01:56:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 -- 172.21.15.42:0/2183130573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d015c490 msgr2=0x7fd1d0151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d015c490 0x7fd1d0151350 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00c570 tx=0x7fd1cc00ca30 comp rx=0 tx=0).stop 2024-09-16T01:56:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 -- 172.21.15.42:0/2183130573 shutdown_connections 2024-09-16T01:56:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fd1b406c480 0x7fd1b406e940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1d0165260 0x7fd1d0156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd1d015c870 0x7fd1d01564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 --2- 172.21.15.42:0/2183130573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1d015c490 0x7fd1d0151350 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 -- 172.21.15.42:0/2183130573 >> 172.21.15.42:0/2183130573 conn(0x7fd1d00d23a0 msgr2=0x7fd1d0071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:22.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 -- 172.21.15.42:0/2183130573 shutdown_connections 2024-09-16T01:56:22.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.045+0000 7fd1d77f8640 1 -- 172.21.15.42:0/2183130573 wait complete. 2024-09-16T01:56:22.057 INFO:tasks.ceph:Scrubbing osd.6 2024-09-16T01:56:22.058 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:56:22.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.164+0000 7f281d853640 1 Processor -- start 2024-09-16T01:56:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.164+0000 7f281d853640 1 -- start start 2024-09-16T01:56:22.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f281d853640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f28180d15f0 0x7f28180cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f281d853640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28180cf980 con 0x7f2818161a20 2024-09-16T01:56:22.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f281d853640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f281806d050 con 0x7f28180cf160 2024-09-16T01:56:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f281d853640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f2818161e00 con 0x7f28180d15f0 2024-09-16T01:56:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f2816ffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2818161a20 0x7f28180d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57806/0 (socket says 172.21.15.42:57806) 2024-09-16T01:56:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f2816ffd640 1 -- 172.21.15.42:0/4144293977 learned_addr learned my addr 172.21.15.42:0/4144293977 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f28167fc640 1 --2- 172.21.15.42:0/4144293977 >> v2:172.21.15.42:3300/0 conn(0x7f28180d15f0 0x7f28180cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f2815ffb640 1 -- 172.21.15.42:0/4144293977 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498798660 0 0) 0x7f28180cf980 con 0x7f2818161a20 2024-09-16T01:56:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f2815ffb640 1 -- 172.21.15.42:0/4144293977 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2800003520 con 0x7f2818161a20 2024-09-16T01:56:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f28167fc640 1 -- 172.21.15.42:0/4144293977 >> v1:172.21.15.107:6789/0 conn(0x7f28180cf160 legacy=0x7f281806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f28167fc640 1 -- 172.21.15.42:0/4144293977 >> v1:172.21.15.42:6789/0 conn(0x7f2818161a20 legacy=0x7f28180d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f2815ffb640 1 -- 172.21.15.42:0/4144293977 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 819980025 0 0) 0x7f2800003520 con 0x7f2818161a20 2024-09-16T01:56:22.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.165+0000 7f28167fc640 1 -- 172.21.15.42:0/4144293977 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28180cfc20 con 0x7f28180d15f0 2024-09-16T01:56:22.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.166+0000 7f28167fc640 1 --2- 172.21.15.42:0/4144293977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28180d15f0 0x7f28180cec20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f280c0097a0 tx=0x7f280c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631c19cc07554be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.166+0000 7f2815ffb640 1 -- 172.21.15.42:0/4144293977 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c037070 con 0x7f28180d15f0 2024-09-16T01:56:22.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.166+0000 7f2815ffb640 1 -- 172.21.15.42:0/4144293977 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c02ac50 con 0x7f28180d15f0 2024-09-16T01:56:22.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.166+0000 7f2815ffb640 1 -- 172.21.15.42:0/4144293977 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808001690 con 0x7f28180d15f0 2024-09-16T01:56:22.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.167+0000 7f281d853640 1 -- 172.21.15.42:0/4144293977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28180d15f0 msgr2=0x7f28180cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.167+0000 7f281d853640 1 --2- 172.21.15.42:0/4144293977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28180d15f0 0x7f28180cec20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f280c0097a0 tx=0x7f280c02a1c0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.167+0000 7f281d853640 1 -- 172.21.15.42:0/4144293977 shutdown_connections 2024-09-16T01:56:22.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.167+0000 7f281d853640 1 --2- 172.21.15.42:0/4144293977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28180d15f0 0x7f28180cec20 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.167+0000 7f281d853640 1 -- 172.21.15.42:0/4144293977 >> 172.21.15.42:0/4144293977 conn(0x7f281809d850 msgr2=0x7f281808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:22.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.167+0000 7f281d853640 1 -- 172.21.15.42:0/4144293977 shutdown_connections 2024-09-16T01:56:22.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.167+0000 7f281d853640 1 -- 172.21.15.42:0/4144293977 wait complete. 2024-09-16T01:56:22.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.168+0000 7f281d853640 1 Processor -- start 2024-09-16T01:56:22.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.168+0000 7f281d853640 1 -- start start 2024-09-16T01:56:22.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f281d853640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28180cf160 0x7f28180b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f281d853640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28180d15f0 0x7f28180b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f281d853640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818161a20 0x7f281815b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f281d853640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f28180b1040 con 0x7f2818161a20 2024-09-16T01:56:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f281d853640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f281806d2f0 con 0x7f28180cf160 2024-09-16T01:56:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f281d853640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f28180cf590 con 0x7f28180d15f0 2024-09-16T01:56:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f28177fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818161a20 0x7f281815b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f28177fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818161a20 0x7f281815b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50242/0 (socket says 172.21.15.42:50242) 2024-09-16T01:56:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f28177fe640 1 -- 172.21.15.42:0/3114628852 learned_addr learned my addr 172.21.15.42:0/3114628852 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f2816ffd640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28180cf160 0x7f28180b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f28167fc640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28180d15f0 0x7f28180b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f28177fe640 1 -- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28180d15f0 msgr2=0x7f28180b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f28177fe640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f28180d15f0 0x7f28180b81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f28177fe640 1 -- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28180cf160 msgr2=0x7f28180b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f28177fe640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28180cf160 0x7f28180b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.169+0000 7f28177fe640 1 -- 172.21.15.42:0/3114628852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28180b8c00 con 0x7f2818161a20 2024-09-16T01:56:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.170+0000 7f28177fe640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818161a20 0x7f281815b060 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f281000c7a0 tx=0x7f281000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.170+0000 7f27fffff640 1 -- 172.21.15.42:0/3114628852 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810003b70 con 0x7f2818161a20 2024-09-16T01:56:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.170+0000 7f27fffff640 1 -- 172.21.15.42:0/3114628852 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2810003d30 con 0x7f2818161a20 2024-09-16T01:56:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.170+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28180b8ee0 con 0x7f2818161a20 2024-09-16T01:56:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.170+0000 7f27fffff640 1 -- 172.21.15.42:0/3114628852 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281000aa90 con 0x7f2818161a20 2024-09-16T01:56:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.170+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28180b94a0 con 0x7f2818161a20 2024-09-16T01:56:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.171+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28181596c0 con 0x7f2818161a20 2024-09-16T01:56:22.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.171+0000 7f27fffff640 1 -- 172.21.15.42:0/3114628852 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f281000ac30 con 0x7f2818161a20 2024-09-16T01:56:22.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.172+0000 7f27fffff640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f280406c2e0 0x7f280406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.172+0000 7f27fffff640 1 -- 172.21.15.42:0/3114628852 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f281008b1d0 con 0x7f2818161a20 2024-09-16T01:56:22.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.172+0000 7f27fffff640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] conn(0x7f2804072780 0x7f2804074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.172+0000 7f27fffff640 1 -- 172.21.15.42:0/3114628852 --> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2810010e50 con 0x7f2804072780 2024-09-16T01:56:22.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.172+0000 7f27fffff640 1 -- 172.21.15.42:0/3114628852 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f2810092050 con 0x7f2818161a20 2024-09-16T01:56:22.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.172+0000 7f2816ffd640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f280406c2e0 0x7f280406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.172+0000 7f28167fc640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] conn(0x7f2804072780 0x7f2804074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.172+0000 7f2816ffd640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f280406c2e0 0x7f280406e7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f28180cfb50 tx=0x7f2808001bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.173+0000 7f28167fc640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] conn(0x7f2804072780 0x7f2804074bc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.173+0000 7f27fffff640 1 -- 172.21.15.42:0/3114628852 <== osd.6 v2:172.21.15.107:6824/986436490 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2810010e50 con 0x7f2804072780 2024-09-16T01:56:22.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.186+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 --> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f28180cec20 con 0x7f2804072780 2024-09-16T01:56:22.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.186+0000 7f27fffff640 1 -- 172.21.15.42:0/3114628852 <== osd.6 v2:172.21.15.107:6824/986436490 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f28180cec20 con 0x7f2804072780 2024-09-16T01:56:22.188 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:56:22.188 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:56:22.188 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:56:22.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] conn(0x7f2804072780 msgr2=0x7f2804074bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f281d853640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:6824/986436490,v1:172.21.15.107:6825/986436490] conn(0x7f2804072780 0x7f2804074bc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f280406c2e0 msgr2=0x7f280406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f281d853640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f280406c2e0 0x7f280406e7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f28180cfb50 tx=0x7f2808001bc0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818161a20 msgr2=0x7f281815b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f281d853640 1 --2- 172.21.15.42:0/3114628852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2818161a20 0x7f281815b060 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f281000c7a0 tx=0x7f281000cc60 comp rx=0 tx=0).stop 2024-09-16T01:56:22.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f28177fe640 1 -- 172.21.15.42:0/3114628852 reap_dead start 2024-09-16T01:56:22.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 shutdown_connections 2024-09-16T01:56:22.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 >> 172.21.15.42:0/3114628852 conn(0x7f281809d850 msgr2=0x7f281815ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:22.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 shutdown_connections 2024-09-16T01:56:22.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.187+0000 7f281d853640 1 -- 172.21.15.42:0/3114628852 wait complete. 2024-09-16T01:56:22.199 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-16T01:56:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.301+0000 7f865688d640 1 Processor -- start 2024-09-16T01:56:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.302+0000 7f865688d640 1 -- start start 2024-09-16T01:56:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.302+0000 7f865688d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f865015b300 0x7f86500cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.302+0000 7f865688d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86500cdbe0 con 0x7f865006f8d0 2024-09-16T01:56:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.302+0000 7f865688d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86500cd900 con 0x7f86500cd3f0 2024-09-16T01:56:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.302+0000 7f865688d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f86500728a0 con 0x7f865015b300 2024-09-16T01:56:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f8654e2a640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f865006f8d0 0x7f865015b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57808/0 (socket says 172.21.15.42:57808) 2024-09-16T01:56:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f8654e2a640 1 -- 172.21.15.42:0/1635101097 learned_addr learned my addr 172.21.15.42:0/1635101097 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864ffff640 1 --2- 172.21.15.42:0/1635101097 >> v2:172.21.15.107:3300/0 conn(0x7f865015b300 0x7f86500cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227392928 0 0) 0x7f86500cdbe0 con 0x7f865006f8d0 2024-09-16T01:56:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8638005730 con 0x7f865006f8d0 2024-09-16T01:56:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2450985247 0 0) 0x7f86500cd900 con 0x7f86500cd3f0 2024-09-16T01:56:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86500cdbe0 con 0x7f86500cd3f0 2024-09-16T01:56:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2430675531 0 0) 0x7f8638005730 con 0x7f865006f8d0 2024-09-16T01:56:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 >> v2:172.21.15.107:3300/0 conn(0x7f865015b300 msgr2=0x7f86500cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 --2- 172.21.15.42:0/1635101097 >> v2:172.21.15.107:3300/0 conn(0x7f865015b300 0x7f86500cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 >> v1:172.21.15.107:6789/0 conn(0x7f86500cd3f0 legacy=0x7f865006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8650072250 con 0x7f865006f8d0 2024-09-16T01:56:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f86480019f0 con 0x7f865006f8d0 2024-09-16T01:56:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 >> v1:172.21.15.42:6789/0 conn(0x7f865006f8d0 legacy=0x7f865015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f86380061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8638006a10 0x7f8638006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86380073d0 0x7f863800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f86500728a0 con 0x7f8638005da0 2024-09-16T01:56:22.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f863800e2a0 con 0x7f86380073d0 2024-09-16T01:56:22.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f863800e4a0 con 0x7f8638006a10 2024-09-16T01:56:22.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864ffff640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f86380061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f8654e2a640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86380073d0 0x7f863800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.303+0000 7f864f7fe640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8638006a10 0x7f8638006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.304+0000 7f864ffff640 1 -- 172.21.15.42:0/1635101097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8638006a10 msgr2=0x7f8638006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:22.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.304+0000 7f864ffff640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8638006a10 0x7f8638006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.304+0000 7f864ffff640 1 -- 172.21.15.42:0/1635101097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86380073d0 msgr2=0x7f863800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:22.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.304+0000 7f864ffff640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86380073d0 0x7f863800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.304+0000 7f8654e2a640 1 -- 172.21.15.42:0/1635101097 reap_dead start 2024-09-16T01:56:22.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.304+0000 7f864ffff640 1 -- 172.21.15.42:0/1635101097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8638005730 con 0x7f8638005da0 2024-09-16T01:56:22.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.304+0000 7f864f7fe640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8638006a10 0x7f8638006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:22.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.304+0000 7f864ffff640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f86380061a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8640009ac0 tx=0x7f8638007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f5929e6d052f2c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.305+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640036070 con 0x7f8638005da0 2024-09-16T01:56:22.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.305+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8640031400 con 0x7f8638005da0 2024-09-16T01:56:22.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.305+0000 7f864effd640 1 -- 172.21.15.42:0/1635101097 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640009690 con 0x7f8638005da0 2024-09-16T01:56:22.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.305+0000 7f865688d640 1 -- 172.21.15.42:0/1635101097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 msgr2=0x7f86380061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.305+0000 7f865688d640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f86380061a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8640009ac0 tx=0x7f8638007a40 comp rx=0 tx=0).stop 2024-09-16T01:56:22.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.305+0000 7f865688d640 1 -- 172.21.15.42:0/1635101097 shutdown_connections 2024-09-16T01:56:22.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.305+0000 7f865688d640 1 --2- 172.21.15.42:0/1635101097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f86380061a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.305+0000 7f865688d640 1 -- 172.21.15.42:0/1635101097 >> 172.21.15.42:0/1635101097 conn(0x7f8650067d70 msgr2=0x7f865006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:22.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.305+0000 7f865688d640 1 -- 172.21.15.42:0/1635101097 shutdown_connections 2024-09-16T01:56:22.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.305+0000 7f865688d640 1 -- 172.21.15.42:0/1635101097 wait complete. 2024-09-16T01:56:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.306+0000 7f865688d640 1 Processor -- start 2024-09-16T01:56:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f865688d640 1 -- start start 2024-09-16T01:56:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f865688d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f8650153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f865688d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8650155620 0x7f86501e5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f865688d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86500ae5e0 0x7f865015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f865688d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f86500d0160 con 0x7f8638005da0 2024-09-16T01:56:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f865688d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f86500cffe0 con 0x7f86500ae5e0 2024-09-16T01:56:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f865688d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8650072d30 con 0x7f8650155620 2024-09-16T01:56:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f864ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f8650153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f864ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f8650153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50266/0 (socket says 172.21.15.42:50266) 2024-09-16T01:56:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f864ffff640 1 -- 172.21.15.42:0/1474259007 learned_addr learned my addr 172.21.15.42:0/1474259007 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f8654e2a640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86500ae5e0 0x7f865015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.307+0000 7f864f7fe640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8650155620 0x7f86501e5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f864ffff640 1 -- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8650155620 msgr2=0x7f86501e5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f864ffff640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8650155620 0x7f86501e5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f864ffff640 1 -- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86500ae5e0 msgr2=0x7f865015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f864ffff640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86500ae5e0 0x7f865015d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f864ffff640 1 -- 172.21.15.42:0/1474259007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8650153b70 con 0x7f8638005da0 2024-09-16T01:56:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f864f7fe640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8650155620 0x7f86501e5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f864ffff640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f8650153630 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8640034040 tx=0x7f8640004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f864cff9640 1 -- 172.21.15.42:0/1474259007 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864003f020 con 0x7f8638005da0 2024-09-16T01:56:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f864cff9640 1 -- 172.21.15.42:0/1474259007 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8640037040 con 0x7f8638005da0 2024-09-16T01:56:22.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f865688d640 1 -- 172.21.15.42:0/1474259007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86501e6390 con 0x7f8638005da0 2024-09-16T01:56:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f864cff9640 1 -- 172.21.15.42:0/1474259007 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640036070 con 0x7f8638005da0 2024-09-16T01:56:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.308+0000 7f865688d640 1 -- 172.21.15.42:0/1474259007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86501e3940 con 0x7f8638005da0 2024-09-16T01:56:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.309+0000 7f865688d640 1 -- 172.21.15.42:0/1474259007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86500b1d60 con 0x7f8638005da0 2024-09-16T01:56:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.310+0000 7f864cff9640 1 -- 172.21.15.42:0/1474259007 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8640042020 con 0x7f8638005da0 2024-09-16T01:56:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.310+0000 7f864cff9640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f863c06c2b0 0x7f863c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.310+0000 7f864cff9640 1 -- 172.21.15.42:0/1474259007 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f86400aaef0 con 0x7f8638005da0 2024-09-16T01:56:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.310+0000 7f864f7fe640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f863c06c2b0 0x7f863c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.311+0000 7f864f7fe640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f863c06c2b0 0x7f863c06e770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f865015e1f0 tx=0x7f8644009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.314+0000 7f864cff9640 1 -- 172.21.15.42:0/1474259007 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8640049070 con 0x7f8638005da0 2024-09-16T01:56:22.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.494+0000 7f865688d640 1 -- 172.21.15.42:0/1474259007 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f86501e60a0 con 0x7f863c06c2b0 2024-09-16T01:56:22.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.494+0000 7f864cff9640 1 -- 172.21.15.42:0/1474259007 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f86501e60a0 con 0x7f863c06c2b0 2024-09-16T01:56:22.496 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 6 to deep-scrub 2024-09-16T01:56:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 -- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f863c06c2b0 msgr2=0x7f863c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f863c06c2b0 0x7f863c06e770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f865015e1f0 tx=0x7f8644009040 comp rx=0 tx=0).stop 2024-09-16T01:56:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 -- 172.21.15.42:0/1474259007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 msgr2=0x7f8650153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f8650153630 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8640034040 tx=0x7f8640004730 comp rx=0 tx=0).stop 2024-09-16T01:56:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 -- 172.21.15.42:0/1474259007 shutdown_connections 2024-09-16T01:56:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f863c06c2b0 0x7f863c06e770 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86500ae5e0 0x7f865015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8650155620 0x7f86501e5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 --2- 172.21.15.42:0/1474259007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8638005da0 0x7f8650153630 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 -- 172.21.15.42:0/1474259007 >> 172.21.15.42:0/1474259007 conn(0x7f8650067d70 msgr2=0x7f865006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 -- 172.21.15.42:0/1474259007 shutdown_connections 2024-09-16T01:56:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.496+0000 7f865688d640 1 -- 172.21.15.42:0/1474259007 wait complete. 2024-09-16T01:56:22.508 INFO:tasks.ceph:Scrubbing osd.7 2024-09-16T01:56:22.509 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:56:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.613+0000 7fb4f99f8640 1 Processor -- start 2024-09-16T01:56:22.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.613+0000 7fb4f99f8640 1 -- start start 2024-09-16T01:56:22.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f99f8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb4f4159f90 0x7fb4f406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f99f8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4f4160560 0x7fb4f40cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f99f8640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f40b3d10 con 0x7fb4f406ff10 2024-09-16T01:56:22.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f99f8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f40b4db0 con 0x7fb4f4159f90 2024-09-16T01:56:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f99f8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f40b3ff0 con 0x7fb4f4160560 2024-09-16T01:56:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f27fc640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb4f406ff10 0x7fb4f415fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57822/0 (socket says 172.21.15.42:57822) 2024-09-16T01:56:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f27fc640 1 -- 172.21.15.42:0/3764727804 learned_addr learned my addr 172.21.15.42:0/3764727804 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f2ffd640 1 --2- 172.21.15.42:0/3764727804 >> v2:172.21.15.107:3300/0 conn(0x7fb4f4159f90 0x7fb4f406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f37fe640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4f4160560 0x7fb4f40cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231378782 0 0) 0x7fb4f40b3d10 con 0x7fb4f406ff10 2024-09-16T01:56:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4e0003520 con 0x7fb4f406ff10 2024-09-16T01:56:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3814056806 0 0) 0x7fb4e0003520 con 0x7fb4f406ff10 2024-09-16T01:56:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4f4160560 msgr2=0x7fb4f40cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f1ffb640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4f4160560 0x7fb4f40cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 >> v2:172.21.15.107:3300/0 conn(0x7fb4f4159f90 msgr2=0x7fb4f406f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f1ffb640 1 --2- 172.21.15.42:0/3764727804 >> v2:172.21.15.107:3300/0 conn(0x7fb4f4159f90 0x7fb4f406f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f40b42d0 con 0x7fb4f406ff10 2024-09-16T01:56:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7fb4dc001670 con 0x7fb4f406ff10 2024-09-16T01:56:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.614+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 >> v1:172.21.15.42:6789/0 conn(0x7fb4f406ff10 legacy=0x7fb4f415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f1ffb640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4f4160560 0x7fb4e00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f1ffb640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4e0003f80 0x7fb4e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f1ffb640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e0004d40 0x7fb4e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f40b4db0 con 0x7fb4e0003f80 2024-09-16T01:56:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f40b3ff0 con 0x7fb4e0004d40 2024-09-16T01:56:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e000ba70 con 0x7fb4f4160560 2024-09-16T01:56:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f27fc640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4e0003f80 0x7fb4e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f2ffd640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4f4160560 0x7fb4e00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f37fe640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e0004d40 0x7fb4e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f27fc640 1 -- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4f4160560 msgr2=0x7fb4e00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f27fc640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4f4160560 0x7fb4e00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f27fc640 1 -- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e0004d40 msgr2=0x7fb4e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f27fc640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e0004d40 0x7fb4e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.615+0000 7fb4f27fc640 1 -- 172.21.15.42:0/3764727804 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e0003520 con 0x7fb4e0003f80 2024-09-16T01:56:22.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f27fc640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4e0003f80 0x7fb4e0004800 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00c160 tx=0x7fb4e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62b3dc6e9200c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc007c80 con 0x7fb4e0003f80 2024-09-16T01:56:22.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4dc005ad0 con 0x7fb4e0003f80 2024-09-16T01:56:22.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f1ffb640 1 -- 172.21.15.42:0/3764727804 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc007070 con 0x7fb4e0003f80 2024-09-16T01:56:22.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f99f8640 1 -- 172.21.15.42:0/3764727804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4e0003f80 msgr2=0x7fb4e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f99f8640 1 --2- 172.21.15.42:0/3764727804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4e0003f80 0x7fb4e0004800 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00c160 tx=0x7fb4e0005830 comp rx=0 tx=0).stop 2024-09-16T01:56:22.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f37fe640 1 -- 172.21.15.42:0/3764727804 reap_dead start 2024-09-16T01:56:22.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f99f8640 1 -- 172.21.15.42:0/3764727804 shutdown_connections 2024-09-16T01:56:22.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f99f8640 1 -- 172.21.15.42:0/3764727804 >> 172.21.15.42:0/3764727804 conn(0x7fb4f406bdf0 msgr2=0x7fb4f406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:22.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f99f8640 1 -- 172.21.15.42:0/3764727804 shutdown_connections 2024-09-16T01:56:22.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.616+0000 7fb4f99f8640 1 -- 172.21.15.42:0/3764727804 wait complete. 2024-09-16T01:56:22.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.618+0000 7fb4f99f8640 1 Processor -- start 2024-09-16T01:56:22.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.618+0000 7fb4f99f8640 1 -- start start 2024-09-16T01:56:22.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f99f8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4e0003f80 0x7fb4f40b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f99f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f40ae2e0 0x7fb4f41e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f99f8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f40ae760 0x7fb4f41e6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f99f8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f40b3ab0 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f99f8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f40b3930 con 0x7fb4f40ae760 2024-09-16T01:56:22.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f99f8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f40cdfd0 con 0x7fb4e0003f80 2024-09-16T01:56:22.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f27fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f40ae2e0 0x7fb4f41e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f27fc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f40ae2e0 0x7fb4f41e63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50296/0 (socket says 172.21.15.42:50296) 2024-09-16T01:56:22.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f27fc640 1 -- 172.21.15.42:0/538494485 learned_addr learned my addr 172.21.15.42:0/538494485 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:22.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f2ffd640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4e0003f80 0x7fb4f40b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f37fe640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f40ae760 0x7fb4f41e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f27fc640 1 -- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4e0003f80 msgr2=0x7fb4f40b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f27fc640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4e0003f80 0x7fb4f40b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f27fc640 1 -- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f40ae760 msgr2=0x7fb4f41e6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f27fc640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f40ae760 0x7fb4f41e6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f27fc640 1 -- 172.21.15.42:0/538494485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f40b0d60 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f27fc640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f40ae2e0 0x7fb4f41e63d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc02ad60 tx=0x7fb4f415d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4ebfff640 1 -- 172.21.15.42:0/538494485 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc001630 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4ebfff640 1 -- 172.21.15.42:0/538494485 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4dc042070 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f40b1040 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4ebfff640 1 -- 172.21.15.42:0/538494485 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc007270 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.619+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f40b1600 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.620+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4f406f9d0 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.621+0000 7fb4ebfff640 1 -- 172.21.15.42:0/538494485 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb4dc007410 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.621+0000 7fb4ebfff640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4d406c2e0 0x7fb4d406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.621+0000 7fb4ebfff640 1 -- 172.21.15.42:0/538494485 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7fb4dc0ab1f0 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.622+0000 7fb4ebfff640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x7fb4d4072780 0x7fb4d4074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.622+0000 7fb4ebfff640 1 -- 172.21.15.42:0/538494485 --> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4dc02ee50 con 0x7fb4d4072780 2024-09-16T01:56:22.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.622+0000 7fb4f2ffd640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4d406c2e0 0x7fb4d406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.622+0000 7fb4ebfff640 1 -- 172.21.15.42:0/538494485 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fb4dc0b2050 con 0x7fb4f40ae2e0 2024-09-16T01:56:22.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.622+0000 7fb4f37fe640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x7fb4d4072780 0x7fb4d4074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.622+0000 7fb4f2ffd640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4d406c2e0 0x7fb4d406e7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009bc0 tx=0x7fb4e4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.622+0000 7fb4f37fe640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x7fb4d4072780 0x7fb4d4074bc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.623+0000 7fb4ebfff640 1 -- 172.21.15.42:0/538494485 <== osd.7 v2:172.21.15.107:6800/1756026323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb4dc02ee50 con 0x7fb4d4072780 2024-09-16T01:56:22.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.636+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 --> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb4f40b1bc0 con 0x7fb4d4072780 2024-09-16T01:56:22.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.636+0000 7fb4ebfff640 1 -- 172.21.15.42:0/538494485 <== osd.7 v2:172.21.15.107:6800/1756026323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb4f40b1bc0 con 0x7fb4d4072780 2024-09-16T01:56:22.638 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-16T01:56:22.638 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:56:22.639 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-16T01:56:22.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x7fb4d4072780 msgr2=0x7fb4d4074bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f99f8640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:6800/1756026323,v1:172.21.15.107:6801/1756026323] conn(0x7fb4d4072780 0x7fb4d4074bc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4d406c2e0 msgr2=0x7fb4d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f99f8640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7fb4d406c2e0 0x7fb4d406e7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009bc0 tx=0x7fb4e4009190 comp rx=0 tx=0).stop 2024-09-16T01:56:22.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f40ae2e0 msgr2=0x7fb4f41e63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f99f8640 1 --2- 172.21.15.42:0/538494485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f40ae2e0 0x7fb4f41e63d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc02ad60 tx=0x7fb4f415d870 comp rx=0 tx=0).stop 2024-09-16T01:56:22.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f37fe640 1 -- 172.21.15.42:0/538494485 reap_dead start 2024-09-16T01:56:22.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 shutdown_connections 2024-09-16T01:56:22.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 >> 172.21.15.42:0/538494485 conn(0x7fb4f406bdf0 msgr2=0x7fb4f406ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:22.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 shutdown_connections 2024-09-16T01:56:22.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.637+0000 7fb4f99f8640 1 -- 172.21.15.42:0/538494485 wait complete. 2024-09-16T01:56:22.648 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-16T01:56:22.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.750+0000 7ff06e4ac640 1 Processor -- start 2024-09-16T01:56:22.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.750+0000 7ff06e4ac640 1 -- start start 2024-09-16T01:56:22.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06e4ac640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff06815e760 0x7ff06806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06e4ac640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0680d4fd0 0x7ff0680cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06e4ac640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0680b3650 0x7ff0680cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06e4ac640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff0680d2700 con 0x7ff0680b3650 2024-09-16T01:56:22.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06e4ac640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff0680cedb0 con 0x7ff06815e760 2024-09-16T01:56:22.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06e4ac640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff0680cf090 con 0x7ff0680d4fd0 2024-09-16T01:56:22.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06ca49640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0680b3650 0x7ff0680cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06ca49640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0680b3650 0x7ff0680cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50312/0 (socket says 172.21.15.42:50312) 2024-09-16T01:56:22.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06ca49640 1 -- 172.21.15.42:0/148789477 learned_addr learned my addr 172.21.15.42:0/148789477 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:22.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff067fff640 1 --2- 172.21.15.42:0/148789477 >> v2:172.21.15.107:3300/0 conn(0x7ff06815e760 0x7ff06806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff0677fe640 1 --2- 172.21.15.42:0/148789477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0680d4fd0 0x7ff0680cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06ca49640 1 -- 172.21.15.42:0/148789477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0680d4fd0 msgr2=0x7ff0680cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:22.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06ca49640 1 --2- 172.21.15.42:0/148789477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0680d4fd0 0x7ff0680cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06ca49640 1 -- 172.21.15.42:0/148789477 >> v2:172.21.15.107:3300/0 conn(0x7ff06815e760 msgr2=0x7ff06806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:22.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06ca49640 1 --2- 172.21.15.42:0/148789477 >> v2:172.21.15.107:3300/0 conn(0x7ff06815e760 0x7ff06806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.751+0000 7ff06ca49640 1 -- 172.21.15.42:0/148789477 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0680b3c80 con 0x7ff0680b3650 2024-09-16T01:56:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.752+0000 7ff06ca49640 1 --2- 172.21.15.42:0/148789477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 0x7ff0680cfaf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff06808ca50 tx=0x7ff06002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a6ba7b73a16ed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.752+0000 7ff066ffd640 1 -- 172.21.15.42:0/148789477 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060036070 con 0x7ff0680b3650 2024-09-16T01:56:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.752+0000 7ff066ffd640 1 -- 172.21.15.42:0/148789477 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff060031600 con 0x7ff0680b3650 2024-09-16T01:56:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.752+0000 7ff066ffd640 1 -- 172.21.15.42:0/148789477 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0600319d0 con 0x7ff0680b3650 2024-09-16T01:56:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.753+0000 7ff06e4ac640 1 -- 172.21.15.42:0/148789477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 msgr2=0x7ff0680cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.753+0000 7ff06e4ac640 1 --2- 172.21.15.42:0/148789477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 0x7ff0680cfaf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff06808ca50 tx=0x7ff06002a610 comp rx=0 tx=0).stop 2024-09-16T01:56:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.753+0000 7ff06e4ac640 1 -- 172.21.15.42:0/148789477 shutdown_connections 2024-09-16T01:56:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.753+0000 7ff06e4ac640 1 --2- 172.21.15.42:0/148789477 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff0680d4fd0 0x7ff0680cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.753+0000 7ff06e4ac640 1 --2- 172.21.15.42:0/148789477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 0x7ff0680cfaf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.753+0000 7ff06e4ac640 1 --2- 172.21.15.42:0/148789477 >> v2:172.21.15.107:3300/0 conn(0x7ff06815e760 0x7ff06806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.753+0000 7ff06e4ac640 1 -- 172.21.15.42:0/148789477 >> 172.21.15.42:0/148789477 conn(0x7ff06808bfc0 msgr2=0x7ff0680d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.753+0000 7ff06e4ac640 1 -- 172.21.15.42:0/148789477 shutdown_connections 2024-09-16T01:56:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.753+0000 7ff06e4ac640 1 -- 172.21.15.42:0/148789477 wait complete. 2024-09-16T01:56:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.754+0000 7ff06e4ac640 1 Processor -- start 2024-09-16T01:56:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.754+0000 7ff06e4ac640 1 -- start start 2024-09-16T01:56:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff06e4ac640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 0x7ff068156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff06e4ac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0680d4fd0 0x7ff0680b9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff06e4ac640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff06815e760 0x7ff0680cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff06e4ac640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680d3230 con 0x7ff0680b3650 2024-09-16T01:56:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff06e4ac640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680d30b0 con 0x7ff0680d4fd0 2024-09-16T01:56:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff06e4ac640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff0680d33b0 con 0x7ff06815e760 2024-09-16T01:56:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff067fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 0x7ff068156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff067fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 0x7ff068156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50320/0 (socket says 172.21.15.42:50320) 2024-09-16T01:56:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff067fff640 1 -- 172.21.15.42:0/2569689332 learned_addr learned my addr 172.21.15.42:0/2569689332 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff06ca49640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff06815e760 0x7ff0680cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff0677fe640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0680d4fd0 0x7ff0680b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff067fff640 1 -- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff06815e760 msgr2=0x7ff0680cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff067fff640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff06815e760 0x7ff0680cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff067fff640 1 -- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0680d4fd0 msgr2=0x7ff0680b9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff067fff640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0680d4fd0 0x7ff0680b9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff067fff640 1 -- 172.21.15.42:0/2569689332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff068154530 con 0x7ff0680b3650 2024-09-16T01:56:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.755+0000 7ff067fff640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 0x7ff068156c40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff05800e870 tx=0x7ff05800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.756+0000 7ff064ff9640 1 -- 172.21.15.42:0/2569689332 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058017070 con 0x7ff0680b3650 2024-09-16T01:56:22.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.756+0000 7ff064ff9640 1 -- 172.21.15.42:0/2569689332 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05800c940 con 0x7ff0680b3650 2024-09-16T01:56:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.756+0000 7ff064ff9640 1 -- 172.21.15.42:0/2569689332 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05800cd30 con 0x7ff0680b3650 2024-09-16T01:56:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.756+0000 7ff06e4ac640 1 -- 172.21.15.42:0/2569689332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0680b9e70 con 0x7ff0680b3650 2024-09-16T01:56:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.756+0000 7ff06e4ac640 1 -- 172.21.15.42:0/2569689332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0680b75d0 con 0x7ff0680b3650 2024-09-16T01:56:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.757+0000 7ff06e4ac640 1 -- 172.21.15.42:0/2569689332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0680d36f0 con 0x7ff0680b3650 2024-09-16T01:56:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.757+0000 7ff064ff9640 1 -- 172.21.15.42:0/2569689332 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff05801a070 con 0x7ff0680b3650 2024-09-16T01:56:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.757+0000 7ff064ff9640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05406c2b0 0x7ff05406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.758+0000 7ff064ff9640 1 -- 172.21.15.42:0/2569689332 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7ff05808b540 con 0x7ff0680b3650 2024-09-16T01:56:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.758+0000 7ff0677fe640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05406c2b0 0x7ff05406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.758+0000 7ff0677fe640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05406c2b0 0x7ff05406e770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0680cb520 tx=0x7ff05c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.762+0000 7ff064ff9640 1 -- 172.21.15.42:0/2569689332 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff058059e10 con 0x7ff0680b3650 2024-09-16T01:56:22.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.938+0000 7ff06e4ac640 1 -- 172.21.15.42:0/2569689332 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7ff0680b6d20 con 0x7ff05406c2b0 2024-09-16T01:56:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.939+0000 7ff064ff9640 1 -- 172.21.15.42:0/2569689332 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff0680b6d20 con 0x7ff05406c2b0 2024-09-16T01:56:22.940 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 7 to deep-scrub 2024-09-16T01:56:22.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 -- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05406c2b0 msgr2=0x7ff05406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05406c2b0 0x7ff05406e770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0680cb520 tx=0x7ff05c008040 comp rx=0 tx=0).stop 2024-09-16T01:56:22.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 -- 172.21.15.42:0/2569689332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 msgr2=0x7ff068156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:22.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 0x7ff068156c40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff05800e870 tx=0x7ff05800ed30 comp rx=0 tx=0).stop 2024-09-16T01:56:22.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 -- 172.21.15.42:0/2569689332 shutdown_connections 2024-09-16T01:56:22.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff05406c2b0 0x7ff05406e770 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff06815e760 0x7ff0680cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0680d4fd0 0x7ff0680b9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 --2- 172.21.15.42:0/2569689332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0680b3650 0x7ff068156c40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:22.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 -- 172.21.15.42:0/2569689332 >> 172.21.15.42:0/2569689332 conn(0x7ff06808bfc0 msgr2=0x7ff06806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:22.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 -- 172.21.15.42:0/2569689332 shutdown_connections 2024-09-16T01:56:22.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:22.941+0000 7ff06e4ac640 1 -- 172.21.15.42:0/2569689332 wait complete. 2024-09-16T01:56:22.953 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:56:23.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.055+0000 7f4c11d66640 1 Processor -- start 2024-09-16T01:56:23.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.055+0000 7f4c11d66640 1 -- start start 2024-09-16T01:56:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c11d66640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c15e990 0x7f4c0c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c11d66640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c0c0b6520 con 0x7f4c0c0ae140 2024-09-16T01:56:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c11d66640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c0c0b1a40 con 0x7f4c0c15e5b0 2024-09-16T01:56:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c11d66640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0c0b2c30 con 0x7f4c0c15e990 2024-09-16T01:56:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0bfff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4c0c0ae140 0x7f4c0c0b07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57832/0 (socket says 172.21.15.42:57832) 2024-09-16T01:56:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0bfff640 1 -- 172.21.15.42:0/123282572 learned_addr learned my addr 172.21.15.42:0/123282572 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0affd640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c15e990 0x7f4c0c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827929417 0 0) 0x7f4c0c0b6520 con 0x7f4c0c0ae140 2024-09-16T01:56:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bf4003520 con 0x7f4c0c0ae140 2024-09-16T01:56:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064435462 0 0) 0x7f4c0c0b1a40 con 0x7f4c0c15e5b0 2024-09-16T01:56:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c0c0b6520 con 0x7f4c0c15e5b0 2024-09-16T01:56:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1351546738 0 0) 0x7f4bf4003520 con 0x7f4c0c0ae140 2024-09-16T01:56:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c15e990 msgr2=0x7f4c0c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c15e990 0x7f4c0c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 >> v1:172.21.15.107:6789/0 conn(0x7f4c0c15e5b0 legacy=0x7f4c0c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c0b1d20 con 0x7f4c0c0ae140 2024-09-16T01:56:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 233322242 0 0) 0x7f4c040019f0 con 0x7f4c0c0ae140 2024-09-16T01:56:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 >> v1:172.21.15.42:6789/0 conn(0x7f4c0c0ae140 legacy=0x7f4c0c0b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 0x7f4bf4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c15e990 0x7f4bf4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf4004d40 0x7f4bf40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0b2c30 con 0x7f4bf4003b70 2024-09-16T01:56:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf400ba70 con 0x7f4bf4004d40 2024-09-16T01:56:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf400bc20 con 0x7f4c0c15e990 2024-09-16T01:56:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.056+0000 7f4c0b7fe640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 0x7f4bf4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.057+0000 7f4c0affd640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c15e990 0x7f4bf4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.057+0000 7f4c0bfff640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf4004d40 0x7f4bf40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.057+0000 7f4c0b7fe640 1 -- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c15e990 msgr2=0x7f4bf4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.057+0000 7f4c0b7fe640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c15e990 0x7f4bf4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.057+0000 7f4c0b7fe640 1 -- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf4004d40 msgr2=0x7f4bf40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.057+0000 7f4c0b7fe640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bf4004d40 0x7f4bf40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.057+0000 7f4c0b7fe640 1 -- 172.21.15.42:0/123282572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf4003520 con 0x7f4bf4003b70 2024-09-16T01:56:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.057+0000 7f4c0b7fe640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 0x7f4bf4003f70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0018d0 tx=0x7f4bf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dec3ca229511f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.058+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0014f0 con 0x7f4bf4003b70 2024-09-16T01:56:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.058+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc0052d0 con 0x7f4bf4003b70 2024-09-16T01:56:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.058+0000 7f4c0a7fc640 1 -- 172.21.15.42:0/123282572 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc02aca0 con 0x7f4bf4003b70 2024-09-16T01:56:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.058+0000 7f4c11d66640 1 -- 172.21.15.42:0/123282572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 msgr2=0x7f4bf4003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.058+0000 7f4c11d66640 1 --2- 172.21.15.42:0/123282572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 0x7f4bf4003f70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0018d0 tx=0x7f4bf4005830 comp rx=0 tx=0).stop 2024-09-16T01:56:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.058+0000 7f4c0bfff640 1 -- 172.21.15.42:0/123282572 reap_dead start 2024-09-16T01:56:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.058+0000 7f4c11d66640 1 -- 172.21.15.42:0/123282572 shutdown_connections 2024-09-16T01:56:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.058+0000 7f4c11d66640 1 -- 172.21.15.42:0/123282572 >> 172.21.15.42:0/123282572 conn(0x7f4c0c073490 msgr2=0x7f4c0c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.058+0000 7f4c11d66640 1 -- 172.21.15.42:0/123282572 shutdown_connections 2024-09-16T01:56:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.058+0000 7f4c11d66640 1 -- 172.21.15.42:0/123282572 wait complete. 2024-09-16T01:56:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.059+0000 7f4c11d66640 1 Processor -- start 2024-09-16T01:56:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.060+0000 7f4c11d66640 1 -- start start 2024-09-16T01:56:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.060+0000 7f4c11d66640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 0x7f4c0c14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.060+0000 7f4c11d66640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c152aa0 0x7f4c0c0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.060+0000 7f4c11d66640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c0c0cc780 0x7f4c0c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.060+0000 7f4c11d66640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0b5f40 con 0x7f4bf4003b70 2024-09-16T01:56:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.060+0000 7f4c11d66640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0b0490 con 0x7f4c0c0cc780 2024-09-16T01:56:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.060+0000 7f4c11d66640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0c0b60c0 con 0x7f4c0c152aa0 2024-09-16T01:56:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.060+0000 7f4c0b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 0x7f4c0c14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c0b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 0x7f4c0c14ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50328/0 (socket says 172.21.15.42:50328) 2024-09-16T01:56:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c0b7fe640 1 -- 172.21.15.42:0/1818415117 learned_addr learned my addr 172.21.15.42:0/1818415117 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c0affd640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c152aa0 0x7f4c0c0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c0bfff640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c0c0cc780 0x7f4c0c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c0b7fe640 1 -- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c152aa0 msgr2=0x7f4c0c0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c0b7fe640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c152aa0 0x7f4c0c0cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c0b7fe640 1 -- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c0c0cc780 msgr2=0x7f4c0c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c0b7fe640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c0c0cc780 0x7f4c0c15d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c0b7fe640 1 -- 172.21.15.42:0/1818415117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c0cbc30 con 0x7f4bf4003b70 2024-09-16T01:56:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c0b7fe640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 0x7f4c0c14ee70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0018d0 tx=0x7f4bfc0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:23.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4bf3fff640 1 -- 172.21.15.42:0/1818415117 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc03f020 con 0x7f4bf4003b70 2024-09-16T01:56:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4bf3fff640 1 -- 172.21.15.42:0/1818415117 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc006e50 con 0x7f4bf4003b70 2024-09-16T01:56:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4bf3fff640 1 -- 172.21.15.42:0/1818415117 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc037040 con 0x7f4bf4003b70 2024-09-16T01:56:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c11d66640 1 -- 172.21.15.42:0/1818415117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0c1f7c50 con 0x7f4bf4003b70 2024-09-16T01:56:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.061+0000 7f4c11d66640 1 -- 172.21.15.42:0/1818415117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0c1f8210 con 0x7f4bf4003b70 2024-09-16T01:56:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.062+0000 7f4c11d66640 1 -- 172.21.15.42:0/1818415117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0c0ae5f0 con 0x7f4bf4003b70 2024-09-16T01:56:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.063+0000 7f4bf3fff640 1 -- 172.21.15.42:0/1818415117 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4bfc042020 con 0x7f4bf4003b70 2024-09-16T01:56:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.063+0000 7f4bf3fff640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bf806c2e0 0x7f4bf806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.063+0000 7f4bf3fff640 1 -- 172.21.15.42:0/1818415117 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f4bfc0aad70 con 0x7f4bf4003b70 2024-09-16T01:56:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.064+0000 7f4c0affd640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bf806c2e0 0x7f4bf806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.064+0000 7f4c0affd640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bf806c2e0 0x7f4bf806e7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c160e10 tx=0x7f4c00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.068+0000 7f4bf3fff640 1 -- 172.21.15.42:0/1818415117 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bfc049030 con 0x7f4bf4003b70 2024-09-16T01:56:23.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.241+0000 7f4c11d66640 1 -- 172.21.15.42:0/1818415117 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c0c1f7a00 con 0x7f4bf806c2e0 2024-09-16T01:56:23.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.243+0000 7f4bf3fff640 1 -- 172.21.15.42:0/1818415117 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13396 (secure 0 0 0) 0x7f4c0c1f7a00 con 0x7f4bf806c2e0 2024-09-16T01:56:23.244 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:23.244 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:56:23.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.244+0000 7f4c11d66640 1 -- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bf806c2e0 msgr2=0x7f4bf806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:23.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.244+0000 7f4c11d66640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bf806c2e0 0x7f4bf806e7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c160e10 tx=0x7f4c00008040 comp rx=0 tx=0).stop 2024-09-16T01:56:23.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.244+0000 7f4c11d66640 1 -- 172.21.15.42:0/1818415117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 msgr2=0x7f4c0c14ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:23.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.244+0000 7f4c11d66640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 0x7f4c0c14ee70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0018d0 tx=0x7f4bfc0012d0 comp rx=0 tx=0).stop 2024-09-16T01:56:23.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.245+0000 7f4c11d66640 1 -- 172.21.15.42:0/1818415117 shutdown_connections 2024-09-16T01:56:23.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.245+0000 7f4c11d66640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f4bf806c2e0 0x7f4bf806e7a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:23.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.245+0000 7f4c11d66640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c0c0cc780 0x7f4c0c15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:23.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.245+0000 7f4c11d66640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4c0c152aa0 0x7f4c0c0cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:23.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.245+0000 7f4c11d66640 1 --2- 172.21.15.42:0/1818415117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bf4003b70 0x7f4c0c14ee70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:23.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.245+0000 7f4c11d66640 1 -- 172.21.15.42:0/1818415117 >> 172.21.15.42:0/1818415117 conn(0x7f4c0c073490 msgr2=0x7f4c0c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:23.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.245+0000 7f4c11d66640 1 -- 172.21.15.42:0/1818415117 shutdown_connections 2024-09-16T01:56:23.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:23.245+0000 7f4c11d66640 1 -- 172.21.15.42:0/1818415117 wait complete. 2024-09-16T01:56:23.257 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-09-16T01:56:22.278311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238972,"kb_used_data":6088,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735748,"statfs":{"total":773094113280,"available":772849405952,"internally_reserved":0,"allocated":6234112,"data_stored":3399488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.269570"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":230,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T01:56:15.157819+0000","last_change":"2024-09-16T01:54:10.497919+0000","last_active":"2024-09-16T01:56:15.157819+0000","last_peered":"2024-09-16T01:56:15.157819+0000","last_clean":"2024-09-16T01:56:15.157819+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:56:15.157819+0000","last_undegraded":"2024-09-16T01:56:15.157819+0000","last_fullsized":"2024-09-16T01:56:15.157819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:54:08.326967+0000","last_clean_scrub_stamp":"2024-09-16T01:54:08.326967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:03.106075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31804,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509469,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1224704,"data_stored":867712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1224704,"data_stored":867712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:56:23.261 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T01:54:08.326967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=1, tm_min=54, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=1, tm_min=56, tm_sec=18, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T01:56:23.261 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T01:56:43.263 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:56:43.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.378+0000 7ff493511640 1 Processor -- start 2024-09-16T01:56:43.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.378+0000 7ff493511640 1 -- start start 2024-09-16T01:56:43.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff493511640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff48c15b300 0x7ff48c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff493511640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c0cdbe0 con 0x7ff48c0cd3f0 2024-09-16T01:56:43.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff493511640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c0cd900 con 0x7ff48c06f8d0 2024-09-16T01:56:43.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff493511640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff48c0728a0 con 0x7ff48c15b300 2024-09-16T01:56:43.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff4912ad640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff48c15b300 0x7ff48c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff490aac640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff48c0cd3f0 0x7ff48c06f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:44672/0 (socket says 172.21.15.42:44672) 2024-09-16T01:56:43.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff490aac640 1 -- 172.21.15.42:0/3254448264 learned_addr learned my addr 172.21.15.42:0/3254448264 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:43.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff4912ad640 1 -- 172.21.15.42:0/3254448264 >> v1:172.21.15.107:6789/0 conn(0x7ff48c06f8d0 legacy=0x7ff48c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff4912ad640 1 -- 172.21.15.42:0/3254448264 >> v1:172.21.15.42:6789/0 conn(0x7ff48c0cd3f0 legacy=0x7ff48c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff483fff640 1 -- 172.21.15.42:0/3254448264 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354310731 0 0) 0x7ff48c0cdbe0 con 0x7ff48c0cd3f0 2024-09-16T01:56:43.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.379+0000 7ff4912ad640 1 -- 172.21.15.42:0/3254448264 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c072250 con 0x7ff48c15b300 2024-09-16T01:56:43.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.380+0000 7ff4912ad640 1 --2- 172.21.15.42:0/3254448264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 0x7ff48c0cceb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097a0 tx=0x7ff48802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4695e4f71e4f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:43.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.380+0000 7ff483fff640 1 -- 172.21.15.42:0/3254448264 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488037070 con 0x7ff48c15b300 2024-09-16T01:56:43.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.380+0000 7ff483fff640 1 -- 172.21.15.42:0/3254448264 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff488032440 con 0x7ff48c15b300 2024-09-16T01:56:43.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.380+0000 7ff483fff640 1 -- 172.21.15.42:0/3254448264 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488032810 con 0x7ff48c15b300 2024-09-16T01:56:43.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.381+0000 7ff493511640 1 -- 172.21.15.42:0/3254448264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 msgr2=0x7ff48c0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.381+0000 7ff493511640 1 --2- 172.21.15.42:0/3254448264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 0x7ff48c0cceb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097a0 tx=0x7ff48802a230 comp rx=0 tx=0).stop 2024-09-16T01:56:43.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.381+0000 7ff493511640 1 -- 172.21.15.42:0/3254448264 shutdown_connections 2024-09-16T01:56:43.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.381+0000 7ff493511640 1 --2- 172.21.15.42:0/3254448264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 0x7ff48c0cceb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.381+0000 7ff493511640 1 -- 172.21.15.42:0/3254448264 >> 172.21.15.42:0/3254448264 conn(0x7ff48c067d70 msgr2=0x7ff48c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:43.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.381+0000 7ff493511640 1 -- 172.21.15.42:0/3254448264 shutdown_connections 2024-09-16T01:56:43.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.381+0000 7ff493511640 1 -- 172.21.15.42:0/3254448264 wait complete. 2024-09-16T01:56:43.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.382+0000 7ff493511640 1 Processor -- start 2024-09-16T01:56:43.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.382+0000 7ff493511640 1 -- start start 2024-09-16T01:56:43.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff493511640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff48c06f8d0 0x7ff48c14f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff493511640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff48c0cd3f0 0x7ff48c0af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff493511640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 0x7ff48c158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff493511640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0d0160 con 0x7ff48c15b300 2024-09-16T01:56:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff493511640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0cffe0 con 0x7ff48c0cd3f0 2024-09-16T01:56:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff493511640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff48c072d30 con 0x7ff48c06f8d0 2024-09-16T01:56:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff491aae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 0x7ff48c158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff491aae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 0x7ff48c158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39848/0 (socket says 172.21.15.42:39848) 2024-09-16T01:56:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff491aae640 1 -- 172.21.15.42:0/3239075462 learned_addr learned my addr 172.21.15.42:0/3239075462 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff491aae640 1 -- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff48c06f8d0 msgr2=0x7ff48c14f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff491aae640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff48c06f8d0 0x7ff48c14f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff491aae640 1 -- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff48c0cd3f0 msgr2=0x7ff48c0af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff490aac640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff48c0cd3f0 0x7ff48c0af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff491aae640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff48c0cd3f0 0x7ff48c0af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff491aae640 1 -- 172.21.15.42:0/3239075462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c1e6dd0 con 0x7ff48c15b300 2024-09-16T01:56:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.383+0000 7ff490aac640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff48c0cd3f0 0x7ff48c0af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:56:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.384+0000 7ff491aae640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 0x7ff48c158a20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff48400c7d0 tx=0x7ff48400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:43.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.384+0000 7ff481ffb640 1 -- 172.21.15.42:0/3239075462 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484003b70 con 0x7ff48c15b300 2024-09-16T01:56:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.384+0000 7ff481ffb640 1 -- 172.21.15.42:0/3239075462 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff484003d30 con 0x7ff48c15b300 2024-09-16T01:56:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.384+0000 7ff493511640 1 -- 172.21.15.42:0/3239075462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c1e70b0 con 0x7ff48c15b300 2024-09-16T01:56:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.384+0000 7ff481ffb640 1 -- 172.21.15.42:0/3239075462 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48400aa90 con 0x7ff48c15b300 2024-09-16T01:56:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.384+0000 7ff493511640 1 -- 172.21.15.42:0/3239075462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c1e3940 con 0x7ff48c15b300 2024-09-16T01:56:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.385+0000 7ff493511640 1 -- 172.21.15.42:0/3239075462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c1e3b40 con 0x7ff48c15b300 2024-09-16T01:56:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.386+0000 7ff481ffb640 1 -- 172.21.15.42:0/3239075462 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff48400ac30 con 0x7ff48c15b300 2024-09-16T01:56:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.386+0000 7ff481ffb640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff47006c2b0 0x7ff47006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.386+0000 7ff481ffb640 1 -- 172.21.15.42:0/3239075462 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7ff48408b290 con 0x7ff48c15b300 2024-09-16T01:56:43.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.386+0000 7ff4912ad640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff47006c2b0 0x7ff47006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.387+0000 7ff4912ad640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff47006c2b0 0x7ff47006e770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff488034000 tx=0x7ff48802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:43.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.391+0000 7ff481ffb640 1 -- 172.21.15.42:0/3239075462 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff484059ae0 con 0x7ff48c15b300 2024-09-16T01:56:43.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.562+0000 7ff493511640 1 -- 172.21.15.42:0/3239075462 --> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff48c15a7e0 con 0x7ff47006c2b0 2024-09-16T01:56:43.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.563+0000 7ff481ffb640 1 -- 172.21.15.42:0/3239075462 <== mgr.4104 v2:172.21.15.107:6832/1809370608 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7ff48c15a7e0 con 0x7ff47006c2b0 2024-09-16T01:56:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:43.565 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-16T01:56:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 -- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff47006c2b0 msgr2=0x7ff47006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff47006c2b0 0x7ff47006e770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff488034000 tx=0x7ff48802c000 comp rx=0 tx=0).stop 2024-09-16T01:56:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 -- 172.21.15.42:0/3239075462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 msgr2=0x7ff48c158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 0x7ff48c158a20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff48400c7d0 tx=0x7ff48400cc90 comp rx=0 tx=0).stop 2024-09-16T01:56:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 -- 172.21.15.42:0/3239075462 shutdown_connections 2024-09-16T01:56:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff47006c2b0 0x7ff47006e770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff48c15b300 0x7ff48c158a20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff48c0cd3f0 0x7ff48c0af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 --2- 172.21.15.42:0/3239075462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff48c06f8d0 0x7ff48c14f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 -- 172.21.15.42:0/3239075462 >> 172.21.15.42:0/3239075462 conn(0x7ff48c067d70 msgr2=0x7ff48c15c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 -- 172.21.15.42:0/3239075462 shutdown_connections 2024-09-16T01:56:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.565+0000 7ff493511640 1 -- 172.21.15.42:0/3239075462 wait complete. 2024-09-16T01:56:43.579 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-16T01:56:42.282761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238952,"kb_used_data":6088,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735768,"statfs":{"total":773094113280,"available":772849426432,"internally_reserved":0,"allocated":6234112,"data_stored":3399488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002855"},"pg_stats":[{"pgid":"1.0","version":"53'119","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T01:56:23.398905+0000","last_change":"2024-09-16T01:56:23.398964+0000","last_active":"2024-09-16T01:56:23.398905+0000","last_peered":"2024-09-16T01:56:23.398905+0000","last_clean":"2024-09-16T01:56:23.398905+0000","last_became_active":"2024-09-16T01:54:10.497126+0000","last_became_peered":"2024-09-16T01:54:10.497126+0000","last_unstale":"2024-09-16T01:56:23.398905+0000","last_undegraded":"2024-09-16T01:56:23.398905+0000","last_fullsized":"2024-09-16T01:56:23.398905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'119","last_scrub_stamp":"2024-09-16T01:56:23.398795+0000","last_deep_scrub":"53'119","last_deep_scrub_stamp":"2024-09-16T01:56:23.398795+0000","last_clean_scrub_stamp":"2024-09-16T01:56:23.398795+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:39.575603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31804,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1224704,"data_stored":867712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1224704,"data_stored":867712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":630784,"data_stored":277344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:56:43.580 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T01:56:43.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.681+0000 7f0fa21d8640 1 Processor -- start 2024-09-16T01:56:43.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.682+0000 7f0fa21d8640 1 -- start start 2024-09-16T01:56:43.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.682+0000 7f0fa21d8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f9c15b570 0x7f0f9c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.682+0000 7f0fa21d8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0f9c15b950 0x7f0f9c0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.682+0000 7f0fa21d8640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f9c073b20 con 0x7f0f9c0ccf50 2024-09-16T01:56:43.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.682+0000 7f0fa21d8640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f0f9c0740e0 con 0x7f0f9c15b950 2024-09-16T01:56:43.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.682+0000 7f0fa21d8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0f9c073e00 con 0x7f0f9c15b570 2024-09-16T01:56:43.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.683+0000 7f0f92ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0f9c15b950 0x7f0f9c0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.683+0000 7f0f9bfff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0f9c0ccf50 0x7f0f9c0cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:44682/0 (socket says 172.21.15.42:44682) 2024-09-16T01:56:43.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.683+0000 7f0f9bfff640 1 -- 172.21.15.42:0/4117707707 learned_addr learned my addr 172.21.15.42:0/4117707707 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-09-16T01:56:43.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.683+0000 7f0f9b7fe640 1 --2- 172.21.15.42:0/4117707707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f9c15b570 0x7f0f9c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.683+0000 7f0f92ffd640 1 -- 172.21.15.42:0/4117707707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f9c15b570 msgr2=0x7f0f9c071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:43.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.683+0000 7f0f92ffd640 1 --2- 172.21.15.42:0/4117707707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f9c15b570 0x7f0f9c071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.683+0000 7f0f92ffd640 1 -- 172.21.15.42:0/4117707707 >> v1:172.21.15.42:6789/0 conn(0x7f0f9c0ccf50 legacy=0x7f0f9c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.683+0000 7f0f92ffd640 1 -- 172.21.15.42:0/4117707707 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c0cf320 con 0x7f0f9c15b950 2024-09-16T01:56:43.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.684+0000 7f0f92ffd640 1 --2- 172.21.15.42:0/4117707707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b950 0x7f0f9c0cca10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400a940 tx=0x7f0f8402b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ac7dfa1c54b8cb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:43.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.684+0000 7f0f9affd640 1 -- 172.21.15.42:0/4117707707 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8400b040 con 0x7f0f9c15b950 2024-09-16T01:56:43.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.684+0000 7f0f9affd640 1 -- 172.21.15.42:0/4117707707 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f84030710 con 0x7f0f9c15b950 2024-09-16T01:56:43.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.684+0000 7f0f9affd640 1 -- 172.21.15.42:0/4117707707 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84030ae0 con 0x7f0f9c15b950 2024-09-16T01:56:43.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.685+0000 7f0fa21d8640 1 -- 172.21.15.42:0/4117707707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b950 msgr2=0x7f0f9c0cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.685+0000 7f0fa21d8640 1 --2- 172.21.15.42:0/4117707707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b950 0x7f0f9c0cca10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400a940 tx=0x7f0f8402b4c0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.685+0000 7f0fa21d8640 1 -- 172.21.15.42:0/4117707707 shutdown_connections 2024-09-16T01:56:43.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.685+0000 7f0fa21d8640 1 --2- 172.21.15.42:0/4117707707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b950 0x7f0f9c0cca10 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.685+0000 7f0fa21d8640 1 --2- 172.21.15.42:0/4117707707 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f9c15b570 0x7f0f9c071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.685+0000 7f0fa21d8640 1 -- 172.21.15.42:0/4117707707 >> 172.21.15.42:0/4117707707 conn(0x7f0f9c06bdf0 msgr2=0x7f0f9c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:43.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.685+0000 7f0fa21d8640 1 -- 172.21.15.42:0/4117707707 shutdown_connections 2024-09-16T01:56:43.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.685+0000 7f0fa21d8640 1 -- 172.21.15.42:0/4117707707 wait complete. 2024-09-16T01:56:43.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.686+0000 7f0fa21d8640 1 Processor -- start 2024-09-16T01:56:43.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.686+0000 7f0fa21d8640 1 -- start start 2024-09-16T01:56:43.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0fa21d8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f9c0ccf50 0x7f0f9c14f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0fa21d8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b570 0x7f0f9c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0fa21d8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f9c15b950 0x7f0f9c1f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0fa21d8640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c0cf840 con 0x7f0f9c15b570 2024-09-16T01:56:43.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0fa21d8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c072450 con 0x7f0f9c15b950 2024-09-16T01:56:43.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0fa21d8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0f9c0cf9c0 con 0x7f0f9c0ccf50 2024-09-16T01:56:43.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0f92ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b570 0x7f0f9c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0f92ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b570 0x7f0f9c155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39870/0 (socket says 172.21.15.42:39870) 2024-09-16T01:56:43.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0f92ffd640 1 -- 172.21.15.42:0/519166860 learned_addr learned my addr 172.21.15.42:0/519166860 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:43.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0f9bfff640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f9c15b950 0x7f0f9c1f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.687+0000 7f0f9b7fe640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f9c0ccf50 0x7f0f9c14f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0f92ffd640 1 -- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f9c0ccf50 msgr2=0x7f0f9c14f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0f92ffd640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f9c0ccf50 0x7f0f9c14f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0f92ffd640 1 -- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f9c15b950 msgr2=0x7f0f9c1f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0f92ffd640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f9c15b950 0x7f0f9c1f1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0f92ffd640 1 -- 172.21.15.42:0/519166860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c14fc40 con 0x7f0f9c15b570 2024-09-16T01:56:43.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0f9bfff640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f9c15b950 0x7f0f9c1f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:56:43.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0f92ffd640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b570 0x7f0f9c155100 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400a940 tx=0x7f0f840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:43.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0f98ff9640 1 -- 172.21.15.42:0/519166860 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8403f030 con 0x7f0f9c15b570 2024-09-16T01:56:43.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0f98ff9640 1 -- 172.21.15.42:0/519166860 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f84030510 con 0x7f0f9c15b570 2024-09-16T01:56:43.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0f98ff9640 1 -- 172.21.15.42:0/519166860 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84006e10 con 0x7f0f9c15b570 2024-09-16T01:56:43.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0fa21d8640 1 -- 172.21.15.42:0/519166860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9c14ff20 con 0x7f0f9c15b570 2024-09-16T01:56:43.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.688+0000 7f0fa21d8640 1 -- 172.21.15.42:0/519166860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9c1f1ed0 con 0x7f0f9c15b570 2024-09-16T01:56:43.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.689+0000 7f0fa21d8640 1 -- 172.21.15.42:0/519166860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f9c150120 con 0x7f0f9c15b570 2024-09-16T01:56:43.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.690+0000 7f0f98ff9640 1 -- 172.21.15.42:0/519166860 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0f84042030 con 0x7f0f9c15b570 2024-09-16T01:56:43.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.691+0000 7f0f98ff9640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0f7c06c2b0 0x7f0f7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.691+0000 7f0f98ff9640 1 -- 172.21.15.42:0/519166860 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7f0f840ab9c0 con 0x7f0f9c15b570 2024-09-16T01:56:43.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.691+0000 7f0f9b7fe640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0f7c06c2b0 0x7f0f7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.691+0000 7f0f9b7fe640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0f7c06c2b0 0x7f0f7c06e770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c006fd0 tx=0x7f0f8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:43.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.695+0000 7f0f98ff9640 1 -- 172.21.15.42:0/519166860 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f9c150120 con 0x7f0f9c15b570 2024-09-16T01:56:43.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.871+0000 7f0fa21d8640 1 -- 172.21.15.42:0/519166860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f0f9c071e40 con 0x7f0f9c15b570 2024-09-16T01:56:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.874+0000 7f0f98ff9640 1 -- 172.21.15.42:0/519166860 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7f0f840ade20 con 0x7f0f9c15b570 2024-09-16T01:56:43.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.875+0000 7f0f98ff9640 1 -- 172.21.15.42:0/519166860 <== mon.0 v2:172.21.15.42:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0f84030ea0 con 0x7f0f9c15b570 2024-09-16T01:56:43.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 -- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0f7c06c2b0 msgr2=0x7f0f7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0f7c06c2b0 0x7f0f7c06e770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c006fd0 tx=0x7f0f8c008040 comp rx=0 tx=0).stop 2024-09-16T01:56:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 -- 172.21.15.42:0/519166860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b570 msgr2=0x7f0f9c155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b570 0x7f0f9c155100 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400a940 tx=0x7f0f840046c0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 -- 172.21.15.42:0/519166860 shutdown_connections 2024-09-16T01:56:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7f0f7c06c2b0 0x7f0f7c06e770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f9c15b950 0x7f0f9c1f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f9c15b570 0x7f0f9c155100 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 --2- 172.21.15.42:0/519166860 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0f9c0ccf50 0x7f0f9c14f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 -- 172.21.15.42:0/519166860 >> 172.21.15.42:0/519166860 conn(0x7f0f9c06bdf0 msgr2=0x7f0f9c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:43.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 -- 172.21.15.42:0/519166860 shutdown_connections 2024-09-16T01:56:43.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.877+0000 7f0fa21d8640 1 -- 172.21.15.42:0/519166860 wait complete. 2024-09-16T01:56:43.889 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:56:43.890 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:56:43.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.991+0000 7ff718f98640 1 Processor -- start 2024-09-16T01:56:43.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.991+0000 7ff718f98640 1 -- start start 2024-09-16T01:56:43.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff718f98640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff714145bc0 0x7ff71415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff718f98640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff7140ae140 0x7ff71406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff718f98640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff71409aa30 0x7ff71406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:43.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff718f98640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff7140b3570 con 0x7ff7140ae140 2024-09-16T01:56:43.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff718f98640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff7140b3850 con 0x7ff714145bc0 2024-09-16T01:56:43.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff718f98640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff7140b3b30 con 0x7ff71409aa30 2024-09-16T01:56:43.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff711d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff7140ae140 0x7ff71406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff711d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff7140ae140 0x7ff71406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39884/0 (socket says 172.21.15.42:39884) 2024-09-16T01:56:43.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff711d9b640 1 -- 172.21.15.42:0/3684778268 learned_addr learned my addr 172.21.15.42:0/3684778268 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:43.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff712d9d640 1 --2- 172.21.15.42:0/3684778268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff71409aa30 0x7ff71406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.992+0000 7ff71259c640 1 --2- 172.21.15.42:0/3684778268 >> v2:172.21.15.107:3300/0 conn(0x7ff714145bc0 0x7ff71415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:43.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.993+0000 7ff711d9b640 1 -- 172.21.15.42:0/3684778268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff71409aa30 msgr2=0x7ff71406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:43.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.993+0000 7ff711d9b640 1 --2- 172.21.15.42:0/3684778268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff71409aa30 0x7ff71406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.993+0000 7ff711d9b640 1 -- 172.21.15.42:0/3684778268 >> v2:172.21.15.107:3300/0 conn(0x7ff714145bc0 msgr2=0x7ff71415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:56:43.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.993+0000 7ff711d9b640 1 --2- 172.21.15.42:0/3684778268 >> v2:172.21.15.107:3300/0 conn(0x7ff714145bc0 0x7ff71415ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:43.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.993+0000 7ff711d9b640 1 -- 172.21.15.42:0/3684778268 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7140b1610 con 0x7ff7140ae140 2024-09-16T01:56:43.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.993+0000 7ff711d9b640 1 --2- 172.21.15.42:0/3684778268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7140ae140 0x7ff71406bc10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff708009870 tx=0x7ff70802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3ef61b3623f999 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:43.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff71159a640 1 -- 172.21.15.42:0/3684778268 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708037070 con 0x7ff7140ae140 2024-09-16T01:56:44.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff71159a640 1 -- 172.21.15.42:0/3684778268 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff708032440 con 0x7ff7140ae140 2024-09-16T01:56:44.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff71159a640 1 -- 172.21.15.42:0/3684778268 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708032830 con 0x7ff7140ae140 2024-09-16T01:56:44.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff718f98640 1 -- 172.21.15.42:0/3684778268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7140ae140 msgr2=0x7ff71406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:44.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff718f98640 1 --2- 172.21.15.42:0/3684778268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7140ae140 0x7ff71406bc10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff708009870 tx=0x7ff70802a2a0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff718f98640 1 -- 172.21.15.42:0/3684778268 shutdown_connections 2024-09-16T01:56:44.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff718f98640 1 --2- 172.21.15.42:0/3684778268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff71409aa30 0x7ff71406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff718f98640 1 --2- 172.21.15.42:0/3684778268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7140ae140 0x7ff71406bc10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff718f98640 1 --2- 172.21.15.42:0/3684778268 >> v2:172.21.15.107:3300/0 conn(0x7ff714145bc0 0x7ff71415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff718f98640 1 -- 172.21.15.42:0/3684778268 >> 172.21.15.42:0/3684778268 conn(0x7ff714073490 msgr2=0x7ff7140b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.994+0000 7ff718f98640 1 -- 172.21.15.42:0/3684778268 shutdown_connections 2024-09-16T01:56:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.995+0000 7ff718f98640 1 -- 172.21.15.42:0/3684778268 wait complete. 2024-09-16T01:56:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.996+0000 7ff718f98640 1 Processor -- start 2024-09-16T01:56:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.996+0000 7ff718f98640 1 -- start start 2024-09-16T01:56:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff718f98640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff71409aa30 0x7ff71406fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:44.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff718f98640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7140ae140 0x7ff714070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:44.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff718f98640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff714145bc0 0x7ff714141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:44.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff718f98640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff714145fa0 con 0x7ff714145bc0 2024-09-16T01:56:44.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff718f98640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff7140b1e10 con 0x7ff71409aa30 2024-09-16T01:56:44.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff718f98640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff71413d780 con 0x7ff7140ae140 2024-09-16T01:56:44.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff712d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff714145bc0 0x7ff714141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:44.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff712d9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff714145bc0 0x7ff714141950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39888/0 (socket says 172.21.15.42:39888) 2024-09-16T01:56:44.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff712d9d640 1 -- 172.21.15.42:0/1784391376 learned_addr learned my addr 172.21.15.42:0/1784391376 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-16T01:56:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff711d9b640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7140ae140 0x7ff714070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff71259c640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff71409aa30 0x7ff71406fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff712d9d640 1 -- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7140ae140 msgr2=0x7ff714070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff712d9d640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7140ae140 0x7ff714070020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff712d9d640 1 -- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff71409aa30 msgr2=0x7ff71406fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff712d9d640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff71409aa30 0x7ff71406fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff712d9d640 1 -- 172.21.15.42:0/1784391376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71413da60 con 0x7ff714145bc0 2024-09-16T01:56:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.997+0000 7ff712d9d640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff714145bc0 0x7ff714141950 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff70c007e30 tx=0x7ff70c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.998+0000 7ff702ffd640 1 -- 172.21.15.42:0/1784391376 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c014620 con 0x7ff714145bc0 2024-09-16T01:56:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.998+0000 7ff702ffd640 1 -- 172.21.15.42:0/1784391376 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff70c019070 con 0x7ff714145bc0 2024-09-16T01:56:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.998+0000 7ff718f98640 1 -- 172.21.15.42:0/1784391376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71413dd40 con 0x7ff714145bc0 2024-09-16T01:56:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.998+0000 7ff702ffd640 1 -- 172.21.15.42:0/1784391376 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c014a20 con 0x7ff714145bc0 2024-09-16T01:56:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.998+0000 7ff718f98640 1 -- 172.21.15.42:0/1784391376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7141f0200 con 0x7ff714145bc0 2024-09-16T01:56:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.999+0000 7ff718f98640 1 -- 172.21.15.42:0/1784391376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff71415ca70 con 0x7ff714145bc0 2024-09-16T01:56:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:43.999+0000 7ff702ffd640 1 -- 172.21.15.42:0/1784391376 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff70c014bc0 con 0x7ff714145bc0 2024-09-16T01:56:44.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.000+0000 7ff702ffd640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6f406c2b0 0x7ff6f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.000+0000 7ff702ffd640 1 -- 172.21.15.42:0/1784391376 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5335+0+0 (secure 0 0 0) 0x7ff70c08bbc0 con 0x7ff714145bc0 2024-09-16T01:56:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.000+0000 7ff71259c640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6f406c2b0 0x7ff6f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.000+0000 7ff71259c640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6f406c2b0 0x7ff6f406e770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff714070dc0 tx=0x7ff70400b5e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:44.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.004+0000 7ff702ffd640 1 -- 172.21.15.42:0/1784391376 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff70c059d40 con 0x7ff714145bc0 2024-09-16T01:56:44.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.217+0000 7ff718f98640 1 -- 172.21.15.42:0/1784391376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff714145190 con 0x7ff714145bc0 2024-09-16T01:56:44.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.217+0000 7ff702ffd640 1 -- 172.21.15.42:0/1784391376 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+3914 (secure 0 0 0) 0x7ff70c05e040 con 0x7ff714145bc0 2024-09-16T01:56:44.219 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-16T01:56:44.219 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"btime":"2024-09-16T01:56:12:927433+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3210303754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3210303754},{"type":"v1","addr":"172.21.15.42:6833","nonce":3210303754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5277,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/628179225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":628179225},{"type":"v1","addr":"172.21.15.107:6837","nonce":628179225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3586378815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3586378815},{"type":"v1","addr":"172.21.15.42:6835","nonce":3586378815}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5350,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/2730701875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":2730701875},{"type":"v1","addr":"172.21.15.107:6836","nonce":2730701875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[]} 2024-09-16T01:56:44.219 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 25 2024-09-16T01:56:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 -- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6f406c2b0 msgr2=0x7ff6f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6f406c2b0 0x7ff6f406e770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff714070dc0 tx=0x7ff70400b5e0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 -- 172.21.15.42:0/1784391376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff714145bc0 msgr2=0x7ff714141950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff714145bc0 0x7ff714141950 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff70c007e30 tx=0x7ff70c00e4b0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 -- 172.21.15.42:0/1784391376 shutdown_connections 2024-09-16T01:56:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:6832/1809370608,v1:172.21.15.107:6833/1809370608] conn(0x7ff6f406c2b0 0x7ff6f406e770 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff714145bc0 0x7ff714141950 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff7140ae140 0x7ff714070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 --2- 172.21.15.42:0/1784391376 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff71409aa30 0x7ff71406fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 -- 172.21.15.42:0/1784391376 >> 172.21.15.42:0/1784391376 conn(0x7ff714073490 msgr2=0x7ff71406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 -- 172.21.15.42:0/1784391376 shutdown_connections 2024-09-16T01:56:44.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-16T01:56:44.219+0000 7ff718f98640 1 -- 172.21.15.42:0/1784391376 wait complete. 2024-09-16T01:56:44.232 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-16T01:56:44.232 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T01:56:44.233 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:56:44.233 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.242 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:56:44.242 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:56:44.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.292 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:56:44.293 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:56:44.293 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.304 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:56:44.305 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:56:44.305 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.356 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:56:44.357 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T01:56:44.357 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T01:56:44.357 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.395 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T01:56:44.395 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T01:56:44.395 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.472 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T01:56:44.472 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T01:56:44.472 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.543 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T01:56:44.543 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T01:56:44.543 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-16T01:56:44.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-16T01:56:44.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-16T01:56:44.614 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T01:56:44.614 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-16T01:56:44.614 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.653 INFO:tasks.ceph.osd.4:Stopped 2024-09-16T01:56:44.653 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-16T01:56:44.653 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.725 INFO:tasks.ceph.osd.5:Stopped 2024-09-16T01:56:44.725 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-16T01:56:44.725 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.795 INFO:tasks.ceph.osd.6:Stopped 2024-09-16T01:56:44.796 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-16T01:56:44.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.877 INFO:tasks.ceph.osd.7:Stopped 2024-09-16T01:56:44.878 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T01:56:44.878 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-16T01:56:44.878 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.903 INFO:tasks.ceph.mgr.y:Stopped 2024-09-16T01:56:44.904 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T01:56:44.904 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.946 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T01:56:44.947 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T01:56:44.947 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T01:56:44.947 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.958 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T01:56:44.958 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-16T01:56:44.958 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:44.999 INFO:tasks.ceph.mon.b:Stopped 2024-09-16T01:56:44.999 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-16T01:56:44.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:56:45.051 INFO:tasks.ceph.mon.c:Stopped 2024-09-16T01:56:45.051 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T01:56:45.051 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | egrep -v 'object missing on disk' | egrep -v 'Invalid tag char' | head -n 1 2024-09-16T01:56:45.093 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:56:45.094 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T01:56:45.320 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:56:45.320 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T01:56:45.419 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:56:45.420 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T01:56:45.485 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:56:45.485 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T01:56:45.545 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:56:45.545 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-16T01:56:45.739 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:56:45.739 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-16T01:56:45.799 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:56:45.800 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-16T01:56:45.858 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:56:45.858 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-16T01:56:45.917 INFO:tasks.ceph:Archiving mon data... 2024-09-16T01:56:45.918 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497/data/mon.a.tgz 2024-09-16T01:56:45.919 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-16T01:56:45.936 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.2gHYdQ0BRf 2024-09-16T01:56:45.937 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.2gHYdQ0BRf 2024-09-16T01:56:46.072 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.2gHYdQ0BRf 2024-09-16T01:56:46.157 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.2gHYdQ0BRf is 332KB 2024-09-16T01:56:46.227 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.2gHYdQ0BRf 2024-09-16T01:56:46.242 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497/data/mon.b.tgz 2024-09-16T01:56:46.242 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-16T01:56:46.261 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.8xyYLfdEU3 2024-09-16T01:56:46.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8xyYLfdEU3 2024-09-16T01:56:46.425 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.8xyYLfdEU3 2024-09-16T01:56:46.510 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.8xyYLfdEU3 is 441KB 2024-09-16T01:56:46.580 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.8xyYLfdEU3 2024-09-16T01:56:46.596 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497/data/mon.c.tgz 2024-09-16T01:56:46.596 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-16T01:56:46.650 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.lHU7XYP38Y 2024-09-16T01:56:46.651 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lHU7XYP38Y 2024-09-16T01:56:46.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.lHU7XYP38Y 2024-09-16T01:56:46.880 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.lHU7XYP38Y is 440KB 2024-09-16T01:56:46.977 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.lHU7XYP38Y 2024-09-16T01:56:46.992 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T01:56:46.992 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T01:56:46.995 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T01:56:47.077 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T01:56:47.111 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T01:56:47.111 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T01:56:47.113 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497/remote/smithi042/crash 2024-09-16T01:56:47.114 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T01:56:47.145 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497/remote/smithi107/crash 2024-09-16T01:56:47.147 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T01:56:47.174 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:56:47.175 INFO:tasks.ceph:Shutting down logrotate 2024-09-16T01:56:47.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:56:47.271 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-16T01:56:47.298 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-16T01:56:47.323 INFO:tasks.ceph:Compressing logs... 2024-09-16T01:56:47.323 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:56:47.341 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:56:47.365 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T01:56:47.365 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42196.log 2024-09-16T01:56:47.365 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49408.log 2024-09-16T01:56:47.365 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47735.log 2024-09-16T01:56:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36531.log 2024-09-16T01:56:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42595.log 2024-09-16T01:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42590.log 2024-09-16T01:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36531.log.gz 2024-09-16T01:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.1.42595.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-16T01:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42595.log.gz 2024-09-16T01:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.1.42590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36399.log 2024-09-16T01:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42590.log.gz 2024-09-16T01:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36279.log 2024-09-16T01:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36399.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-16T01:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36399.log.gz 2024-09-16T01:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36279.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-16T01:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T01:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36279.log.gz 2024-09-16T01:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36491.log 2024-09-16T01:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42991.log 2024-09-16T01:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36239.log 2024-09-16T01:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.3.42991.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36491.log.gz 2024-09-16T01:56:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.3.42991.log.gz 2024-09-16T01:56:47.413 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-16T01:56:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36444.log 2024-09-16T01:56:47.413 INFO:teuthology.orchestra.run.smithi107.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36239.log.gz 2024-09-16T01:56:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36319.log 2024-09-16T01:56:47.413 INFO:teuthology.orchestra.run.smithi107.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T01:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36444.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-16T01:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36319.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-16T01:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36444.log.gz 2024-09-16T01:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T01:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36319.log.gz 2024-09-16T01:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-osd.5.log: -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-16T01:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T01:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.d.log: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T01:56:47.415 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36359.log 2024-09-16T01:56:47.415 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mgr.x.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-16T01:56:47.415 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-16T01:56:47.415 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.36359.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36359.log.gz 2024-09-16T01:56:47.415 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42995.log 2024-09-16T01:56:47.420 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.3.42995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42995.log.gz 2024-09-16T01:56:47.449 INFO:teuthology.orchestra.run.smithi107.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T01:56:47.472 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49178.log 2024-09-16T01:56:47.472 INFO:teuthology.orchestra.run.smithi042.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42196.log.gz 2024-09-16T01:56:47.473 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49408.log.gz 2024-09-16T01:56:47.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52708.log 2024-09-16T01:56:47.473 INFO:teuthology.orchestra.run.smithi042.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47735.log.gz 2024-09-16T01:56:47.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44793.log 2024-09-16T01:56:47.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52708.log: gzip -5 --verbose -- 89.9% /var/log/ceph/ceph-client.admin.47437.log 2024-09-16T01:56:47.473 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49178.log.gz 2024-09-16T01:56:47.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43686.log 2024-09-16T01:56:47.473 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52708.log.gz 2024-09-16T01:56:47.474 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44793.log.gz 2024-09-16T01:56:47.474 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47351.log 2024-09-16T01:56:47.474 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47437.log.gz 2024-09-16T01:56:47.474 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46897.log 2024-09-16T01:56:47.474 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46813.log 2024-09-16T01:56:47.474 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43686.log.gz 2024-09-16T01:56:47.474 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46897.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47351.log.gz 2024-09-16T01:56:47.475 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52079.log 2024-09-16T01:56:47.475 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46897.log.gz 2024-09-16T01:56:47.475 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49104.log 2024-09-16T01:56:47.475 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46813.log: /var/log/ceph/ceph-client.admin.52079.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.44359.log -- replaced with /var/log/ceph/ceph-client.admin.46813.log.gz 2024-09-16T01:56:47.475 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-16T01:56:47.475 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49104.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.52079.log.gz 2024-09-16T01:56:47.475 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52372.log 2024-09-16T01:56:47.475 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44359.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.49104.log.gz 2024-09-16T01:56:47.476 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46981.log 2024-09-16T01:56:47.476 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44359.log.gz 2024-09-16T01:56:47.476 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44027.log 2024-09-16T01:56:47.476 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46981.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52372.log.gz -5 2024-09-16T01:56:47.476 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41814.log 2024-09-16T01:56:47.476 INFO:teuthology.orchestra.run.smithi042.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46981.log.gz 2024-09-16T01:56:47.476 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51566.log 2024-09-16T01:56:47.476 INFO:teuthology.orchestra.run.smithi042.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44027.log.gz 2024-09-16T01:56:47.477 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49828.log 2024-09-16T01:56:47.477 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51566.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41814.log.gz 2024-09-16T01:56:47.477 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50779.log 2024-09-16T01:56:47.477 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51566.log.gz 2024-09-16T01:56:47.477 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49870.log 2024-09-16T01:56:47.477 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49828.log.gz 2024-09-16T01:56:47.478 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46645.log 2024-09-16T01:56:47.478 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49870.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50779.log.gz 2024-09-16T01:56:47.478 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50357.log 2024-09-16T01:56:47.478 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49870.log.gz 2024-09-16T01:56:47.478 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46645.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T01:56:47.478 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46645.log.gz 2024-09-16T01:56:47.478 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43221.log 2024-09-16T01:56:47.478 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.1.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50357.log.gz 2024-09-16T01:56:47.479 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52037.log 2024-09-16T01:56:47.479 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52834.log 2024-09-16T01:56:47.479 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43221.log.gz 2024-09-16T01:56:47.479 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51418.log 2024-09-16T01:56:47.479 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52037.log.gz/var/log/ceph/ceph-client.admin.52834.log: 2024-09-16T01:56:47.479 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47649.log 2024-09-16T01:56:47.479 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52834.log.gz 2024-09-16T01:56:47.479 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53044.log 2024-09-16T01:56:47.480 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51418.log: /var/log/ceph/ceph-client.admin.47649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41409.log 2024-09-16T01:56:47.480 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51418.log.gz 2024-09-16T01:56:47.480 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53044.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47649.log.gz 2024-09-16T01:56:47.480 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47065.log 2024-09-16T01:56:47.480 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53044.log.gz 2024-09-16T01:56:47.480 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41986.log 2024-09-16T01:56:47.480 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41409.log: /var/log/ceph/ceph-client.admin.47065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2024-09-16T01:56:47.480 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41409.log.gz 2024-09-16T01:56:47.481 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41986.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47065.log.gz 2024-09-16T01:56:47.481 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44357.log 2024-09-16T01:56:47.481 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41986.log.gz 2024-09-16T01:56:47.481 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50485.log 2024-09-16T01:56:47.481 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47563.log: /var/log/ceph/ceph-client.admin.44357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47921.log 2024-09-16T01:56:47.481 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2024-09-16T01:56:47.481 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44357.log.gz 2024-09-16T01:56:47.481 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49324.log 2024-09-16T01:56:47.481 INFO:teuthology.orchestra.run.smithi042.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50485.log.gz 2024-09-16T01:56:47.482 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30136.log 2024-09-16T01:56:47.482 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47921.log: /var/log/ceph/ceph-client.admin.49324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48005.log 2024-09-16T01:56:47.482 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47921.log.gz 2024-09-16T01:56:47.482 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.tmp-client.admin.30136.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49324.log.gz 2024-09-16T01:56:47.482 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30136.log.gz 2024-09-16T01:56:47.482 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2024-09-16T01:56:47.482 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43696.log 2024-09-16T01:56:47.482 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52498.log 2024-09-16T01:56:47.483 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44835.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48005.log.gz 2024-09-16T01:56:47.483 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42346.log 2024-09-16T01:56:47.483 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2024-09-16T01:56:47.483 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43696.log.gz 2024-09-16T01:56:47.483 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51441.log 2024-09-16T01:56:47.483 INFO:teuthology.orchestra.run.smithi042.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52498.log.gz 2024-09-16T01:56:47.483 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45804.log 2024-09-16T01:56:47.483 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42346.log: /var/log/ceph/ceph-client.admin.51441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49215.log 2024-09-16T01:56:47.484 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42346.log.gz 2024-09-16T01:56:47.484 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.2.45804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41586.log 2024-09-16T01:56:47.484 INFO:teuthology.orchestra.run.smithi042.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51441.log.gz 2024-09-16T01:56:47.484 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45804.log.gz 2024-09-16T01:56:47.484 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41858.log 2024-09-16T01:56:47.484 INFO:teuthology.orchestra.run.smithi042.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49215.log.gz 2024-09-16T01:56:47.484 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43095.log 2024-09-16T01:56:47.484 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41586.log.gz 2024-09-16T01:56:47.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48924.log 2024-09-16T01:56:47.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41858.log: /var/log/ceph/ceph-client.admin.43095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50611.log 2024-09-16T01:56:47.485 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41858.log.gz 2024-09-16T01:56:47.485 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43095.log.gz 2024-09-16T01:56:47.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41900.log 2024-09-16T01:56:47.485 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48924.log.gz 2024-09-16T01:56:47.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52750.log 2024-09-16T01:56:47.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50611.log: /var/log/ceph/ceph-client.admin.41900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43137.log 2024-09-16T01:56:47.486 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50611.log.gz 2024-09-16T01:56:47.486 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41900.log.gz 2024-09-16T01:56:47.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51743.log 2024-09-16T01:56:47.486 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52750.log.gz 2024-09-16T01:56:47.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44229.log 2024-09-16T01:56:47.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44565.log 2024-09-16T01:56:47.486 INFO:teuthology.orchestra.run.smithi042.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43137.log.gz 2024-09-16T01:56:47.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44229.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T01:56:47.487 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51743.log.gz 2024-09-16T01:56:47.487 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44229.log.gz 2024-09-16T01:56:47.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44709.log 2024-09-16T01:56:47.487 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44565.log.gz 2024-09-16T01:56:47.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44028.log 2024-09-16T01:56:47.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.44709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49044.log 2024-09-16T01:56:47.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44028.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44709.log.gz 2024-09-16T01:56:47.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48599.log 2024-09-16T01:56:47.488 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44028.log.gz 2024-09-16T01:56:47.488 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50271.log 2024-09-16T01:56:47.488 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.48599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49067.log 2024-09-16T01:56:47.488 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% 0.0% -- replaced with /var/log/ceph/ceph-client.0.48599.log.gz 2024-09-16T01:56:47.488 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49044.log.gz 2024-09-16T01:56:47.488 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T01:56:47.488 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51701.log 2024-09-16T01:56:47.488 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51869.log 2024-09-16T01:56:47.489 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49067.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50271.log.gz 2024-09-16T01:56:47.489 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2024-09-16T01:56:47.489 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49067.log.gz 2024-09-16T01:56:47.489 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51701.log.gz 2024-09-16T01:56:47.489 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47861.log 2024-09-16T01:56:47.489 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51869.log: /var/log/ceph/ceph-client.admin.44877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44021.log 2024-09-16T01:56:47.489 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51869.log.gz 2024-09-16T01:56:47.489 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50863.log 2024-09-16T01:56:47.490 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47861.log.gz 2024-09-16T01:56:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44021.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2024-09-16T01:56:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45042.log 2024-09-16T01:56:47.490 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44021.log.gz 2024-09-16T01:56:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2024-09-16T01:56:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50863.log: /var/log/ceph/ceph-client.admin.45042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42280.log 2024-09-16T01:56:47.490 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50863.log.gz 2024-09-16T01:56:47.490 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50313.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45042.log.gz 2024-09-16T01:56:47.491 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49576.log 2024-09-16T01:56:47.491 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2024-09-16T01:56:47.491 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47479.log 2024-09-16T01:56:47.491 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42280.log: /var/log/ceph/ceph-client.admin.49576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48131.log 2024-09-16T01:56:47.491 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47479.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49576.log.gz 2024-09-16T01:56:47.491 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53170.log 2024-09-16T01:56:47.491 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42280.log.gz 2024-09-16T01:56:47.492 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47479.log.gz 2024-09-16T01:56:47.492 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51289.log 2024-09-16T01:56:47.492 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48131.log: /var/log/ceph/ceph-client.admin.53170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49366.log 2024-09-16T01:56:47.492 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48131.log.gz 2024-09-16T01:56:47.492 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.51289.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53170.log.gz 2024-09-16T01:56:47.492 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50737.log 0.0% 2024-09-16T01:56:47.492 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.0.51289.log.gz 2024-09-16T01:56:47.492 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49492.log 2024-09-16T01:56:47.493 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49366.log: /var/log/ceph/ceph-client.admin.50737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49450.log 2024-09-16T01:56:47.493 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49366.log.gz 2024-09-16T01:56:47.493 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50737.log.gz 2024-09-16T01:56:47.493 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47023.log 2024-09-16T01:56:47.493 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49492.log.gz 2024-09-16T01:56:47.493 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50049.log 2024-09-16T01:56:47.493 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49450.log: /var/log/ceph/ceph-client.admin.47023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51785.log 2024-09-16T01:56:47.493 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49450.log.gz 2024-09-16T01:56:47.494 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47023.log.gz 2024-09-16T01:56:47.494 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49618.log 2024-09-16T01:56:47.494 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43305.log 2024-09-16T01:56:47.494 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51785.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50049.log.gz 2024-09-16T01:56:47.494 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45362.log 2024-09-16T01:56:47.494 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51785.log.gz 2024-09-16T01:56:47.494 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49618.log.gz 2024-09-16T01:56:47.495 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43179.log 2024-09-16T01:56:47.495 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43305.log: /var/log/ceph/ceph-client.0.45362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51659.log 2024-09-16T01:56:47.495 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45362.log.gz 2024-09-16T01:56:47.495 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43305.log.gz 2024-09-16T01:56:47.495 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48047.log 2024-09-16T01:56:47.495 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43179.log.gz 2024-09-16T01:56:47.495 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46478.log 2024-09-16T01:56:47.495 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41942.log 2024-09-16T01:56:47.496 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51659.log.gz 2024-09-16T01:56:47.496 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48047.log: /var/log/ceph/ceph-client.admin.46478.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-16T01:56:47.496 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48047.log.gz 2024-09-16T01:56:47.496 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46478.log.gz 2024-09-16T01:56:47.496 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50821.log 2024-09-16T01:56:47.496 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41942.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44751.log 2024-09-16T01:56:47.496 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41942.log.gz 2024-09-16T01:56:47.497 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45808.log 2024-09-16T01:56:47.497 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44751.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.50821.log.gz -5 2024-09-16T01:56:47.497 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48299.log 2024-09-16T01:56:47.497 INFO:teuthology.orchestra.run.smithi042.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-16T01:56:47.497 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.2.45808.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44751.log.gz 2024-09-16T01:56:47.497 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2024-09-16T01:56:47.497 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45808.log.gz 2024-09-16T01:56:47.497 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46729.log 2024-09-16T01:56:47.498 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48299.log.gz 2024-09-16T01:56:47.498 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47309.log 2024-09-16T01:56:47.498 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46729.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2024-09-16T01:56:47.498 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43694.log 2024-09-16T01:56:47.498 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46729.log.gz 2024-09-16T01:56:47.498 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46236.log 2024-09-16T01:56:47.498 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43694.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47309.log.gz 2024-09-16T01:56:47.498 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52456.log 2024-09-16T01:56:47.499 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43694.log.gz 2024-09-16T01:56:47.499 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44367.log 2024-09-16T01:56:47.499 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52456.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46236.log.gz 2024-09-16T01:56:47.499 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42070.log 2024-09-16T01:56:47.499 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52456.log.gz 2024-09-16T01:56:47.499 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42112.log 2024-09-16T01:56:47.499 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44367.log.gz 2024-09-16T01:56:47.499 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49912.log 2024-09-16T01:56:47.500 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42070.log.gz 2024-09-16T01:56:47.500 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41686.log 2024-09-16T01:56:47.500 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42112.log: /var/log/ceph/ceph-client.admin.49912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47963.log 2024-09-16T01:56:47.500 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42112.log.gz 2024-09-16T01:56:47.500 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49912.log.gz 2024-09-16T01:56:47.500 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41490.log 2024-09-16T01:56:47.500 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41686.log.gz 2024-09-16T01:56:47.500 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49002.log 2024-09-16T01:56:47.501 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53253.log 2024-09-16T01:56:47.501 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41490.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47963.log.gz 2024-09-16T01:56:47.501 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49002.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41490.log.gz 2024-09-16T01:56:47.501 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36184.log 2024-09-16T01:56:47.501 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49002.log.gz 2024-09-16T01:56:47.501 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46025.log 2024-09-16T01:56:47.501 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53253.log: /var/log/ceph/ceph-client.admin.36184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42960.log 2024-09-16T01:56:47.501 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53253.log.gz 2024-09-16T01:56:47.502 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44368.log 2024-09-16T01:56:47.502 INFO:teuthology.orchestra.run.smithi042.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.36184.log.gz 2024-09-16T01:56:47.502 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46025.log.gz 2024-09-16T01:56:47.502 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48173.log 2024-09-16T01:56:47.502 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42960.log.gz 2024-09-16T01:56:47.502 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50527.log 2024-09-16T01:56:47.502 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44368.log: /var/log/ceph/ceph-client.admin.48173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49660.log 2024-09-16T01:56:47.502 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44368.log.gz 2024-09-16T01:56:47.503 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48173.log.gz 2024-09-16T01:56:47.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47819.log 2024-09-16T01:56:47.503 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43018.log 2024-09-16T01:56:47.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49660.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50527.log.gz 2024-09-16T01:56:47.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47777.log 2024-09-16T01:56:47.503 INFO:teuthology.orchestra.run.smithi042.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49660.log.gz 2024-09-16T01:56:47.503 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47819.log.gz 2024-09-16T01:56:47.503 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T01:56:47.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43018.log: /var/log/ceph/ceph-client.admin.47777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45500.log 2024-09-16T01:56:47.504 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43018.log.gz 2024-09-16T01:56:47.504 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mon.a.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47777.log.gz 2024-09-16T01:56:47.504 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50653.log 2024-09-16T01:56:47.504 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47395.log 2024-09-16T01:56:47.504 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45500.log.gz 2024-09-16T01:56:47.504 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47605.log 2024-09-16T01:56:47.504 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48257.log 2024-09-16T01:56:47.504 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47395.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50653.log.gz 2024-09-16T01:56:47.505 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47605.log: gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47395.log.gz 2024-09-16T01:56:47.505 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43347.log 2024-09-16T01:56:47.505 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48257.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47605.log.gz 2024-09-16T01:56:47.505 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2024-09-16T01:56:47.505 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48257.log.gz 2024-09-16T01:56:47.505 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48341.log 2024-09-16T01:56:47.505 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43347.log: /var/log/ceph/ceph-client.admin.44032.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T01:56:47.505 INFO:teuthology.orchestra.run.smithi042.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43347.log.gz 2024-09-16T01:56:47.506 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2024-09-16T01:56:47.506 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46151.log 2024-09-16T01:56:47.506 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50569.log 2024-09-16T01:56:47.506 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.46151.log: gzip -5 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48341.log.gz 2024-09-16T01:56:47.506 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49954.log 2024-09-16T01:56:47.506 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46151.log.gz 2024-09-16T01:56:47.506 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51031.log 2024-09-16T01:56:47.506 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50569.log.gz 2024-09-16T01:56:47.507 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47267.log 2024-09-16T01:56:47.507 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51031.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49954.log.gz 2024-09-16T01:56:47.507 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42772.log 2024-09-16T01:56:47.507 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.47267.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52960.log 2024-09-16T01:56:47.507 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47267.log.gz 2024-09-16T01:56:47.507 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42772.log: -- replaced with /var/log/ceph/ceph-client.admin.51031.log.gz 2024-09-16T01:56:47.507 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53086.log 2024-09-16T01:56:47.507 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.52960.log: -- /var/log/ceph/ceph-mgr.y.log 2024-09-16T01:56:47.508 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53086.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52960.log.gz 2024-09-16T01:56:47.508 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46109.log 2024-09-16T01:56:47.508 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53086.log.gz 2024-09-16T01:56:47.508 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mgr.y.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.42772.log.gz 2024-09-16T01:56:47.508 INFO:teuthology.orchestra.run.smithi042.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-16T01:56:47.508 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51911.log 2024-09-16T01:56:47.508 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52330.log 2024-09-16T01:56:47.508 INFO:teuthology.orchestra.run.smithi042.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46109.log.gz 2024-09-16T01:56:47.509 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46400.log 2024-09-16T01:56:47.509 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52330.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51911.log.gz 2024-09-16T01:56:47.509 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49744.log 2024-09-16T01:56:47.509 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46400.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52330.log.gz 2024-09-16T01:56:47.509 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36538.log 2024-09-16T01:56:47.509 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46400.log.gz 2024-09-16T01:56:47.509 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52918.log 2024-09-16T01:56:47.509 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51995.log 2024-09-16T01:56:47.510 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49744.log.gz 2024-09-16T01:56:47.510 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52918.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36538.log.gz 2024-09-16T01:56:47.510 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50167.log 2024-09-16T01:56:47.510 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51995.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52918.log.gz 2024-09-16T01:56:47.510 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44364.log 2024-09-16T01:56:47.510 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51995.log.gz 2024-09-16T01:56:47.510 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.50167.log: -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T01:56:47.510 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44364.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50167.log.gz 2024-09-16T01:56:47.511 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46288.log 2024-09-16T01:56:47.511 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44364.log.gz 2024-09-16T01:56:47.511 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose/var/log/ceph/ceph.log: -- /var/log/ceph/ceph-client.admin.48089.log 2024-09-16T01:56:47.511 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50401.log 2024-09-16T01:56:47.511 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48089.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46288.log.gz 2024-09-16T01:56:47.511 INFO:teuthology.orchestra.run.smithi042.stderr: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T01:56:47.511 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53212.log 2024-09-16T01:56:47.511 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48089.log.gz 2024-09-16T01:56:47.512 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46939.log 2024-09-16T01:56:47.512 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50401.log.gz 2024-09-16T01:56:47.512 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.53212.log: /var/log/ceph/ceph-client.admin.49786.log 2024-09-16T01:56:47.512 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46939.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43695.log 2024-09-16T01:56:47.512 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53212.log.gz 2024-09-16T01:56:47.512 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46939.log.gz 2024-09-16T01:56:47.512 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46771.log 2024-09-16T01:56:47.512 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43695.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46687.log 2024-09-16T01:56:47.513 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49786.log.gz 2024-09-16T01:56:47.513 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46771.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43695.log.gz 2024-09-16T01:56:47.513 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47521.log 2024-09-16T01:56:47.513 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46771.log.gz 2024-09-16T01:56:47.513 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51097.log 2024-09-16T01:56:47.513 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47521.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46687.log.gz 2024-09-16T01:56:47.513 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44649.log 2024-09-16T01:56:47.513 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2%/var/log/ceph/ceph-client.admin.51097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44033.log 2024-09-16T01:56:47.514 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47521.log.gz 2024-09-16T01:56:47.514 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50229.log 2024-09-16T01:56:47.514 INFO:teuthology.orchestra.run.smithi042.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51097.log.gz 2024-09-16T01:56:47.514 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44649.log.gz 2024-09-16T01:56:47.514 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44033.log: --verbose -- /var/log/ceph/ceph-client.admin.48215.log 2024-09-16T01:56:47.514 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50229.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44033.log.gz 2024-09-16T01:56:47.514 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48595.log 2024-09-16T01:56:47.514 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50229.log.gz 2024-09-16T01:56:47.515 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48215.log: gzip -5 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48215.log.gz 2024-09-16T01:56:47.515 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48407.log 2024-09-16T01:56:47.515 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.48595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48595.log.gz 2024-09-16T01:56:47.515 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52582.log 2024-09-16T01:56:47.515 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44031.log 2024-09-16T01:56:47.515 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48407.log.gz 2024-09-16T01:56:47.515 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43687.log 2024-09-16T01:56:47.515 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44031.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52582.log.gz 2024-09-16T01:56:47.516 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44031.log.gz 2024-09-16T01:56:47.516 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50947.log 2024-09-16T01:56:47.516 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44607.log 2024-09-16T01:56:47.516 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43687.log: gzip/var/log/ceph/ceph-client.admin.50947.log: -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43687.log.gz 2024-09-16T01:56:47.516 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.53295.log 2024-09-16T01:56:47.516 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44607.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50947.log.gz 2024-09-16T01:56:47.516 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45983.log 2024-09-16T01:56:47.516 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44607.log.gz 2024-09-16T01:56:47.517 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41770.log 2024-09-16T01:56:47.517 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53295.log.gz 2024-09-16T01:56:47.517 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43431.log 2024-09-16T01:56:47.517 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6%/var/log/ceph/ceph-client.admin.41770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43389.log 2024-09-16T01:56:47.517 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45983.log.gz 2024-09-16T01:56:47.517 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41770.log.gz 2024-09-16T01:56:47.517 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.43431.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42154.log 2024-09-16T01:56:47.517 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43431.log.gz 2024-09-16T01:56:47.518 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43389.log: /var/log/ceph/ceph-client.0.51285.log 2024-09-16T01:56:47.518 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42154.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43389.log.gz 2024-09-16T01:56:47.518 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.50989.log -- replaced with /var/log/ceph/ceph-client.admin.42154.log.gz 2024-09-16T01:56:47.518 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-16T01:56:47.518 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.51285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51285.log.gz 2024-09-16T01:56:47.518 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43697.log 2024-09-16T01:56:47.518 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49141.log 2024-09-16T01:56:47.518 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43697.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51953.log 2024-09-16T01:56:47.519 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50989.log.gz 2024-09-16T01:56:47.519 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49141.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43697.log.gz 2024-09-16T01:56:47.519 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52624.log 2024-09-16T01:56:47.519 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.51953.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.49141.log.gz 2024-09-16T01:56:47.519 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53002.log 2024-09-16T01:56:47.519 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52624.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51953.log.gz 2024-09-16T01:56:47.519 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52666.log 2024-09-16T01:56:47.519 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52624.log.gz 2024-09-16T01:56:47.519 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51827.log 2024-09-16T01:56:47.520 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53002.log: /var/log/ceph/ceph-client.admin.52666.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53002.log.gz 2024-09-16T01:56:47.520 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44369.log 2024-09-16T01:56:47.520 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.51827.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52666.log.gz 2024-09-16T01:56:47.520 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50695.log 2024-09-16T01:56:47.520 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51827.log.gz 2024-09-16T01:56:47.520 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45367.log 2024-09-16T01:56:47.520 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44369.log: /var/log/ceph/ceph-client.admin.50695.log: gzip -5 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44369.log.gz 2024-09-16T01:56:47.521 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43263.log 2024-09-16T01:56:47.521 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50695.log.gz 2024-09-16T01:56:47.521 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.45367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45367.log.gz 2024-09-16T01:56:47.521 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52121.log 2024-09-16T01:56:47.521 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43515.log 2024-09-16T01:56:47.521 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43263.log.gz 2024-09-16T01:56:47.521 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49534.log 2024-09-16T01:56:47.521 INFO:teuthology.orchestra.run.smithi042.stderr: 88.8%/var/log/ceph/ceph-client.admin.43515.log: -- replaced with /var/log/ceph/ceph-client.admin.52121.log.gz 2024-09-16T01:56:47.522 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36445.log 2024-09-16T01:56:47.522 INFO:teuthology.orchestra.run.smithi042.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43515.log.gz 2024-09-16T01:56:47.522 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42238.log 2024-09-16T01:56:47.522 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36445.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49534.log.gz 2024-09-16T01:56:47.522 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44365.log 2024-09-16T01:56:47.522 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42238.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36445.log.gz 2024-09-16T01:56:47.522 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46194.log 2024-09-16T01:56:47.522 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42238.log.gz 2024-09-16T01:56:47.523 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.44365.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52540.log 2024-09-16T01:56:47.523 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46194.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44365.log.gz 2024-09-16T01:56:47.523 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46568.log 2024-09-16T01:56:47.523 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46194.log.gz 2024-09-16T01:56:47.523 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53128.log 2024-09-16T01:56:47.523 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52540.log.gz 2024-09-16T01:56:47.523 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43473.log 2024-09-16T01:56:47.523 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53128.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46568.log.gz 2024-09-16T01:56:47.523 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44030.log 2024-09-16T01:56:47.524 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53128.log.gz 2024-09-16T01:56:47.524 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.43473.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46067.log 2024-09-16T01:56:47.524 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44030.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43473.log.gz 2024-09-16T01:56:47.524 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44030.log.gz 2024-09-16T01:56:47.524 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.49702.log 2024-09-16T01:56:47.524 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46067.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 88.3% 2024-09-16T01:56:47.524 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46067.log.gz 2024-09-16T01:56:47.525 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50905.log 2024-09-16T01:56:47.525 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49702.log.gz 2024-09-16T01:56:47.525 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52414.log 2024-09-16T01:56:47.525 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5/var/log/ceph/ceph-client.admin.50905.log: --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-16T01:56:47.525 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52414.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50905.log.gz 2024-09-16T01:56:47.525 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46855.log 2024-09-16T01:56:47.525 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52414.log.gz 2024-09-16T01:56:47.525 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52876.log 2024-09-16T01:56:47.525 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.46855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47107.log 2024-09-16T01:56:47.526 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6%/var/log/ceph/ceph-client.admin.52876.log: -- replaced with /var/log/ceph/ceph-client.admin.46855.log.gz 2024-09-16T01:56:47.526 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52792.log 2024-09-16T01:56:47.526 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52876.log.gz 91.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-16T01:56:47.526 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47107.log: 2024-09-16T01:56:47.526 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose 88.8% -- /var/log/ceph/ceph-client.admin.41728.log 2024-09-16T01:56:47.526 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47107.log.gz 2024-09-16T01:56:47.526 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47187.log 2024-09-16T01:56:47.526 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52792.log.gz 2024-09-16T01:56:47.527 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42028.log 2024-09-16T01:56:47.527 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50443.log 2024-09-16T01:56:47.527 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1%/var/log/ceph/ceph-client.admin.47187.log: -- replaced with /var/log/ceph/ceph-client.admin.41728.log.gz 2024-09-16T01:56:47.527 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42028.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47187.log.gzgzip 2024-09-16T01:56:47.527 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47693.log 2024-09-16T01:56:47.527 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42028.log.gz 2024-09-16T01:56:47.527 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50443.log: -- /var/log/ceph/ceph-client.admin.43692.log 2024-09-16T01:56:47.527 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47693.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50443.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45941.log 2024-09-16T01:56:47.528 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-16T01:56:47.528 INFO:teuthology.orchestra.run.smithi042.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47693.log.gz 2024-09-16T01:56:47.528 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44026.log 2024-09-16T01:56:47.528 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43692.log: /var/log/ceph/ceph-client.admin.45941.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43692.log.gz/var/log/ceph/ceph-client.admin.44026.log: 2024-09-16T01:56:47.528 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45941.log.gz 2024-09-16T01:56:47.528 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44026.log.gz 2024-09-16T01:56:47.529 INFO:teuthology.orchestra.run.smithi107.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-16T01:56:47.529 INFO:teuthology.orchestra.run.smithi107.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-16T01:56:47.529 INFO:teuthology.orchestra.run.smithi107.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-16T01:56:47.609 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T01:56:48.103 INFO:teuthology.orchestra.run.smithi107.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-16T01:56:48.104 INFO:teuthology.orchestra.run.smithi107.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-16T01:56:48.111 INFO:teuthology.orchestra.run.smithi107.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-16T01:56:48.132 INFO:teuthology.orchestra.run.smithi042.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T01:56:48.159 INFO:teuthology.orchestra.run.smithi107.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-16T01:56:48.161 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-16T01:56:48.161 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m0.783s 2024-09-16T01:56:48.161 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m3.197s 2024-09-16T01:56:48.162 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.137s 2024-09-16T01:56:48.197 INFO:teuthology.orchestra.run.smithi042.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T01:56:48.217 INFO:teuthology.orchestra.run.smithi042.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T01:56:48.237 INFO:teuthology.orchestra.run.smithi042.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T01:56:48.238 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-16T01:56:48.238 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m0.883s 2024-09-16T01:56:48.238 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m3.395s 2024-09-16T01:56:48.238 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m0.267s 2024-09-16T01:56:48.238 INFO:tasks.ceph:Archiving logs... 2024-09-16T01:56:48.239 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497/remote/smithi042/log 2024-09-16T01:56:48.240 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:56:48.947 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497/remote/smithi107/log 2024-09-16T01:56:48.948 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:56:49.425 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T01:56:49.435 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T01:56:49.435 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:56:49.438 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:56:49.528 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T01:56:49.538 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T01:56:49.538 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:56:49.541 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:56:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:56:49.557 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:56:49.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-16T01:56:49.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-16T01:56:49.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-16T01:56:49.561 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:56:49.561 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-16T01:56:49.561 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 -429us[ -422us] +/- 52ms 2024-09-16T01:56:49.561 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 +346us[ +346us] +/- 64ms 2024-09-16T01:56:49.562 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +290us[ +290us] +/- 88ms 2024-09-16T01:56:49.562 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:56:49.563 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:56:49.563 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-16T01:56:49.564 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 -445us[ -438us] +/- 52ms 2024-09-16T01:56:49.564 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 +351us[ +357us] +/- 64ms 2024-09-16T01:56:49.564 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +291us[ +291us] +/- 88ms 2024-09-16T01:56:49.564 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:56:49.564 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T01:56:49.574 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T01:56:49.574 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T01:56:49.588 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:56:49.682 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:56:49.751 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:56:49.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:56:49.783 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:56:49.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:56:49.812 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T01:56:49.822 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T01:56:49.835 INFO:teuthology.task.internal:Duration was 544.402304 seconds 2024-09-16T01:56:49.836 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T01:56:49.846 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T01:56:49.847 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:56:49.849 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:56:49.890 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:56:49.893 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:56:50.313 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T01:56:50.314 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-09-16T01:56:50.314 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:56:50.377 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-09-16T01:56:50.378 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:56:50.405 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T01:56:50.406 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:56:50.421 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:56:50.475 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T01:56:50.475 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:56:50.494 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:56:50.619 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T01:56:50.629 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T01:56:50.630 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:56:50.655 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:56:50.680 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T01:56:50.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:56:50.699 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:56:50.720 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-09-16T01:56:50.745 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-09-16T01:56:50.757 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:56:50.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:56:50.790 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:56:50.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:56:50.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T01:56:50.824 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T01:56:50.825 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497/remote/smithi042 2024-09-16T01:56:50.826 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:56:50.865 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906497/remote/smithi107 2024-09-16T01:56:50.865 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:56:50.898 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T01:56:50.898 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:56:50.901 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:56:50.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T01:56:50.961 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T01:56:50.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T01:56:50.971 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T01:56:50.971 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:56:50.974 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:56:50.987 INFO:teuthology.orchestra.run.smithi042.stdout: 265325 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:56 /home/ubuntu/cephtest 2024-09-16T01:56:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: 265861 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:56 /home/ubuntu/cephtest 2024-09-16T01:56:51.005 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T01:56:51.017 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T01:56:51.053 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} duration: 544.4023044109344 failure_reason: 'Test failure: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5f7b6379320a411faf7af4c695a22c90 status: fail success: false 2024-09-16T01:56:51.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T01:56:51.132 INFO:teuthology.run:FAIL